Tea@programming.dev to Technology@lemmy.worldEnglish · 3 days agoWikipedia is giving AI developers its data to fend off bot scrapersenterprise.wikimedia.comexternal-linkmessage-square10fedilinkarrow-up194arrow-down13
arrow-up191arrow-down1external-linkWikipedia is giving AI developers its data to fend off bot scrapersenterprise.wikimedia.comTea@programming.dev to Technology@lemmy.worldEnglish · 3 days agomessage-square10fedilink
minus-squareMonument@lemmy.sdf.orglinkfedilinkEnglisharrow-up12·2 days agoNo, because there isn’t a single IP range or user agent, and many developers are going to lengths to defeat anti-scraping measures, which include user agent spoofing as well as vpns and the like to mask the source of the traffic.
No, because there isn’t a single IP range or user agent, and many developers are going to lengths to defeat anti-scraping measures, which include user agent spoofing as well as vpns and the like to mask the source of the traffic.