Luu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 1 month agoTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comexternal-linkmessage-square131fedilinkarrow-up1571arrow-down17cross-posted to: [email protected]
arrow-up1564arrow-down1external-linkTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comLuu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 1 month agomessage-square131fedilinkcross-posted to: [email protected]
minus-squarezod000@lemmy.mllinkfedilinkEnglisharrow-up3·1 month agoI don’t hate all bots, I hate this bot specifically because: they intentionally hide that they are a bot to evade our, and everyone else’s, methods of restricting which bots we allow and how much activity we allow. they do not respect the robots.txt the already mentioned lack of rate limiting
I don’t hate all bots, I hate this bot specifically because: