BrikoXM to TechnologyEnglish · 3 months agoAnthropic’s crawler is ignoring websites’ anti-AI scraping policieswww.theverge.comexternal-linkmessage-square1fedilinkarrow-up116arrow-down10file-text
arrow-up116arrow-down1external-linkAnthropic’s crawler is ignoring websites’ anti-AI scraping policieswww.theverge.comBrikoXM to TechnologyEnglish · 3 months agomessage-square1fedilinkfile-text
minus-squareAdmiral Patrick@dubvee.orglinkfedilinkEnglisharrow-up4·3 months agoThe User Agent for it is ClaudeBot if you’re like me and reject all bot agents.
The User Agent for it is
ClaudeBot
if you’re like me and reject all bot agents.