Andy Reid@lemmy.world to Technology@lemmy.worldEnglish · 1 year agoAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comexternal-linkmessage-square201fedilinkarrow-up11.09Karrow-down115cross-posted to: [email protected][email protected]technology
arrow-up11.08Karrow-down1external-linkAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comAndy Reid@lemmy.world to Technology@lemmy.worldEnglish · 1 year agomessage-square201fedilinkcross-posted to: [email protected][email protected]technology
minus-squareKairuByte@lemmy.dbzer0.comlinkfedilinkEnglisharrow-up9·1 year agoI’m the idiot human that digs through robots.txt and the site map to see things that aren’t normally accessible by an end user.
I’m the idiot human that digs through robots.txt and the site map to see things that aren’t normally accessible by an end user.