Correction (10/11/24): Lebleu reached out to clarify a few detailed regarding the motivations behing the user posting AI-generated materiel and the examples mentioned. These changes were applied...

Wikipedia has a new initiative called WikiProject AI Cleanup. It is a task force of volunteers currently combing through Wikipedia articles, editing or removing false information that appears to have been posted by people using generative AI.

Ilyas Lebleu, a founding member of the cleanup crew, told 404 Media that the crisis began when Wikipedia editors and users began seeing passages that were unmistakably written by a chatbot of some kind.

  • schizo@forum.uncomfortable.businessEnglish
    8·
    1 month ago

    Ah, so the AI version of the chewbacca defense.

    I have to wonder if intentionally shitting on LLMs with plausible nonsense is effective.

    Like, you watch for certain user agents and change what data you actually send the bot vs what a real human might see.

    • Dragonstaff@leminal.spaceEnglish
      31·
      1 month ago

      I suspect it would be difficult to generate enough data to intentionally change a dataset. There are certainly little holes, like the glue pizza thing, but finding and exploiting them would be difficult and noticing you and blocking you as a data source would be easy.

    • T156@lemmy.worldEnglish
      1·
      1 month ago

      I have to wonder if intentionally shitting on LLMs with plausible nonsense is effective.

      I don’t think so. The volume of data is too large for it to make much of a difference, and a scraper can just mimic a human user agent and work that way.

      You’d have to change so much data consistently across so many different places that it would be near-impossible for a single human effort.