Want to stop chatGPT from crawling your website? Just mention Australian mayor Brian Hood (or any of the other names listed in the article)

When asked about these names, ChatGPT responds with “I’m unable to produce a response” or “There was an error generating a response” before terminating the chat session, according to Ars’ testing. The names do not affect outputs using OpenAI’s API systems or in the OpenAI Playground (a special site for developer testing).

The filter also means that it’s likely that ChatGPT won’t be able to answer questions about this article when browsing the web, such as through ChatGPT with Search. Someone could use that to potentially prevent ChatGPT from browsing and processing a website on purpose if they added a forbidden name to the site’s text.

  • CosmicTurtle0@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    27
    ·
    24 days ago

    Misinformation is a feature, not a bug. They never fixed AI from hallucinating or being so damn confident in its answers.

    They just tell you that it might hallucinate and to check its answers.

    • frunch@lemmy.world
      link
      fedilink
      arrow-up
      10
      ·
      24 days ago

      “let us Google it for you… But then you Google our results to make sure they’re accurate”