Tech experts are starting to doubt that ChatGPT and A.I. ‘hallucinations’ will ever go away: ‘This isn’t fixable’::Experts are starting to doubt it, and even OpenAI CEO Sam Altman is a bit stumped.

  • joelthelion@lemmy.world
    link
    fedilink
    English
    arrow-up
    5
    ·
    1 year ago

    I don’t understand why they don’t use a second model to detect falsehoods instead of trying to fix it in the original LLM?

    • Flying Squid@lemmy.world
      link
      fedilink
      English
      arrow-up
      11
      ·
      1 year ago

      And then they can use a third model to detect falsehoods in the second model and a fourth model to detect falsehoods in the third model and… well, it’s LLMs all the way down.

    • doggle@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      1 year ago

      Ai models are already computationally intensive. This would instantly double the overhead. Also being able to detect problems does not mean you’re able to fix them.

    • Sethayy@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      2
      ·
      1 year ago

      Cause what are you gonna train the second model on? Same data as the first just recreates it and any other data is gonna be nice and mucky with all the ai content out there

    • dirkgentle@lemmy.ca
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      1 year ago

      If it was easy to detect, it wouldn’t happen in the first place. So far, not even OpenAI themselves, have succeeded in implementing a AI detector.