• Kache@lemm.ee
    link
    fedilink
    arrow-up
    51
    ·
    edit-2
    3 days ago

    In my experience, LLMs aren’t really that good at summarizing

    It’s more like they can “rewrite more concisely” which is a bit different

    • merc@sh.itjust.works
      link
      fedilink
      arrow-up
      35
      arrow-down
      1
      ·
      3 days ago

      Summarizing requires understanding what’s important, and LLMs don’t “understand” anything.

      They can reduce word counts, and they have some statistical models that can tell them which words are fillers. But, the hilarious state of Apple Intelligence shows how frequently that breaks.

      • toynbee@lemmy.world
        link
        fedilink
        arrow-up
        15
        ·
        3 days ago

        There is, or maybe was, a YouTube channel that would run well known song lyrics through various layers of translation, then attempt to sing the result to the tune of the original.

      • sp3ctr4l
        link
        fedilink
        English
        arrow-up
        9
        ·
        3 days ago

        translation party!

        Throw Japanese into English into Japanese into English ad nauseum, untill an ‘equilibrium’ statement is reached.

        … Which was quite often nowhere near the original statement, in either language… but at least the translation algorithm agreed with itself.

    • snooggums@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      3 days ago

      If it isn’t accurate to the source material, it isn’t concise.

      LLMs are good at reducing word count.