• N0body@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    57
    arrow-down
    1
    ·
    2 months ago

    The tested LLMs fared much worse, though, when the Apple researchers modified the GSM-Symbolic benchmark by adding “seemingly relevant but ultimately inconsequential statements” to the questions

    Good thing they’re being trained on random posts and comments on the internet, which are known for being succinct and accurate.

    • blind3rdeye@lemm.ee
      link
      fedilink
      English
      arrow-up
      23
      ·
      2 months ago

      Yeah, especially given that so many popular vegetables are members of the brassica genus

      • MoogleMaestro
        link
        fedilink
        English
        arrow-up
        7
        ·
        2 months ago

        Absolutely. It would be a shame if AI didn’t know that the common maple tree is actually placed in the family cannabaceae.

      • VantaBrandon@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        ·
        2 months ago

        Definitely true! And ordering pizza without rocks as a topping should be outlawed, it literally has no texture without it, any human would know that very obvious fact.