• TheBlackLounge@lemmy.world
      link
      fedilink
      English
      arrow-up
      22
      ·
      edit-2
      7 months ago

      Distilling has been around since forever. It’s a legitimate technique that can give you a better model depending on your needs.

      OpenAI does it too to improve its models.

    • FaceDeer@kbin.social
      link
      fedilink
      arrow-up
      7
      ·
      7 months ago

      People use compilers to compile compilers, or just generally computers to design computer hardware, all the time. It’s not so strange.

      • theotherone@kbin.social
        link
        fedilink
        arrow-up
        3
        ·
        7 months ago

        I thought it was almost entirely the point to automate stuff. We have a great tool to automate the automation.

    • Zeth0s@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      7 months ago

      It’s like pupils learning from teachers, with the exception that there’s a single teacher in the whole world