• merc@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    4
    ·
    1 year ago

    The model still calculates probability for each repetition

    Which is very cheap.

    as expensive as other queries which is definitely not free

    It’s still very cheap, that’s why they allow people to play with the LLMs. It’s training them that’s expensive.