Executives and researchers leading Meta’s AI efforts obsessed over beating OpenAI’s GPT-4 model while developing Llama 3, according to internal messages unsealed by a court on Tuesday in one of the company’s ongoing AI copyright cases, Kadrey v. Meta.
That’s basically what’s down stream from an open source model. Llama derivatives are what I use on my mid range gaming computer, and honestly they’re comparable. They can handle fewer details at a time, but they’re faster and way more efficient… Once you add in rag and tool use, they’re better than models 200x their size