I have an GTX 1660 Super (6 GB)

Right now I have ollama with:

  • deepseek-r1:8b
  • qwen2.5-coder:7b

Do you recommend any other local models to play with my GPU?

  • Disonantezko@lemmy.sdf.orgOP
    link
    fedilink
    English
    arrow-up
    1
    ·
    9 days ago

    It’s not out of my scope, I’m just learning what can I do locally with my current machine.


    Today I read about RAG, maybe I’m gonna try an easy local setup to chat with a PDF.