• beeng@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    1
    ·
    11 months ago

    I cloned and compiled the alpaca.cpp on my Android Oneplus 9, I can get it started but dies due to not enough RAM. I have 8 GB total, but cant get the required 4 GB free to run the trimmed Llama (alpaca) model.

    I might splash out on the orange pi for some fun.