🇦🇺𝕄𝕦𝕟𝕥𝕖𝕕𝕔𝕣𝕠𝕔𝕕𝕚𝕝𝕖@lemm.ee to LocalLLaMA@sh.itjust.worksEnglish · 1 month agoHow much gpu do i need to run a 90b modelmessage-squaremessage-square15fedilinkarrow-up113arrow-down11file-text
arrow-up112arrow-down1message-squareHow much gpu do i need to run a 90b model🇦🇺𝕄𝕦𝕟𝕥𝕖𝕕𝕔𝕣𝕠𝕔𝕕𝕚𝕝𝕖@lemm.ee to LocalLLaMA@sh.itjust.worksEnglish · 1 month agomessage-square15fedilinkfile-text
minus-squarePossibly linuxlinkfedilinkEnglisharrow-up1·1 month agoYou can use system ram for when the GPU memory fills up. Alternatively you can run multiple GPUs.
You can use system ram for when the GPU memory fills up. Alternatively you can run multiple GPUs.