Looking at the others in the ultra-SFFPC market segment they’re targeting (e.g. Mac Mini, Intel NUC, Nvidia DIGITS) this is a solid first outing.
It’s a standard ITX mainboard that happens to have soldered ram. It will fit in any ITX-compatible case and even has dedicated PCI-e slot in case you do use a case with space for a PCI-e device like an SFP+ card.
On the upside, the unified ram means the GPU can use it, and so you could run 70b-size models on it.
Looking at the others in the ultra-SFFPC market segment they’re targeting (e.g. Mac Mini, Intel NUC, Nvidia DIGITS) this is a solid first outing.
It’s a standard ITX mainboard that happens to have soldered ram. It will fit in any ITX-compatible case and even has dedicated PCI-e slot in case you do use a case with space for a PCI-e device like an SFP+ card.
On the upside, the unified ram means the GPU can use it, and so you could run 70b-size models on it.
The version with 128GB ram is $1999.
Nvidia’s equivalent (DIGITS) is $2,999.