If you know what you're using it for, this is a great little box. Its real potential is better recognized when you have two, to compensate for larger models + context windows, but even with 1 you can do quite a bit. Works well for fine tuning, and can host models if you understand its limitations. Dense models are a bit slow on it due to limited memory bandwidth (around 20tk/s for something like Owen 3.8 27b), but it has extremely fast prompt processing. Makes it great for running automations that you don't have to interact live with. For things you do, use a MoE model like Qwen 3.6 35b a3b. I run that with Hermes on it, and it's quite fast for useable work. The FE model's 4tb storage is also very useful to have if you switch models for different purposes. And I think it looks the best out of all the GB10 devices. Just keep in mind airflow is not that great, and I just hook up a couple of usb fans in front of it to keep it cool.

I’ve been really impressed with the DGX Spark. It gives me a compact, quiet, and secure way to run serious AI workloads locally without jumping straight into a much more expensive workstation or server-class setup. All of that that is also easier portable due to it's very small size. What I’ve done with it has been exactly the kind of work I wanted from a system like this: local model experimentation, running larger LLMs that benefit more from memory than raw CPU, and testing AI workflows without depending entirely on cloud inference. The 128GB of unified memory and the DGX software stack make it especially useful for AI development, and it feels built for exactly that kind of hands-on work. It can do a lot of the cloud AI work but in no way shape or form replaces the online subscription cloud models. What makes it great is that it strikes a rare balance. It’s powerful enough to be genuinely useful for developers and researchers, but still far more approachable as an entry point than larger AI infrastructure options. Compared with machines in the DGX H100 class or other enterprise systems, this is a much lower-cost way to get into local AI hardware while still keeping strong performance and flexibility. For me, the biggest win is that it lowers the barrier to serious local AI work. Instead of needing a full rack, noisy cooling, or a cloud bill that keeps growing, I can prototype, test, and iterate on my own desk. If you want a practical AI machine that feels like a real step up without going all the way to enterprise pricing, the DGX Spark makes a lot of sense. I have now reasoning model with Gemma 4 and a Coder model, Qwen3 Coder. Completely load and ready to be used at any time. Or I can load one bigger model and do dynamic load and unload ah hoc. For my cons, I would say I wish that was even more memory and it would be more cheaper. But even at this price point, I think it is still fair.

I have been using the NVIDIA DGX Spark (GB10) primarily for running local LLMs, multi-agent pipeline development, and heavy quantitative backtesting. The performance packed into such a small deskside footprint is outstanding. 128GB Unified Memory: Having high-capacity shared memory allows running ~70B parameter models and large context windows locally without hitting standard VRAM limits or PCIe throughput bottlenecks. Quiet Form Factor: Even during continuous compute workloads, the thermal management keeps the unit running cool on the desk with minimal noise. Turnkey Software Stack: NVIDIA DGX OS comes preconfigured with CUDA and TensorRT-LLM, which made setting up local AI agent environments straightforward on day one. The only minor consideration is that the Arm-based CPU core layout occasionally requires compiling specific Python libraries or C++ extensions from source depending on your environment. If you need a reliable, high-performance machine for local inference, testing, and data-sensitive workflows without relying constantly on cloud clusters, this workstation delivers exceptional capability.

This is the way to build your own person ai server

Best computer... IT's working like a charm running my models and agents.