Local models, agents and developer tools. Notes on testing, deployment and troubleshooting.
With enough system RAM, a 35B-class MoE model can be practically usable with 6 GB of VRAM, provided its expert weights stay on the CPU.
