Notes on local models, AI agents, developer tools, deployment and troubleshooting.
With enough system RAM, a 35B-class MoE model can be practically usable with 6 GB of VRAM, provided its expert weights stay on the CPU.
