Reviews
Hands-on model tests with the hardware, setup, results and evidence needed to reproduce them.
How to read these reviews
Start with the test setup and conditions, then inspect results, failures and reproduction material. Conclusions state their limits so you can judge whether they apply to your device.
Test notes
A 35B MoE on 6 GB of VRAM? 64 GB of RAM Made It Work
With enough system RAM, a 35B-class MoE model can be practically usable with 6 GB of VRAM, provided its expert weights stay on the CPU.
Read article