You can Run locally bigger MoE model on a 12 GB phone, CPU only.
Treating flash storage as part of the memory hierarchy.
Only the experts actually needed for each token are loaded.
- Byte-identical to full residency
- No merge step for multi-shard GGUFs.
-