Zhihu Frontier(@ZhihuFrontier):FreeToken: Running a 35B MoE Model on Just 8GB of VRAM | Shuo Yang How can a laptop GPU with just 8GB of VRAM run a 35B MoE model at interactive speed? Join Shuo Yang (@Andy_ShuoYang), lead developer of FreeToken, for a deep dive into its edge-native MoE serving architecture, bandwidth-adaptive CPU–GPU execution, dynamic expert placement, and runtime memory management, hosted by @qingke_ai and simulcast on Zhihu Frontier. 📅 Oct 11

Zhihu Frontier

@ZhihuFrontier

🚀Bringing China's AI & tech trends, voices and perspectives to the global stage. ⚡️Powered by 知乎/ China's leading knowledge community.

加入 June 2025

207 正在關注 12.7K 粉絲

Zhihu Frontier@ZhihuFrontier

2026.10.10 15:27

FreeToken: Running a 35B MoE Model on Just 8GB of VRAM | Shuo Yang How can a laptop GPU with just 8GB of VRAM run a 35B MoE model at interactive speed? Join Shuo Yang (@Andy_ShuoYang), lead developer of FreeToken, for a deep dive into its edge-native MoE serving architecture, bandwidth-adaptive CPU–GPU execution, dynamic expert placement, and runtime memory management, hosted by @qingke_ai and simulcast on Zhihu Frontier. 📅 Oct 11 · 11 AM Beijing / 3 AM UTC 📺 Watch live: