FreeToken: Running a 35B MoE Model on Just 8GB of VRAM | Shuo Yang
How can a laptop GPU with just 8GB of VRAM run a 35B MoE model at interactive speed?
Join Shuo Yang (
@Andy_ShuoYang), lead developer of FreeToken, for a deep dive into its edge-native MoE serving architecture, bandwidth-adaptive CPU–GPU execution, dynamic expert placement, and runtime memory management, hosted by
@qingke_ai and simulcast on Zhihu Frontier.
📅 Oct 11 · 11 AM Beijing / 3 AM UTC
📺 Watch live: