dots studio(@dotsstudioai):Under the hood of dots3-note Preview: BigMac 🚀 One piece of the training infra behind dots3-note Preview is BigMac, our pipeline scheduling system purpose-built for VLM training. BigMac co-schedules heterogeneous vision and language workloads through a dependency-safe nested pipeline — preserving the efficiency of optimized LLM schedules while reducing pipeline bubbles and activation memory. Across our evaluated workloads, it delivers 1.08–1.9× training speedups over existing baselines. We’ve now open-sourced it.

2026.08.19 09:29

Under the hood of dots3-note Preview: BigMac 🚀 One piece of the training infra behind dots3-note Preview is BigMac, our pipeline scheduling system purpose-built for VLM training. BigMac co-schedules heterogeneous vision and language workloads through a dependency-safe nested pipeline — preserving the efficiency of optimized LLM schedules while reducing pipeline bubbles and activation memory. Across our evaluated workloads, it delivers 1.08–1.9× training speedups over existing baselines. We’ve now open-sourced it.