dots studio(@dotsstudioai):Under the hood of dots3-note Preview: BigMac 🚀 One piece of the training infra behind dots3-note Preview is BigMac, our pipeline scheduling system purpose-built for VLM training. BigMac co-schedules heterogeneous vision and language workloads through a dependency-safe nested pipeline — preserving the efficiency of optimized LLM schedules while reducing pipeline bubbles and activation memory. Across our evaluated workloads, it delivers 1.08–1.9× training speedups over existing baselines. We’ve now open-sourced it.

dots studio

@dotsstudioai

rednote's AI lab, creating frontier intelligence for daily life.

加入 August 2026

14 正在关注 2.6K 粉丝

dots studio@dotsstudioai

2026.08.19 09:29

Under the hood of dots3-note Preview: BigMac 🚀 One piece of the training infra behind dots3-note Preview is BigMac, our pipeline scheduling system purpose-built for VLM training. BigMac co-schedules heterogeneous vision and language workloads through a dependency-safe nested pipeline — preserving the efficiency of optimized LLM schedules while reducing pipeline bubbles and activation memory. Across our evaluated workloads, it delivers 1.08–1.9× training speedups over existing baselines. We’ve now open-sourced it.

显示更多