Rohan Paul(@rohanpaul_ai):FT: ByteDance is reportedly pre-training an AI model with up to 10T parameters, far exceeding Kimi K3’s 2.8Trn param size. FT also reported that ByteDance has avoided distilling rival models for more than a year, preferring independent model development. If the reported run succeeds, ByteDance will have shown it can execute frontier-scale pretraining without leaning on a rival model as teacher.

Rohan Paul

@rohanpaul_ai

Compiling in real-time, the race towards AGI. The Largest Show on X for AI. 🗞️ Get my daily AI analysis newsletter to your email 👉

参加 June 2014

6.8K フォロー中 154.3K ファン

Rohan Paul@rohanpaul_ai

2026.08.07 09:10

FT: ByteDance is reportedly pre-training an AI model with up to 10T parameters, far exceeding Kimi K3’s 2.8Trn param size. FT also reported that ByteDance has avoided distilling rival models for more than a year, preferring independent model development. If the reported run succeeds, ByteDance will have shown it can execute frontier-scale pretraining without leaning on a rival model as teacher.