Jun Song(@jun_song):Chinese AI models have one massive advantage: Their training data is mostly in Chinese, and a single Chinese character packs significantly more meaning than an English letter. This means they can compress a lot more data per token. It gives them up to a 4x token compression efficiency—an inherent advantage that English-based US models simply cannot replicate. This is exactly why GLM, a mere 750B model, can compete with 2T-level frontier models.

Jun Song

@jun_song

Founder: @0xSupergemma | Local LLMs / Open Source / AGI World Model | Ambassador @Alibaba_Qwen @NvidiaAI/ 156 IQ (Mensa)

Joined September 2024

315 Following 29.9K Followers

Jun Song@jun_song

2026.06.24 06:18

Chinese AI models have one massive advantage: Their training data is mostly in Chinese, and a single Chinese character packs significantly more meaning than an English letter. This means they can compress a lot more data per token. It gives them up to a 4x token compression efficiency—an inherent advantage that English-based US models simply cannot replicate. This is exactly why GLM, a mere 750B model, can compete with 2T-level frontier models.

243

1.2K

Forward to community

Most Popular Users