Teortaxesโถ๏ธ (DeepSeek ๆจ็น๐้็ฒ 2023 โ โ)
@teortaxesTex
We're in a race. It's not USA vs China but humans and AGIs vs ape power centralization.
@deepseek_ai stan #1#, 2023โDeep Time
ยซCโest la guerre.ยป ยฎ1
๊ฐ์
September 2010
3.3K ํ๋ก์ ์ค 76.9K ํฌ
> One near-term release candidate is the hybrid GDN-2-3B latent MoE, which follows the Nemotron-3 Nano architecture but replaces the Mamba-2 layers with GDN-2.
cool!
Weโve already trained larger variants of this model, and they outperform competing approaches, including Mamba-2, GDP, and KDA, by a substantial margin.
One near-term release candidate is the hybrid GDN-2-3B latent MoE, which follows the Nemotron-3 Nano architecture but replaces the Mamba-2 layers with GDN-2.
A public release requires several approvals, and weโre working hard to secure them!
๋ ๋ณด๊ธฐ
