登録して招待リンクを共有すると、動画再生報酬と紹介報酬を獲得できます。

Quasar
@QuasarModels
Bittensor subnet built to crush the long-context barrier | SN24 | Owners : @yousseffarahat0 and @troyquasar Backed by @const_reborn
参加 November 2025
27 フォロー中    2.7K ファン
First announcement of April. We introduce Quasar-3B (1B Active) a looped continuous-time transformer built for long-context intelligence Quasar uses a hybrid architecture combining Quasar layers + GLA, enabling efficient stateful reasoning with stable long-range dependency handling. This release is the base model of the Quasar system, designed for distributed training and distillation at scale. In the coming days, SN24 miners will begin working with us to distill knowledge from frontier models like Qwen into Quasar, pushing toward a new SOTA in long-context modeling. The training roadmap is staged: Stage 1: Quasar-RoPE stable pretraining with 16K context, establishing the base representation for the system Stage 2: Quasar-DroPE continued training with distillation as the core mechanism, removing positional encodings and scaling toward 5M token context In both stages, distillation remains the central training signal, driven collaboratively through SN24 miners using knowledge transfer from frontier models. Read more about Quasar and get ready for mining 👇
もっと見る