Quasar-Preview is here. SILX AI's first public Quasar checkpoint is an ~18B sparse MoE with a ~2B active path, built for long-context and decentralized distillation research. 🚀 🤖 • Architecture: Quasar Long Hybrid Transformer with sparse MoE routing, Quasar / Raven / GLA hybrid layers, and a single-loop scaffold • Context: experimental 5M-token config with Safe NoPE / DrOPE-style staging; long-context path has <1B extension tokens so far • Training: >1T and <1.5T tokens, designed as the starting checkpoint for Bittensor SN24 decentralized training • Benchmarks: 68.4% MMLU 5-shot, 71.4% MATH-500 4-shot, 81.9% PIQA, 74.0% HellaSwag • Caveat: early preview checkpoint, not a final production or SOTA model • License: MIT