登録して招待リンクを共有すると、動画再生報酬と紹介報酬を獲得できます。

X Freeze
@XFreeze
try Grok Bot templates here
参加 July 2024
2.1K フォロー中    297K ファン
Elon Musk just revealed a massive update on Grok 4.8, and SpaceXSI has completely rebuilt its reinforcement learning and inference infrastructure from scratch The engineering team has abandoned JAX and SGLang, rewriting the entire RL and inference stack in C/C++ Here’s where Grok 4.8 stands: • Pre-training is complete • Major cleanup of supervised fine-tuning data • Reinforcement learning now underway • Evaluation scores are starting to climb • Soft rollout to Grok Bot users planned for later this week And Elon also gave another imp update about Grok 4.8: “Grok 4.8 will bear no resemblance to 4.7 (thankfully)” He also explained why the development took longer than expected: “It is not yet incredible, but, this time, the foundations are built right, so I expect it to evolve to be something special” This is a fundamental engineering overhaul, not just another model upgrade SpaceXSI has rewritten the underlying infrastructure to build a much stronger foundation for Grok’s future development. And the first Grok Bot users are expected to get their hands on it this week
もっと見る
We have dumped JAX/SGLang and rewritten the entire RL and inference stack from scratch in C/C++, which took some extra time. Training (aka pre-training) is done. Lot of cleanup was needed on the SFT data to get that mostly right. Now, 4.8 is in RL and the evals are starting to climb. We will do a soft rollout to Bot users later this week and see how it goes. Grok 4.8 will bear no resemblance to 4.7 (thankfully). It is not yet incredible, but, this time, the foundations are built right, so I expect it to evolve to be something special.
もっと見る