X Freeze
@XFreeze
try Grok Bot templates here
가입 July 2024
2.1K 팔로잉 중 297K 팬
Elon Musk just revealed a massive update on Grok 4.8, and SpaceXSI has completely rebuilt its reinforcement learning and inference infrastructure from scratch
The engineering team has abandoned JAX and SGLang, rewriting the entire RL and inference stack in C/C++
Here’s where Grok 4.8 stands:
• Pre-training is complete
• Major cleanup of supervised fine-tuning data
• Reinforcement learning now underway
• Evaluation scores are starting to climb
• Soft rollout to Grok Bot users planned for later this week
And Elon also gave another imp update about Grok 4.8:
“Grok 4.8 will bear no resemblance to 4.7 (thankfully)”
He also explained why the development took longer than expected:
“It is not yet incredible, but, this time, the foundations are built right, so I expect it to evolve to be something special”
This is a fundamental engineering overhaul, not just another model upgrade
SpaceXSI has rewritten the underlying infrastructure to build a much stronger foundation for Grok’s future development.
And the first Grok Bot users are expected to get their hands on it this week
더 보기
We have dumped JAX/SGLang and rewritten the entire RL and inference stack from scratch in C/C++, which took some extra time.
Training (aka pre-training) is done. Lot of cleanup was needed on the SFT data to get that mostly right. Now, 4.8 is in RL and the evals are starting to climb. We will do a soft rollout to Bot users later this week and see how it goes.
Grok 4.8 will bear no resemblance to 4.7 (thankfully). It is not yet incredible, but, this time, the foundations are built right, so I expect it to evolve to be something special.
더 보기
