Register and share your invite link to earn from video plays and referrals.

slime
@slime_framework
The LLM post-training framework for RL Scaling.
11 Following    2.3K Followers
OpenAI's Navier-Stokes effort used ~10,000 concurrent agents and ~130B output tokens. It made us rethink the scale ahead for RL infrastructure. slime v0.4.0 is a first step toward greater scale, with four architectural changes: • Focus: synchronous training for algorithmic exploration and correctness; fully async training for throughput at scale. • Distributed rollout: spread orchestration across cluster CPUs, with independent generation pools and event loops. • Persistent storage: introduce straw, our new storage middleware for rollout and training data, providing durable queues and shared tensor storage. • Independent recovery: restart Megatron while healthy SGLang engines stay running, preserving accepted rollout work. More on the architecture below 👇 1/5
Show more
We've just added score centering to slime! You can enable sc with --use-score-centering PR:
Ahead of the upcoming open-source release of GLM-5.3, we’re releasing slime v0.3.2 🚀 Highlights: - Fully aligned GLM-5 training in Megatron with SGLang rollout - Tons of community-contributed bug fixes and optimizations - Continued refactoring and codebase cleanup, including the new slime/observability module - CUDA 13 support Getting slime ready for GLM-5.3 👀
Show more
slime now adds --release-train, pushing the inference system during agentic RL training to a new limit. In colocated RL training, we want SGLang to use as much room as possible for inference-side optimizations such as HiCache, instead of being constrained by offloaded Megatron training processes. --release-train makes this possible by releasing the Megatron training process during rollout and reloading it for each training round. This gives SGLang more configuration headroom in colocated RL workloads. PR:
Show more
🚀 slime v0.3.0 is out! This release is a major step toward agent-first RL. We turned slime’s existing multi-turn / agentic capabilities into a more coherent foundation: - slime/agent with reusable sandbox-agent components - OpenAI / Anthropic-compatible adapters - black-box coding-agent RL example - variable global batch-size training - fully async training as a first-class path - lower host-memory usage for more flexible rollout-inference setups - PPO refactor with actor-critic colocation - delta weight sync, FlashQLA for Qwen GDN, --save-hf, and more CI coverage slime is moving closer to a practical open-source framework for large-scale agentic RL. Release note:
Show more