Register and share your invite link to earn from video plays and referrals.

KVCache.AI
@KVCache_AI
Hi, this is official account. We build systems for efficient LLM serving, including KTransformers, Mooncake and AgentENV.
Joined August 2018
109 Following    1.1K Followers
Excited to team up with @radixark to make large-scale RL data movement faster 🚀 Miles is built for high-performance, large-scale post-training, and Mooncake is now integrated as a rollout data-transfer backend for the fragmented, heterogeneous data moving between rollout and training in disaggregated RL. On rollout data captured from Miles: ⚡ 10–14× faster remote GET ⚡ 1.2–1.6× faster PUT By turning fragmented rollout objects into efficient bulk I/O while preserving their original structure, Mooncake helps reduce rollout-to-training handoff latency without changing the RL programming model. Read more:
Show more