注册并分享邀请链接,可获得视频播放与邀请奖励。

KVCache.AI
@KVCache_AI
Hi, this is official account. We build systems for efficient LLM serving, including KTransformers, Mooncake and AgentENV.
加入 August 2018
109 正在关注    1.1K 粉丝
Excited to team up with @radixark to make large-scale RL data movement faster 🚀 Miles is built for high-performance, large-scale post-training, and Mooncake is now integrated as a rollout data-transfer backend for the fragmented, heterogeneous data moving between rollout and training in disaggregated RL. On rollout data captured from Miles: ⚡ 10–14× faster remote GET ⚡ 1.2–1.6× faster PUT By turning fragmented rollout objects into efficient bulk I/O while preserving their original structure, Mooncake helps reduce rollout-to-training handoff latency without changing the RL programming model. Read more:
显示更多