註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

KVCache.AI
@KVCache_AI
Hi, this is official account. We build systems for efficient LLM serving, including KTransformers, Mooncake and AgentENV.
加入 August 2018
109 正在關注    1.1K 粉絲
Excited to team up with @radixark to make large-scale RL data movement faster 🚀 Miles is built for high-performance, large-scale post-training, and Mooncake is now integrated as a rollout data-transfer backend for the fragmented, heterogeneous data moving between rollout and training in disaggregated RL. On rollout data captured from Miles: ⚡ 10–14× faster remote GET ⚡ 1.2–1.6× faster PUT By turning fragmented rollout objects into efficient bulk I/O while preserving their original structure, Mooncake helps reduce rollout-to-training handoff latency without changing the RL programming model. Read more:
顯示更多