SemiAnalysis
@SemiAnalysis_
参加 January 2024
35 フォロー中 167.5K ファン
TPU🚨 is working with the popular OSS inference optimization library Mooncake on integrating TPU with Mooncake Store. Similar to NVL72, KVCache DRAM P2P pooling will initially happen on the scale-out network via TENT instead of using ICI/NVLink. 🔥 Mooncake basically improves performance per TCO of production inference!
もっと見る
