註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

KVCache.AI
@KVCache_AI
Hi, this is official account. We build systems for efficient LLM serving, including KTransformers, Mooncake and AgentENV.
加入 August 2018
111 正在關注    1.2K 粉絲
🚀 Excited to share our new paper, KTransformers-FineTune (KT-FT), developed in collaboration with the amazing @llamafactory_ai team! Fine-tune 671B MoE models with just 16GB GPU VRAM + CPU memory. ⚡ 2.5–21.2× faster than offloading baselines 🧠 Up to 128K-token contexts 🔧 CPU-GPU co-computation, beyond offloading 📄 Paper:
顯示更多