Register and share your invite link to earn from video plays and referrals.

KVCache.AI
@KVCache_AI
Hi, this is official account. We build systems for efficient LLM serving, including KTransformers, Mooncake and AgentENV.
Joined August 2018
111 Following    1.2K Followers
🚀 Excited to share our new paper, KTransformers-FineTune (KT-FT), developed in collaboration with the amazing @llamafactory_ai team! Fine-tune 671B MoE models with just 16GB GPU VRAM + CPU memory. ⚡ 2.5–21.2× faster than offloading baselines 🧠 Up to 128K-token contexts 🔧 CPU-GPU co-computation, beyond offloading 📄 Paper:
Show more