๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

KVCache.AI
@KVCache_AI
Hi, this is official account. We build systems for efficient LLM serving, including KTransformers, Mooncake and AgentENV.
๊ฐ€์ž… August 2018
111 ํŒ”๋กœ์ž‰ ์ค‘    1.2K ํŒฌ
๐Ÿš€ Excited to share our new paper, KTransformers-FineTune (KT-FT), developed in collaboration with the amazing @llamafactory_ai team! Fine-tune 671B MoE models with just 16GB GPU VRAM + CPU memory. โšก 2.5โ€“21.2ร— faster than offloading baselines ๐Ÿง  Up to 128K-token contexts ๐Ÿ”ง CPU-GPU co-computation, beyond offloading ๐Ÿ“„ Paper:
๋” ๋ณด๊ธฐ