Unsloth AI
@UnslothAI
Train and run models locally! ๐ฆฅ
Joined November 2023
479 Following 87.2K Followers
You can now run Kimi K2.7 Code locally! ๐
We shrank the 1T model to 325GB (-48%) via Dynamic 2-bit where important layers are upcasted.
Run at >40 tok/s on 330GB RAM/VRAM setups.
Run full precision on 610 GB.
Guide:
GGUF:
Show more
๐ Kimi-K2.7-Code, our latest coding model, is now released and open-sourced!
๐ท Improved coding & agent performance over K2.6: +21.8% on Kimi Code Bench v2, +11.0% on Program Bench, and +31.5% on MLS Bench Lite.
๐ท Reasoning efficiency: Less overthinking, with 30% lower reasoning-token usage compared to K2.6.
๐ท Long-horizon coding: Improved instruction following, higher end-to-end coding task success rates.
โก๏ธ 6x High-Speed Mode coming soon!
๐ Available today via Kimi API and Kimi Code.
๐ Kimi Code:
๐ API:
Show more
