Aliez Ren
@aliez_ren
ๅฅๅฉๅทฅๅ
ท @taoli_tools
ๆฑ ๅญๅบ้ด
๊ฐ์
June 2014
1.8K ํ๋ก์ ์ค 17.1K ํฌ
่ๆไบ๐
You can now run Kimi K2.7 Code locally! ๐
We shrank the 1T model to 325GB (-48%) via Dynamic 2-bit where important layers are upcasted.
Run at >40 tok/s on 330GB RAM/VRAM setups.
Run full precision on 610 GB.
Guide:
GGUF:
๋ ๋ณด๊ธฐ
