๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Pedro Cuenca
@pcuenq
ML Engineer at ๐Ÿค— Hugging Face | Co-founder at LateNiteSoft (Camera+). I love AI and photography.
๊ฐ€์ž… May 2019
1.1K ํŒ”๋กœ์ž‰ ์ค‘    7.8K ํŒฌ
It's crazy that I can run MiMo 2.6 Flash across my RTX 6000 GPU and my M5 laptop at 40 tokens/sec over 10 GbE ๐Ÿคฏ These are the native mxfp4 weights of a state-of-the-art model, on heterogeneous hardware. Supported out of the box in llama.cpp.
๋” ๋ณด๊ธฐ