๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

clem ๐Ÿค—
@ClementDelangue
Co-founder & CEO @HuggingFace ๐Ÿค—, the open and collaborative platform for AI builders
๊ฐ€์ž… September 2010
4.9K ํŒ”๋กœ์ž‰ ์ค‘    315.9K ํŒฌ
llama.cpp with MTP support makes local models fast enough to use as daily drivers ๐Ÿš€ Qwen3.6-27B dense generation below on A10G: From 25 tok/st to 45 tok/s (+78%)!