๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Ash Hart
@ashxhart
Doing my bit to bring local AI to everyone ๏ฃฟ | building | | Thoughts are my own.
๊ฐ€์ž… October 2014
490 ํŒ”๋กœ์ž‰ ์ค‘    14.1K ํŒฌ
๐Ÿคฃ LOLโ€ฆ 1600 tps decode on a 5090 Qwen 3.8 27b nvfp4. Check the tokens written at the bottom ๐Ÿ˜‚