๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

filipe
@filicroval
data eng | 1xAsus Ascent GX10 | benchmarking local models so you don't have to
๊ฐ€์ž… May 2023
214 ํŒ”๋กœ์ž‰ ์ค‘    153.4K ํŒฌ
DeepSeek-V4-Flash-0731 (all 284B parameters) running on a single DGX Spark. โšก ~17 tok/s generation, 40 tok/s prefill ๐Ÿ“ฆ One 80GB GGUF file, mixed IQ2_XXS/Q8 imatrix quant ๐Ÿง  256-expert MoE, 6 routed per token ๐Ÿ†“ MIT licensed frontier model (kinda) on your desk ๐Ÿ˜Ž ๐Ÿค—
๋” ๋ณด๊ธฐ