๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

David Hendrickson
@TeksEdge
CEO & Founder | PhD | Startup Advisor | @Columbia | Author Generative Software Engineering | ๐Ÿ”” Follow for AI & Vibe Coding Tips ๐Ÿ‘‡
๊ฐ€์ž… July 2023
552 ํŒ”๋กœ์ž‰ ์ค‘    12.5K ํŒฌ
DeepSeek V4.1 Flash 1017 is now the #1# open model on Agent Arena leaderboard. Hosted ๐Ÿ† #1# open Agent Arena ๐Ÿ’ฐ ~$0.19 median/task ๐Ÿ”“ MIT weights Localmaxxers are already running the same 1017 checkpoint on 2ร— RTX 3090s + 128GB DDR4. And getting โšก ~30 tps decode ๐Ÿš€ 301โ€“470 tps prefill This is a monster model w/552B MoE backbone ๐Ÿ’พ + ~196B Engram memory ๐Ÿ“š 1M native context The local build squeezes the experts to ~2.03 bpw and uses exact routing, with the big Engram tables on storage. โš ๏ธ Those 2x3090s use an aggressive quant. It does not mean the local 2-bit version retains the exact Arena score. But that's still kind of nuts. Link to the 2x 3090's test in the ALT
๋” ๋ณด๊ธฐ