๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

David Hendrickson
@TeksEdge
CEO & Founder | PhD | Startup Advisor | @Columbia | Author Generative Software Engineering | ๐Ÿ”” Follow for AI & Vibe Coding Tips ๐Ÿ‘‡
๊ฐ€์ž… July 2023
552 ํŒ”๋กœ์ž‰ ์ค‘    12.5K ํŒฌ
I think Sipeed may be skipping the MaixStation DGX-Spark-Killer configuration we would want most. They're planning these memory configs ๐Ÿ’พ 32GB ๐Ÿ’พ 128GB ๐Ÿ’พ 512GB But no standard 64GB model. Sipeed's reasoning is 32GB โ†’ dense 27B models 128GB โ†’ 125B-class MoE models 64GB โ†’ โ€œwould run neither betterโ€ A ~$2,000 64GB box with 273 GB/s bandwidth would be more interesting to me than a ~$2,000 32GB box. 64GB opens up a very different Local-AI options including, larger quants, larger context/KV cache, and more room for agents. Especially when Nvidia's new 64GB DGX Spark starts at $4,999. Sipeed says enterprise customers can custom-order 64GB. Am I wrong? Would you buy 32GB, 64GB or jump straight to 128GB?
๋” ๋ณด๊ธฐ
Update: Sipeed gave Tomโ€™s Hardware the MaixStation price I was missing. The 128GB MaixStation is expected to cost about $3,999. Current 128GB DGX Spark โ†’ $6,950 MaixStation 128GB โ†’ ~$3,999 Thatโ€™s roughly ๐Ÿ’ฐ $2,951 less ๐Ÿ“‰ ~42% cheaper Same: ๐Ÿง  128GB LPDDR5X ๐Ÿš€ 273 GB/s memory bandwidth Sipeed has shown newer Qwen 27B runs claiming ๐Ÿ”ฅ +25% prefill ๐Ÿ”ฅ +30% decode But in its email to Tomโ€™s, Sipeed put the like-for-like comparison at โšก ~10% faster prefill โšก ~10% faster decode using FP4 with speculative decoding OFF. They say the larger gains are newer runs that aren't official yet. There are a few more interesting details now too ๐Ÿ”‹ ~40W typical load ๐Ÿ”Œ USB-C PD โ€” Sipeed says even a 65W power bank can run it ๐Ÿ“ 11 ร— 11 ร— 3 cm ๐ŸŒ 10G SFP+ ๐Ÿ’พ standard M.2 2280 SSD ๐Ÿ”— up to 256 Gbps C2C, with Sipeed claiming up to 8 nodes without an external switch Kickstarter is planned for the end of 2026, with Sipeed telling Tomโ€™s units should ship within roughly 3 months after the campaign closes. ๐Ÿ”— Links to TomsHardware article in ALT
๋” ๋ณด๊ธฐ