ๆณจๅ†Œๅนถๅˆ†ไบซ้‚€่ฏท้“พๆŽฅ๏ผŒๅฏ่Žทๅพ—่ง†้ข‘ๆ’ญๆ”พไธŽ้‚€่ฏทๅฅ–ๅŠฑใ€‚

David Hendrickson
@TeksEdge
CEO & Founder | PhD | Startup Advisor | @Columbia | Author Generative Software Engineering | ๐Ÿ”” Follow for AI & Vibe Coding Tips ๐Ÿ‘‡
ๅŠ ๅ…ฅ July 2023
549 ๆญฃๅœจๅ…ณๆณจ    11.2K ็ฒ‰ไธ
๐Ÿ“ฃ New Inferenceing Engine Alert! One DGX Spark is now running DeepSeek V4 Flash + Qwen3.8 Flash-Next at 262K context with ~1,000 tps PP. A new engine called Athena recently dropped for Nvidia GB10 systems. On a single 128GB DGX Spark you can get ... DeepSeek V4 Flash โšก 8K prefill: 1,126 tps ๐Ÿ“š 256K: 948 tps ๐Ÿš€ Decode @256K: 19.4 tps Qwen3.8 Flash-Next โšก 8K prefill: 1,071 tps ๐Ÿ“š 256K: 961 tps ๐Ÿš€ Decode @256K: 32.1 tps Going from 8K โ†’ 256K barely rocks on prefill performance. And Athena caches long conversations to disk. ๐Ÿ‘ˆ๐Ÿ‘€ A 141,519-token conversation reportedly restores in: โšก 2.1 seconds vs ~2 min 20 sec to process it fresh. It also includes โœ… speculative decoding โœ… OpenAI + Anthropic-compatible API โœ… tool calling โœ… Qwen image/document input โœ… persistent agent context โœ… Docker install โœ… switch models without changing clients This is what I want from DGX Spark. ๐ŸŽฏ Huge models + huge context + usable speed on 1 box sitting on your desk. ๐Ÿ‘€ ๐Ÿ”— Link in ALT
ๆ˜พ็คบๆ›ดๅคš