注册并分享邀请链接,可获得视频播放与邀请奖励。

HealthRanger
@HealthRanger
IQ 150+ polymath. Founder of all Brighteon platforms, mass spec food lab director, #1# bestselling author of "Food Forensics," AI developer
加入 August 2008
1.7K 正在关注    419.7K 粉丝
Happy to report: TensorFold engine (@ashxhart) plus the MIA AI Lab recipe (@MiaAI_lab) for 2 x DGX Spark boxes, DeepSeek-v4.1-Flash-1017, EXL3 quants published by Mia, confirmed running 4 concurrent lanes at aggregate 107 tokens/second using unique prompts with sustained long-term decoding. This is an extraordinary result. Each lane is nearly 28 tokens/second, which is very usable. I didn't measure prefill. Given the strength of this remarkable DeepSeek model, to have it within reach of your desktop with 2 spark boxes is really an achievement. Those 2 sparks used to cost just $8000 total. Now they about $16K total, and it's because of these use cases making the hardware more valuable by the day! Nvidia should be thanking MIA AI Lab and Ash Hart, and many others working in this open source space. They are the ones that make Spark boxes FAR more valuable! See my Decentralize TV interview with Ash Hart! Link in the comments.
显示更多