註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Ash Hart
@ashxhart
Doing my bit to bring local AI to everyone  | building | | Thoughts are my own.
加入 October 2014
487 正在關注    13.8K 粉絲
TensorFold 1.2.6 is out. 🚀 The big one here is the prompt cache under multi-agent load. In the 16-agent Qwen3.8-27B + DFlash2 test, median follow-up time to first token dropped: • M3 Ultra: 546s → 15.9s • GB10: 105s → 25.8s Each agent started with a ~17k-token prompt. Same replies throughout that test. Also in this release: • Flash Next cold prompts finish 29 to 41% sooner on HIP, measured on the Radeon 8060S. • GLM-5.3-Flash single-stream code decoding is 32% faster on two GB10s at TP=2. • Opt-in DSpine-b16 drafting from Tencent for Qwen3.8-27B on CUDA. • An image-generation API for image-capable engines, local Unix sockets and tool-call fixes. One upgrade note: kept prompt states need a fresh prefill after updating. Massive thanks to everyone contributing code, testing on their hardware and reporting the things that need fixing. I really appreciate the time you all put into this. @andersjw_ @Bizuayeu @defilan @devopsfortunato @unigilby @jvr0x @teleogen And on GitHub: abm9111, AbrahamCete, akol1, BobClawblaw, chadhurley25075-png, davidtai, ElderOrb, jschmied, kotevcode, Mirrdhyn, mrv777, ppardus, robertung88 and volfco. @petruspennanen @volatilemarkts @plotarmordev @MiaAI_lab
顯示更多
0
27
183
16
轉發到社區