TensorFold 1.2.6 is out. 🚀
The big one here is the prompt cache under multi-agent load.
In the 16-agent Qwen3.8-27B + DFlash2 test, median follow-up time to first token dropped:
• M3 Ultra: 546s → 15.9s
• GB10: 105s → 25.8s
Each agent started with a ~17k-token prompt. Same replies throughout that test.
Also in this release:
• Flash Next cold prompts finish 29 to 41% sooner on HIP, measured on the Radeon 8060S.
• GLM-5.3-Flash single-stream code decoding is 32% faster on two GB10s at TP=2.
• Opt-in DSpine-b16 drafting from Tencent for Qwen3.8-27B on CUDA.
• An image-generation API for image-capable engines, local Unix sockets and tool-call fixes.
One upgrade note: kept prompt states need a fresh prefill after updating.
Massive thanks to everyone contributing code, testing on their hardware and reporting the things that need fixing. I really appreciate the time you all put into this.
@andersjw_ @Bizuayeu @defilan @devopsfortunato @unigilby @jvr0x @teleogen
And on GitHub: abm9111, AbrahamCete, akol1, BobClawblaw, chadhurley25075-png, davidtai, ElderOrb, jschmied, kotevcode, Mirrdhyn, mrv777, ppardus, robertung88 and volfco.
@petruspennanen @volatilemarkts @plotarmordev @MiaAI_lab