TensorFold 1.2.6 is out. ๐
The big one here is the prompt cache under multi-agent load.
In the 16-agent Qwen3.8-27B + DFlash2 test, median follow-up time to first token dropped:
โข M3 Ultra: 546s โ 15.9s
โข GB10: 105s โ 25.8s
Each agent started with a ~17k-token prompt. Same replies throughout that test.
Also in this release:
โข Flash Next cold prompts finish 29 to 41% sooner on HIP, measured on the Radeon 8060S.
โข GLM-5.3-Flash single-stream code decoding is 32% faster on two GB10s at TP=2.
โข Opt-in DSpine-b16 drafting from Tencent for Qwen3.8-27B on CUDA.
โข An image-generation API for image-capable engines, local Unix sockets and tool-call fixes.
One upgrade note: kept prompt states need a fresh prefill after updating.
Massive thanks to everyone contributing code, testing on their hardware and reporting the things that need fixing. I really appreciate the time you all put into this.
@andersjw_ @Bizuayeu @defilan @devopsfortunato @unigilby @jvr0x @teleogen
And on GitHub: abm9111, AbrahamCete, akol1, BobClawblaw, chadhurley25075-png, davidtai, ElderOrb, jschmied, kotevcode, Mirrdhyn, mrv777, ppardus, robertung88 and volfco.
@petruspennanen @volatilemarkts @plotarmordev @MiaAI_lab