TensorFold 1.2.4 is out. 🚀
Two of the measured wins in this release:
• DeepSeek-V4.1 restored a saved 319K-token conversation from NVMe in 1.2 to 1.4 seconds, versus 155 to 178 seconds, on two GB10s at CUDA TP=2 with replay prefill.
• Flash Next on M5 Ultra: two overlapping clients finished in 47 seconds instead of 127 in the MLX 4-bit parallel-serving test.
Also new: Gemma 4 E4B on CUDA, LFM3-1.7B text on Metal and Clef-Flash decisions on HIP. The HIP runtime now builds and loads on Windows too.
There are cold-loading improvements, tool-call fixes and clearer API errors.
One upgrade note: existing disk-cached prompt states need a fresh prefill after updating.
Thank you to everyone behind the code, testing and bug reports. The community puts an incredible amount of work into these releases.
@arminxnova @atasrb @Bizuayeu @BlivionIaG @codengod @defilan @devopsfortunato @unigilby @jayleaton @jishvenugopal @Wi11y010 @teleogen @lasse_ai @petruspennanen @dubsthedev @woolsey
And on GitHub: AbrahamCete, AdrianBinDC, BobClawblaw, ElderOrb, gordonhatusupy, goshi, jschmied, laidick, ppardus, shuuul and tolewis.
@petruspennanen @plotarmordev @volatilemarkts @MiaAI_lab