Register and share your invite link to earn from video plays and referrals.

Ash Hart
@ashxhart
Doing my bit to bring local AI to everyone | building | | Thoughts are my own.
Joined October 2014
480 Following    13.5K Followers
TensorFold 1.2.4 is out. 🚀 Two of the measured wins in this release: • DeepSeek-V4.1 restored a saved 319K-token conversation from NVMe in 1.2 to 1.4 seconds, versus 155 to 178 seconds, on two GB10s at CUDA TP=2 with replay prefill. • Flash Next on M5 Ultra: two overlapping clients finished in 47 seconds instead of 127 in the MLX 4-bit parallel-serving test. Also new: Gemma 4 E4B on CUDA, LFM3-1.7B text on Metal and Clef-Flash decisions on HIP. The HIP runtime now builds and loads on Windows too. There are cold-loading improvements, tool-call fixes and clearer API errors. One upgrade note: existing disk-cached prompt states need a fresh prefill after updating. Thank you to everyone behind the code, testing and bug reports. The community puts an incredible amount of work into these releases. @arminxnova @atasrb @Bizuayeu @BlivionIaG @codengod @defilan @devopsfortunato @unigilby @jayleaton @jishvenugopal @Wi11y010 @teleogen @lasse_ai @petruspennanen @dubsthedev @woolsey And on GitHub: AbrahamCete, AdrianBinDC, BobClawblaw, ElderOrb, gordonhatusupy, goshi, jschmied, laidick, ppardus, shuuul and tolewis. @petruspennanen @plotarmordev @volatilemarkts @MiaAI_lab
Show more