Register and share your invite link to earn from video plays and referrals.

Ash Hart
@ashxhart
Doing my bit to bring local AI to everyone  | building | | Thoughts are my own.
Joined October 2014
482 Following    13.7K Followers
TensorFold 1.2.3 is out. 🚀 Some useful Flash Next improvements in this one: • NVFP4 on two GB10s at TP=2: plain decode 21% to 23% faster, with 2.62 GiB less model memory per rank. • M3 Ultra: a 1,024-token reply beside a 64K prompt finished in 8 seconds instead of 48 in the parallel-serving test. Same tokens. Those are specific test results, with the configurations and comparisons in the release notes. We've also added PDF document input, Ornith-1.5-122B on Metal, native dots.mocr OCR and Qwen embeddings/reranking on HIP, and LFM3-1.7B on Intel Iris Xe. There are fixes for prompt caching, memory use, streamed tool calls and serving too. A huge thank you to everyone contributing code, testing builds and reporting problems. There's so much work behind each release. @arminxnova @Bizuayeu @BlivionIaG @codengod @devopsfortunato @diwakergupta @unigilby @jayleaton @jishvenugopal @JRB_AI @joshuaswarren @teleogen @lasse_ai @MiaAI_lab @woolsey @petruspennanen And on GitHub: AbrahamCete, BadAd84, BobClawblaw, dinadur, garvrao80, joernchen, jschmied, ppardus, shuuul and tolewis. @MiaAI_lab @volatilemarkts @petruspennanen @plotarmordev
Show more