登録して招待リンクを共有すると、動画再生報酬と紹介報酬を獲得できます。

Ash Hart
@ashxhart
Doing my bit to bring local AI to everyone | building | | Thoughts are my own.
参加 October 2014
480 フォロー中    13.5K ファン
TensorFold 1.2.6 is out. 🚀 The big one here is the prompt cache under multi-agent load. In the 16-agent Qwen3.8-27B + DFlash2 test, median follow-up time to first token dropped: • M3 Ultra: 546s → 15.9s • GB10: 105s → 25.8s Each agent started with a ~17k-token prompt. Same replies throughout that test. Also in this release: • Flash Next cold prompts finish 29 to 41% sooner on HIP, measured on the Radeon 8060S. • GLM-5.3-Flash single-stream code decoding is 32% faster on two GB10s at TP=2. • Opt-in DSpine-b16 drafting from Tencent for Qwen3.8-27B on CUDA. • An image-generation API for image-capable engines, local Unix sockets and tool-call fixes. One upgrade note: kept prompt states need a fresh prefill after updating. Massive thanks to everyone contributing code, testing on their hardware and reporting the things that need fixing. I really appreciate the time you all put into this. @andersjw_ @Bizuayeu @defilan @devopsfortunato @unigilby @jvr0x @teleogen And on GitHub: abm9111, AbrahamCete, akol1, BobClawblaw, chadhurley25075-png, davidtai, ElderOrb, jschmied, kotevcode, Mirrdhyn, mrv777, ppardus, robertung88 and volfco. @petruspennanen @volatilemarkts @plotarmordev @MiaAI_lab
もっと見る