๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Ash Hart
@ashxhart
Doing my bit to bring local AI to everyone | building | | Thoughts are my own.
๊ฐ€์ž… October 2014
480 ํŒ”๋กœ์ž‰ ์ค‘    13.5K ํŒฌ
TensorFold 1.2.6 is out. ๐Ÿš€ The big one here is the prompt cache under multi-agent load. In the 16-agent Qwen3.8-27B + DFlash2 test, median follow-up time to first token dropped: โ€ข M3 Ultra: 546s โ†’ 15.9s โ€ข GB10: 105s โ†’ 25.8s Each agent started with a ~17k-token prompt. Same replies throughout that test. Also in this release: โ€ข Flash Next cold prompts finish 29 to 41% sooner on HIP, measured on the Radeon 8060S. โ€ข GLM-5.3-Flash single-stream code decoding is 32% faster on two GB10s at TP=2. โ€ข Opt-in DSpine-b16 drafting from Tencent for Qwen3.8-27B on CUDA. โ€ข An image-generation API for image-capable engines, local Unix sockets and tool-call fixes. One upgrade note: kept prompt states need a fresh prefill after updating. Massive thanks to everyone contributing code, testing on their hardware and reporting the things that need fixing. I really appreciate the time you all put into this. @andersjw_ @Bizuayeu @defilan @devopsfortunato @unigilby @jvr0x @teleogen And on GitHub: abm9111, AbrahamCete, akol1, BobClawblaw, chadhurley25075-png, davidtai, ElderOrb, jschmied, kotevcode, Mirrdhyn, mrv777, ppardus, robertung88 and volfco. @petruspennanen @volatilemarkts @plotarmordev @MiaAI_lab
๋” ๋ณด๊ธฐ