๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Ash Hart
@ashxhart
Doing my bit to bring local AI to everyone | building | | Thoughts are my own.
๊ฐ€์ž… October 2014
480 ํŒ”๋กœ์ž‰ ์ค‘    13.5K ํŒฌ
TensorFold 1.2.4 is out. ๐Ÿš€ Two of the measured wins in this release: โ€ข DeepSeek-V4.1 restored a saved 319K-token conversation from NVMe in 1.2 to 1.4 seconds, versus 155 to 178 seconds, on two GB10s at CUDA TP=2 with replay prefill. โ€ข Flash Next on M5 Ultra: two overlapping clients finished in 47 seconds instead of 127 in the MLX 4-bit parallel-serving test. Also new: Gemma 4 E4B on CUDA, LFM3-1.7B text on Metal and Clef-Flash decisions on HIP. The HIP runtime now builds and loads on Windows too. There are cold-loading improvements, tool-call fixes and clearer API errors. One upgrade note: existing disk-cached prompt states need a fresh prefill after updating. Thank you to everyone behind the code, testing and bug reports. The community puts an incredible amount of work into these releases. @arminxnova @atasrb @Bizuayeu @BlivionIaG @codengod @defilan @devopsfortunato @unigilby @jayleaton @jishvenugopal @Wi11y010 @teleogen @lasse_ai @petruspennanen @dubsthedev @woolsey And on GitHub: AbrahamCete, AdrianBinDC, BobClawblaw, ElderOrb, gordonhatusupy, goshi, jschmied, laidick, ppardus, shuuul and tolewis. @petruspennanen @plotarmordev @volatilemarkts @MiaAI_lab
๋” ๋ณด๊ธฐ