๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Ash Hart
@ashxhart
Doing my bit to bring local AI to everyone ๏ฃฟ | building | | Thoughts are my own.
๊ฐ€์ž… October 2014
482 ํŒ”๋กœ์ž‰ ์ค‘    13.7K ํŒฌ
TensorFold 1.2.3 is out. ๐Ÿš€ Some useful Flash Next improvements in this one: โ€ข NVFP4 on two GB10s at TP=2: plain decode 21% to 23% faster, with 2.62 GiB less model memory per rank. โ€ข M3 Ultra: a 1,024-token reply beside a 64K prompt finished in 8 seconds instead of 48 in the parallel-serving test. Same tokens. Those are specific test results, with the configurations and comparisons in the release notes. We've also added PDF document input, Ornith-1.5-122B on Metal, native dots.mocr OCR and Qwen embeddings/reranking on HIP, and LFM3-1.7B on Intel Iris Xe. There are fixes for prompt caching, memory use, streamed tool calls and serving too. A huge thank you to everyone contributing code, testing builds and reporting problems. There's so much work behind each release. @arminxnova @Bizuayeu @BlivionIaG @codengod @devopsfortunato @diwakergupta @unigilby @jayleaton @jishvenugopal @JRB_AI @joshuaswarren @teleogen @lasse_ai @MiaAI_lab @woolsey @petruspennanen And on GitHub: AbrahamCete, BadAd84, BobClawblaw, dinadur, garvrao80, joernchen, jschmied, ppardus, shuuul and tolewis. @MiaAI_lab @volatilemarkts @petruspennanen @plotarmordev
๋” ๋ณด๊ธฐ