Ash Hart
@ashxhart
Doing my bit to bring local AI to everyone | building | | | Thoughts are my own.
๊ฐ์
October 2014
474 ํ๋ก์ ์ค 8.8K ํฌ
TensorFold on the other side of the planet!
Local AI is going to take off ๐
Optimized TensorFold for GLM5.3 EXL3 and achieved 87-95 tok/s on 4x RTX PRO 6000! Speculative decoding is MTP.
Uncensored SOTA models at home are starting to become a reality๐ฅ
๋ ๋ณด๊ธฐ
