註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Ash Hart
@ashxhart
Doing my bit to bring local AI to everyone  | building | | Thoughts are my own.
加入 October 2014
487 正在關注    13.8K 粉絲
🤯 GLM-5.3-Flash 4bit on two M5 Ultras (tp=2) with TensorFold and 4x TB5 cables bonded. 🚀 114 tks decode on Prose single stream, and ~1600tks prefil. C=8 decode up to 200tps. There is headroom here as well, but this is where we landed today. A new-session TTFT with our prefix-cache lean mode is 0.06s. @digitalix Thanks for letting me use the M5Us!
顯示更多
0
23
173
14
轉發到社區