Mia
@MiaAI_lab
Building with AI & LLMs // Running frontier open models locally
加入 July 2022
413 正在關注 48.5K 粉絲
Absolutely insane decode numbers on 2x RTX PRO 6000s with GLM 5.3 Flash on TensorFold. Haven't even optimized it really... faster than API I think.
This is with power capped at 400w per card.
顯示更多
