Mia
@MiaAI_lab
Building with AI & LLMs // Running frontier open models locally
参加 July 2022
413 フォロー中 48.3K ファン
Absolutely insane decode numbers on 2x RTX PRO 6000s with GLM 5.3 Flash on TensorFold. Haven't even optimized it really... faster than API I think.
This is with power capped at 400w per card.
もっと見る
