Mia
@MiaAI_lab
Building with AI & LLMs // Running frontier open models locally
加入 July 2022
414 正在关注 48.7K 粉丝
Absolutely insane decode numbers on 2x RTX PRO 6000s with GLM 5.3 Flash on TensorFold. Haven't even optimized it really... faster than API I think.
This is with power capped at 400w per card.
显示更多
