Alex Ziskind
@digitalix
Software engineer making videos about dev gear, local AI, and weird tech experiments
加入 March 2009
1.5K 正在关注 27.5K 粉丝
Faster chips, new bottleneck 🤯
Two clustered M5 Ultra Macs ran SLOWER than one: 35 tok/s vs 53. Which is strange, considering my experiments with M3 Ultra were the opposite.
Keep the GPUs awake and they jump to 58 tok/s.
显示更多
