Ahmad
@TheAhmadOsman
Founder & CEO @OsmanticAI — Accelerating Opensource & Self-hosted / Local AI Adoption • I moderate GPUs on r/LocalLLaMA
가입 February 2011
465 팔로잉 중 78.4K 팬
The optimizations in MLX are horrid, DHH is right Apple doesn’t have a hardware problem they have a software problem
Faster chips, new bottleneck 🤯
Two clustered M5 Ultra Macs ran SLOWER than one: 35 tok/s vs 53. Which is strange, considering my experiments with M3 Ultra were the opposite.
Keep the GPUs awake and they jump to 58 tok/s.
더 보기
