註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

David Hendrickson
@TeksEdge
CEO & Founder | PhD | Startup Advisor | @Columbia | Author Generative Software Engineering | 🔔 Follow for AI & Vibe Coding Tips 👇
加入 July 2023
552 正在關注    12.5K 粉絲
AMD Max+ Pro 495 benchmarks are starting to trickle out. This user got their single 192GB AMD Minisforum mini PC running gpt-oss 120B MXFP4 with llama.cpp at 55.7 tps. Setup 🧠 gpt-oss 120B 💾 192GB LPDDR5X-8533 unified memory 🎮 Radeon 8065S ⚡ 55.7 tps decode 🚀 1,135 tps prefill And deeper into context, at the source's ~32K test depth ⚡ 42.3 tps decode 🚀 385 tps prefill This is why these 192GB unified-memory machines could be a big deal for Local AI. Link in ALT
顯示更多