đ¤¯ This entire 64GB AMD AI workstation cost its builder LESS than a single RTX 5090 and Qwen3.8-27B is hitting 111 tok/s.
This is the kind of rig that makes me want to build it because RTX 5090s are so expensive.
Setup đ
đ 2Ã Radeon AI PRO R9700 32GB
đž 64GB total dedicated VRAM
đ§ Ryzen 7500F
đž 64GB DDR5
đ PCIe 5.0 x8 per GPU
⥠vLLM Radiance + TP2 + MTP
Running Qwen3.8-27B Quark AWQ MXFP4 ...
đ 111.4 tok/s median decode
⥠4,224â4,410 tok/s prefill
âąī¸ 81ms TTFT
đ 131K server context
Native FP8 still managed 87.6 tps
đŽ RTX 5090 â 32GB VRAM
đ 2Ã R9700 â 64GB VRAM
The builder says the entire machine cost ~âŦ4,000, more than âŦ1,000 less than a single RTX 5090 in his market.
So for less money, he ended up with 2Ã the VRAM + 111 tok/s on Qwen3.8-27B. đĨ
Reddit Link in ALT