Eldar Kurtić
@_EldarKurtic
Inference Research Lead | vLLM @RedHat_AI & @DAlistarh's group at IST Austria
808 Following 1.1K Followers
More state-of-the-art MXFP4 ckpts ready for inference on AMD GPUs and @vllm_project available at:
TurboQuant has drawn a lot of attention recently, but the accompanying evals didn't tell the full story.
So we ran what I believe is the first comprehensive study of TurboQuant: where it helps, where it falls short, and how it impacts accuracy, latency, and throughput.
Findings:
Show more
