註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

SemiAnalysis
@SemiAnalysis_
加入 January 2024
35 正在關注    167.9K 粉絲
Great blog from Kevin Lu at @vllm_project about quality control at the inference engine. Unfortunately, @AnushElangovan has not provided enough stable AMD QA clusters to vLLM, which leads to an order of magnitude worse software quality on AMD versus CUDA. Multiple AMD CI vLLM fleet-wide outages happen every month.
顯示更多