vLLM(@vllm_project):GLM-5.2 in NVFP4 is ready to serve in vLLM 🚀 @NVIDIAAI's official NVFP4 checkpoint of GLM-5.2 on Blackwell cuts the memory footprint vs FP8 while matching its accuracy across reasoning, coding, and long-context benchmarks. Serve it today with: vllm serve nvidia/GLM-5.2-NVFP4 🤗

vLLM

@vllm_project

A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!

加入 March 2024

36 正在关注 46.7K 粉丝

vLLM@vllm_project

2026.06.26 18:08

GLM-5.2 in NVFP4 is ready to serve in vLLM 🚀 @NVIDIAAI's official NVFP4 checkpoint of GLM-5.2 on Blackwell cuts the memory footprint vs FP8 while matching its accuracy across reasoning, coding, and long-context benchmarks. Serve it today with: vllm serve nvidia/GLM-5.2-NVFP4 🤗

显示更多