Red Hat AI(@RedHat_AI):Qwen3.8-2.4T-A95B, a 2.4-trillion parameter MoE, quantized with no accuracy loss. MoE layers to NVFP4, attention layers to FP8 block, via LLM Compressor. On GPQA Diamond: 93.1 quantized vs 92.6 for the full-precision base. Full recovery. Serve on vLLM:

Red Hat AI

@RedHat_AI

Accelerating AI innovation with open platforms and community. The future of AI is open.

参加 May 2018

2.1K フォロー中 12.6K ファン

Red Hat AI@RedHat_AI

2026.08.19 15:14

Qwen3.8-2.4T-A95B, a 2.4-trillion parameter MoE, quantized with no accuracy loss. MoE layers to NVFP4, attention layers to FP8 block, via LLM Compressor. On GPQA Diamond: 93.1 quantized vs 92.6 for the full-precision base. Full recovery. Serve on vLLM: