Red Hat AI(@RedHat_AI):New vLLM Office Hours on advanced model compression, with Kyle Sayers and @_soyr_. They cover: - LLM Compressor's sequential pipeline and data parallel schemes - Settings most users never change - What observers do and how they affect quantization error

Red Hat AI

@RedHat_AI

Accelerating AI innovation with open platforms and community. The future of AI is open.

参加 May 2018

2.1K フォロー中 12.9K ファン

Red Hat AI@RedHat_AI

2026.11.10 15:13

New vLLM Office Hours on advanced model compression, with Kyle Sayers and @_soyr_. They cover: - LLM Compressor's sequential pipeline and data parallel schemes - Settings most users never change - What observers do and how they affect quantization error - Expert pruning with REAP and MoNE