Red Hat AI
@RedHat_AI
Accelerating AI innovation with open platforms and community.
The future of AI is open.
가입 May 2018
2.1K 팔로잉 중 12.9K 팬
New vLLM Office Hours on advanced model compression, with Kyle Sayers and @_soyr_.
They cover:
- LLM Compressor's sequential pipeline and data parallel schemes
- Settings most users never change
- What observers do and how they affect quantization error
- Expert pruning with REAP and MoNE
더 보기
