Red Hat AI
@RedHat_AI
Accelerating AI innovation with open platforms and community.
The future of AI is open.
加入 May 2018
2.1K 正在關注 12.9K 粉絲
New vLLM Office Hours on advanced model compression, with Kyle Sayers and @_soyr_.
They cover:
- LLM Compressor's sequential pipeline and data parallel schemes
- Settings most users never change
- What observers do and how they affect quantization error
- Expert pruning with REAP and MoNE
顯示更多
