Victor M(@victormustar):llama.cpp v0.9.0 is out 💃🕺 > Native FP8 (OCP E4M3) > Faster multi-seq serving: flash_attn_ext_rows > Multi-node tensor parallel via NCCL (ggml 0.29.0) > New models: Clover, Limite, Metis-1.6, Mistral Large 4 > Speech: Chatterbox TTS, Nemotron 3.5 Transcribe > Faster Gemma 4 E2B/E4B prefill

Victor M

@victormustar

🤗 Head of Product @huggingface

Joined August 2012

2.4K Following 33K Followers

Victor M@victormustar

2026.11.04 17:50

llama.cpp v0.9.0 is out 💃🕺 > Native FP8 (OCP E4M3) > Faster multi-seq serving: flash_attn_ext_rows > Multi-node tensor parallel via NCCL (ggml 0.29.0) > New models: Clover, Limite, Metis-1.6, Mistral Large 4 > Speech: Chatterbox TTS, Nemotron 3.5 Transcribe > Faster Gemma 4 E2B/E4B prefill > much more...