Victor M
@victormustar
๐ค Head of Product @huggingface
๊ฐ์
August 2012
2.4K ํ๋ก์ ์ค 33K ํฌ
llama.cpp v0.9.0 is out ๐๐บ
> Native FP8 (OCP E4M3)
> Faster multi-seq serving: flash_attn_ext_rows
> Multi-node tensor parallel via NCCL (ggml 0.29.0)
> New models: Clover, Limite, Metis-1.6, Mistral Large 4
> Speech: Chatterbox TTS, Nemotron 3.5 Transcribe
> Faster Gemma 4 E2B/E4B prefill
> much more...
๋ ๋ณด๊ธฐ
