antirez(@antirez):Update on the DwarfStar laguna-s2.1 branch, the GGUF files got updated, now the support for the file with Q8 projections and smaller routed experts (68GB total IIRC) is implemented as well. Speed improved significantly to 60 t/s generation, 550 t/s prefill.

antirez

@antirez

Reproducible bugs are candies. I like programming too much for not liking automatic programming.

Joined May 2007

797 Following 77.5K Followers

antirez@antirez

2026.07.23 17:13

Update on the DwarfStar laguna-s2.1 branch, the GGUF files got updated, now the support for the file with Q8 projections and smaller routed experts (68GB total IIRC) is implemented as well. Speed improved significantly to 60 t/s generation, 550 t/s prefill.

158

Forward to community

Most Popular Users