Today I'll release:
- much smaller statistically lossless checkpoints of Qwen3.8 27B, with EAR passing 98, for vLLM (should work also with SGLang but I didn't test).
=> around 19 GB while still being better than the official FP8
- the smallest LFM3 1.7B GGUF with an EAR passing 98 (this was super hard!! very sensitive to quantization this one)
I'm also working on a post-SLQ refinement step, using autoround. It already works but it's quite costly. I will probably release these v2 this weekend.
GSQ would also be a good refinement steps for 2-bit and 3-bit layers. I'm checking the cost.
I'm almost ready for Qwen4 ๐ซก