Register and share your invite link to earn from video plays and referrals.

Benjamin Marie
@bnjmn_marie
Independent AI researcher (AI, LLM). Support my work:
Joined June 2019
227 Following    7.7K Followers
Today I'll release: - much smaller statistically lossless checkpoints of Qwen3.8 27B, with EAR passing 98, for vLLM (should work also with SGLang but I didn't test). => around 19 GB while still being better than the official FP8 - the smallest LFM3 1.7B GGUF with an EAR passing 98 (this was super hard!! very sensitive to quantization this one) I'm also working on a post-SLQ refinement step, using autoround. It already works but it's quite costly. I will probably release these v2 this weekend. GSQ would also be a good refinement steps for 2-bit and 3-bit layers. I'm checking the cost. I'm almost ready for Qwen4 🫡
Show more