注册并分享邀请链接,可获得视频播放与邀请奖励。

Benjamin Marie
@bnjmn_marie
Independent AI researcher (AI, LLM). Support my work:
加入 June 2019
227 正在关注    7.7K 粉丝
Today I'll release: - much smaller statistically lossless checkpoints of Qwen3.8 27B, with EAR passing 98, for vLLM (should work also with SGLang but I didn't test). => around 19 GB while still being better than the official FP8 - the smallest LFM3 1.7B GGUF with an EAR passing 98 (this was super hard!! very sensitive to quantization this one) I'm also working on a post-SLQ refinement step, using autoround. It already works but it's quite costly. I will probably release these v2 this weekend. GSQ would also be a good refinement steps for 2-bit and 3-bit layers. I'm checking the cost. I'm almost ready for Qwen4 🫡
显示更多
0
20
155
7
转发到社区