註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Benjamin Marie
@bnjmn_marie
Independent AI researcher (AI, LLM). Support my work:
加入 June 2019
227 正在關注    7.7K 粉絲
Today I'll release: - much smaller statistically lossless checkpoints of Qwen3.8 27B, with EAR passing 98, for vLLM (should work also with SGLang but I didn't test). => around 19 GB while still being better than the official FP8 - the smallest LFM3 1.7B GGUF with an EAR passing 98 (this was super hard!! very sensitive to quantization this one) I'm also working on a post-SLQ refinement step, using autoround. It already works but it's quite costly. I will probably release these v2 this weekend. GSQ would also be a good refinement steps for 2-bit and 3-bit layers. I'm checking the cost. I'm almost ready for Qwen4 🫡
顯示更多
0
20
155
7
轉發到社區