注册并分享邀请链接,可获得视频播放与邀请奖励。

Ark
@quimedesu
SWE, Graphics and AI Researcher LocalLLM, Deepwen 3.6
加入 November 2010
454 正在关注    684 粉丝
30 Web Designs made with Ternary-Bonsai-2-27B-PTQ1_0 It's a 5.5Gib model that can fit in 8gb GPUs, it's derived from Qwen3.8-27B, it's not just Q1, it uses their custom ternary kernels to achieve a higher accuracy that would not be possible with standard quantization and it needs a custom fork to work.
显示更多