Ark(@quimedesu):30 Web Designs made with Ternary-Bonsai-2-27B-PTQ1_0 It's a 5.5Gib model that can fit in 8gb GPUs, it's derived from Qwen3.8-27B, it's not just Q1, it uses their custom ternary kernels to achieve a higher accuracy that would not be possible with standard quantization and it needs a custom fork to work.

Ark

@quimedesu

SWE, Graphics and AI Researcher LocalLLM, Deepwen 3.6

Joined November 2010

454 Following 684 Followers

Ark@quimedesu

2026.09.18 01:00

30 Web Designs made with Ternary-Bonsai-2-27B-PTQ1_0 It's a 5.5Gib model that can fit in 8gb GPUs, it's derived from Qwen3.8-27B, it's not just Q1, it uses their custom ternary kernels to achieve a higher accuracy that would not be possible with standard quantization and it needs a custom fork to work.