๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Mia
@MiaAI_lab
Building with AI & LLMs | Insights, recipes, tools & honest experiments
๊ฐ€์ž… July 2022
364 ํŒ”๋กœ์ž‰ ์ค‘    12.2K ํŒฌ
This model can fit in a 12-16gb VRAM consumer GPUs and laptops and it's almost as good as Nvidia's Qwen3.6-27b NVFP4 for agentic workflows, which is insane ๐Ÿคฏ @PrismML's Bonsai-27B 2-bit is performing exceptionally well! Coding tests next. Full eval results link:
๋” ๋ณด๊ธฐ