Unsloth AI
@UnslothAI
Train and run models locally! 🦥
加入 November 2023
480 正在關注 88.9K 粉絲
2-bit Gemma 4 12B GGUF, only 4.66 GB on disk, managed to cite 15 sites from a single prompt.
Try this locally on >6GB RAM via Unsloth Studio.
GitHub:
顯示更多
Gemma 4 12B can now run locally on just 8GB RAM via Dynamic GGUFs.
Google's new model, Gemma 4 12B Unified supports image, audio and 256K context.
You can run and train the model via Unsloth Studio.
GGUF:
Guide:
顯示更多
