Unsloth AI
@UnslothAI
Train and run models locally! 🦥
参加 November 2023
480 フォロー中 88.9K ファン
2-bit Gemma 4 12B GGUF, only 4.66 GB on disk, managed to cite 15 sites from a single prompt.
Try this locally on >6GB RAM via Unsloth Studio.
GitHub:
もっと見る
Gemma 4 12B can now run locally on just 8GB RAM via Dynamic GGUFs.
Google's new model, Gemma 4 12B Unified supports image, audio and 256K context.
You can run and train the model via Unsloth Studio.
GGUF:
Guide:
もっと見る
