Unsloth AI
@UnslothAI
Run and train models locally with the Unsloth Desktop app. 🦥
Joined November 2023
478 Following 98.3K Followers
Gemma 4 now runs 2x faster with MTP GGUFs! Run locally on just 6GB RAM. ⚡️
MTP enables Google Gemma 4 run ~1.4–2.2× faster with no accuracy loss.
Gemma 4 12B MTP can run at 162 t/s vs. 52 t/s without MTP. 31B reaches 101 t/s.
GGUFs + Guide:
Show more
