Used to take me days to setup a new machine and customize it to my liking now I just tell an agent what I want installed, what shortcuts to add, and what customizations to do and voila you got a new machine setup in under two hours
Congratulations to @NousResearch on your recent raise. You guys are keeping the dream alive for countless OS builders out there and doing a lot of amazing work in this space. Cheers 💪❤️
You can now train your own Decision model like Jev locally!
We increased Qwen3.5 0.8B’s aggregate accuracy from 20.7% to 74.3% across 3 decision benchmarks - on just 4GB VRAM.
Turn any LLM like Qwen3.8, Gemma 4 into decision models with our open-source Unsloth repo.
We fine-tuned with a Clef head using Unsloth and LoRA (r=64) for one epoch, increasing downstream accuracy from 30–37% to 78%.
GitHub:
Guide and Notebooks:
One thing I discounted was that Unified Memory might actually play very well for small and efficient models
We'll see how it goes, but the future of Local AI is bright and that's the most important thing
Had a great time with the OS Man last night at The Foundry in SF. Meeting all of the coolest geeks and developers the city has to offer. Nothing like meeting new people and hearing what they are building.
We’re building the infra layer for Local AI
We won’t stop until perfection
I am so proud of how far we’ve come
Most importantly, I am so excited about the future we’re building towards - it’s gonna be great