Prediction: Local model will be the biggest story of 2027
Claude Model is getting smarter and bigger
But smaller model is getting better.
I don’t need my own model to solve the hardest math problems. Why shouldn’t I distill a smaller one focusing on the things that matter to me and free?
Local model is free.
Local model is private.
Local model is fast.
Such future will disrupt the inference market and anthropic/openai’s current biz model as we speak. We still need inference but we also need an entire new generation of hardware that powers this type of inference.
Who is building this new future? Raise your hand!