Qwen 3.8 27B will be quite the release
Local AI has a rocket strapped to its back now
I wonder how Karpathy feels now that the lab he’s working at (Anthropic) is the only one left that didn’t sign the letter in support of Opensource AI
Even OpenAI has signed it
DROP EVERYTHING
- Why hardware prices, including used RTX 3090s from 2020, are getting more expensive
- Whether frontier intelligence is limited data centers only
- Why you should be bullish on Local / Opensource AI
You wanna watch this, bookmark it
Show more
SERIOUSLY
Local AI was never this EASY
- Install ODS
- Let it detect your hardware
- It will download the best model for your hardware
- And then start local inference and Open WebUI for you
With ODS, you can
> Add voice, agents like Hermes, workflows, RAG, search, image generation, and more
> Manage the whole stack from one dashboard
Now your PC, Mac, or Linux box is a private AI server
No cloud required
No subscription required
Your prompts and data stay on your machine unless you choose otherwise
Try ODS today and leave the nerfed models phase behind
Show more
PREDICTION
We're gonna get Kimi K3 equivalent intelligence running on a single RTX PRO 6000 in less than 18 months
Kimi K3 is only a couple of points below Fable 5 and GPT 5.6 Sol Max on the Intelligence Index
Fable 5 wasn't even available for majority of time this model was being trained so they cannot scream "distillation"
Opensource AI is now Frontier Intelligence.
Show more
RTX 3090 owners tonight will be running Kimi_K3_3T_Q_0.001_K GGUF
DROP EVERYTHING
The first panel from the Local AI Summit at AIEWF is now live
“State of the Union: Why Local, Why Now”
Featuring leaders from NVIDIA, Roboflow, Osmantic, Forward Future, and EXO Labs
Show more
In my element, we’re gonna make sure Opensource AI wins
Anthropic wants the public to see one thing: the careful lab, the safety lab, the grown-up in the room trying to keep frontier AI from running off a cliff. However, the pattern around Anthropic does not look like caution by itself. It looks like a company wrapping a business model in moral language, then using that language to justify opaque model behavior, anti-competitive access rules, regulatory pressure, and a future where builders, startups, researchers, and Opensource communities stay downstream of a few blessed frontier labs.
Imagine a compiler that emits worse binaries when it thinks you are building a competing compiler. Imagine a microscope that blurs certain samples because the manufacturer dislikes the research direction. Imagine a debugger that lies only when your codebase resembles a future rival.
Anthropic can learn from the internet, copyrighted books, code, public knowledge, user feedback if permitted, synthetic data, and its own models. But if a developer uses Claude to bootstrap a competitive open assistant, Anthropic calls foul. The company argues that safety controls may be lost and that competing models undermine the investment required to build frontier systems.
The fight is whether intelligence becomes something people can own, inspect, modify, run locally, fine-tune, study, route, and improve, or whether it becomes a subscription permission layer run by companies that can refuse, degrade, surveil, retain, revoke, reroute, or lobby away your access.
Anthropic's moat is being a permission regime. On daily basis, competitors and acquisition targets discover that access can disappear. The company asks governments to bless safety frameworks, deployment gates, incident reporting, evaluation regimes, and even future pauses that incumbents are best positioned to survive.
If a coding or research model secretly changes the quality, direction, or reliability of an answer because it classified the user as doing disallowed frontier work, the tool is no longer merely "safe." It is untrustworthy.
If Anthropic wants to be treated like a public-interest safety institution, it cannot behave like a hypersensitive platform monopolist whenever a customer gets too close to building alternatives.
Yes, companies protect their IP. But Anthropic is not selling a normal SaaS widget. It is selling cognition as infrastructure. Once cognition becomes infrastructure, anti-competitive access control stops being a normal vendor dispute and becomes a social bottleneck.
Anthropic repeatedly converts safety, security, and responsible deployment into mechanisms of control over who may build and what could be built.
We cannot trust them.
Show more
Come hang on the 2nd floor of Moscone West at AIE :D
Day 2 with the coolest guy in Local AI at AIE. Come hang out!
Almost 10 months ago I was hoping to one day get to do a Local AI Summit
This Thursday, thanks to all your support and earned trust, we will be delivering the first iteration of that
Join us, this Thursday from 10am to 4pm in SF at AIE
Show more
a few serious and IMPORTANT words
> "Buy a GPU" wasn't meant to be serious
> but the problems were
having been deep in the local AI trenches for a few years
> from lurking, to building, to modding r/LocalLLaMA
> to the whole "Buy a GPU" thing, to launching x/LocalLLaMA community,
> and now building toward the Local AI Summit
the content we have just isn't cutting it anymore
> everything's scattered, outdated, unstructured
> Reddit threads? mid
> Discord? too much noise
> people want more
> real guides
> working infra
> hands-on sessions
> deeper convos
> scattered tips, one-off tweets, and meme replies
> are not how we move the ecosystem forward
i've been saying this for months:
> local LLMs = real autonomy
> not your weights = not your model
> closed models get nerfed in silence while your data trains the next one
but just saying it isn't cutting it anymore
> you can't build on a model they can change at will
> you can't trust tools that phone home
> you can't scale when the knobs are upstream, and you're downstream
with anthropic, openai, etc:
> your data gets used, models get degraded, no heads-up
> they quietly quantize, distill, and swap weights; no changelog
> access gets throttled, limits slashed, apis pulled
> even open-source repos? fair game for dmca takedowns
and
> this is why local matters
> this is why i'm doing this
> this is why it has to be now
we can fix it, but ONLY IF WE TRY
> this isn't optional anymore
> adoption must grow
> more people need to care
> more people need to learn
> we need to step up
> and we need to raise the bar across the board
Buy a GPU AI
> pinpoint what actually matters: gpu, ram, vram, bandwidth
> skip the seo junk and affiliate bait; get straight, honest guidance
> examine real benchmarks and price-to-performance breakdowns
> learn the trade-offs so you know which specs to chase and which to ignore
> spot shadow throttling, closed apis, and deceptive model access before they bite
> build your local LLM rig with clarity, not vibes
Learn LLMs AI
> begin at absolute zero: understand tokens, embeddings, and model math
> follow a roadmap that moves from a micro-grad engine to a full-blown LLM
> write real code, train on real data, experience real gpu pain
> train it, serve it, break it, debug it; hands-on every step
> master scaling laws, quantization, lora/qlora, and evaluation loops
> graduate from "what's a token?" to "i shipped my own LLM"
Local AI Summit IO
> a hands-on hub dedicated to local LLMs and edge-ai curious minds and hardcore builders
> deep-dive workshops, technical talks, and live demos
> booths from community projects, startups, and hardware vendors
> focus on on-prem infra, open workflows, and practical tooling
> meet, teach, learn, collaborate, and ship alongside fellow learners and builders
> want to speak, host a session, or showcase a project? reach out and help shape the agenda
we're giving this space what it should have had for a while now
> real infrastructure
> clear guides
> and a high bar
if your work touches any of this:
> infrastructure, hardware, software, education, or community
> you're invited to participate
if you
> have thoughts or feedback?
> interested in hosting a booth?
> want to lead a workshop or give a talk?
> we'd love to hear from you
if you're ready to build
> on hardware, on software, or on the community itself
> join in
Buy a GPU. Learn how it all works.
Own your stack. Help shape the next phase.
Let's build what should exist.
get in touch if you wanna help
goodnight
Show more
Anthropic hates Opensource AI because a model like GLM 5.2 being available for feee to download made their $1 Trillion valuation sound like a joke (which it is btw)
How could I report this for unearned royalties?
You are not ready for the Opensource AI Must Win video game 🤣❤️
A well written and well thought out reason not just the open source community will never accept Anthropic again, but why the rest of the world is abandoning them.
TL:DR
Anthropic wraps anti-competitive access rules, output restrictions, and regulatory pressure in safety language to build a permission regime moat.
Models silently degrade or reroute Al development work, turning safety into sabotage and making tools untrustworthy.
Users cannot freely use outputs to train competing open models while Anthropic trains on user data and workflows.
Safety frameworks, RSP influence, and access controls favor incumbents, creating intelligence feudalism over user-owned systems.
Open source Al preserves sovereignty, competition, inspectability, and independence against centralized permission layers.
Show more
ODS by Osmantic will make Local AI The Default
Everything I heard from people that came to the workshop and tried it has been amazing
Lots more cooking
@TheAhmadOsman Dude, ODS is amazing for getting started. Thank you for putting this together and presenting the workshop today.
I can tell you put a ton of time into this software!
It is now clear that for Opensource AI to win Anthropic has to lose. Coexisting is no longer an option in my honest opinion when you’re acting with a cult mindset like they do.
One more time, Anthropic is EVIL. Everyone needs to read this and know they’ve been acting against Opensource AI for years.
WE CANNOT AFFORD TO LET THEM WIN.
FUCK OFF, Dario.
ANTHROPIC CEO WARNS OPEN-SOURCE AI IS ON A "VERY DANGEROUS PATH"