Sudo su
@sudoingX
GPU/local LLM. more RAM and OSS... everywhere
1.1K Following 33.2K Followers
i posted this a couple weeks ago about needing a second dgx spark, and nvidia just shipped me one. the unit and the connectx cable, on a truck to bangkok within a week of me saying it out loud here on x.
sit with that for a second anon. the biggest company on earth moved that fast for one guy in a room in bangkok. no stanford lab connection behind me, no committee, no comms team drafting my posts, just a builder putting real numbers in the open where anyone can tear them apart. the polished accounts with the pedigrees have been saying "democratize ai" for years, nvidia shipped the box to the guy actually doing it. giants aren't supposed to move like this, and that's exactly why the open side feels different right now.
nvidia is carrying real weight for the local ai side, backing the people who own their compute instead of renting cognition from an api, and doing it quietly, on the ground, for whoever's actually doing the work. i think that's the whole reason this movement has legs man.
here's what happens next. two dgx sparks, one connectx cable, 256 gigs of unified memory, tensor parallelism across both. the models that never fit on one box, glm 5.2, nemotron, deepseek v4 flash at a million tokens, they gonna clank now. i'm going to learn a stupid amount from this setup man, and share all of it, same as always.
biggest shoutout from deepest depth of my heart to @Coolmark482 for making all this happen and for seeing the local ai community as worth betting on. thank you.
Show more
a used $200 gpu runs a 27b ai agent at 128k context on your desk right now, fully offline. we are so not ready for 2027.
when claude cowork bros try cursor agent window
three weeks ago america pulled fable 5 offline overnight. today reuters reports china is discussing restrictions on overseas access to its own top models. alibaba, bytedance, all in the room. closed models, open weights, even unreleased ones on the table.
read that again. the only two countries producing frontier models are now both drafting rules to keep them home.
and here's the part nobody wants to say out loud. china open sourced its way up. qwen, deepseek, glm, free weights flooding the world while they were behind. now glm 5.2 sits beside the frontier and suddenly beijing is talking about state assets and national security crimes. everyone loves open source until they're ahead. nations, labs, all of them. openness was never a philosophy. it was a strategy for second place.
i said your ai bill should be your electricity bill. i'm adding a deadline to that. the weights on your drive are the only ai on earth that no ministry, no congress, no boardroom can reach.
and if you think it stops at the models, look at where a rule like this gets enforced. the download page. huggingface is the chokepoint. maybe it never comes to that. fill your nvme like it will.
one more thing. the loudest essays making the case for export controls came from the ceo of the closed lab whose own model just got export controlled. dario wrote the argument for the wall. now every wall going up leaves metered apis as the only lane left open. i don't need to guess what's in anyone's heart. the incentives are doing all the talking, and they all point at the meter.
this is the worst outcome. and it was a choice. the window is closing from both sides. download while downloading is still a thing.
Show more
CHINA CONSIDERS RESTRICTING OVERSEAS ACCESS TO CUTTING-EDGE AI MODELS
China’s Ministry of Commerce has led meetings over the past month with major AI companies, including Alibaba, ByteDance, and to discuss measures that would restrict overseas access to cutting-edge AI models, including models that have not yet been released.
The discussions reportedly include not only closed-source models but also open-weight models. However, the scope of application is still under debate, and the rules may ultimately apply only to future frontier models.
Officials have also discussed designating the leakage or theft of proprietary AI technologies as a national security crime, with stronger penalties, as well as restricting the types of foreign capital that can invest in Chinese AI startups.
The backdrop is the U.S. move to strengthen export controls on AI models, along with national security concerns over cutting-edge models that could possess advanced cyberattack capabilities.
Chinese authorities are reportedly concerned that advanced U.S. cybersecurity AI models could be used to exploit vulnerabilities in Chinese software.
Since the beginning of this year, China has continued to tighten measures to prevent AI technology from being transferred overseas. Authorities have investigated whether Chinese AI startups that relocated abroad violated export control laws, while also strengthening oversight of overseas transactions involving Chinese investors, technology, data, and national security concerns.
Future regulations could take the form of a tiered framework based on technological capability. Basic open-source AI models may be managed through a filing system, high-performance models may be subject to security reviews, and the most sensitive frontier models may be banned from public release or restricted to use within China.
Show more
see this dip? that's july 5th. the day i flew to another city and got engaged. impressions dropped 80% because i chose the most important day of my life over the timeline.
here's what nobody tells you about x monetization:
the algorithm has no memory of your reasons. it only knows your reps. so now i climb back. in public. in real time. wedding is in February 24. i'm funding it with this account and my work.
every 2 weeks x pays out, and i'm going to show you the climb, payout by payout, post by post. not tips from a guru. receipts from a man with a deadline. the siege starts now. watch the chart.
Show more
i got engaged this week ❤️. want to tell you what i learned.
i lost my father at 11. became the provider at 13. for 15 years it was just me, the work, and the people counting on me. no degree. no safety net. the internet became my university and shipping became my religion.
this week i flew to her city with 4 of my elders, the men who stood where my father would have stood. we did it the old way. flowers. sweets. blessings. and when her family asked what i do, i just smiled and said "i build software".
they don't know about the DMs from companies you'd recognize. they don't need to. let your work be discovered, never announced.
she said yes.
this photo is me at the airport the next day, everyone scrolling, me running agents, pushing code from the gate. because the man she said yes to is a builder, and builders don't stop being builders on the good days.
the good days are made OF the building.
wedding in january. launching my platform in spring. everything i've built was the trailer.
locked in for the greatest 6 months of my life. watch anon.
Show more
i got engaged this week ❤️. want to tell you what i learned.
i lost my father at 11. became the provider at 13. for 15 years it was just me, the work, and the people counting on me. no degree. no safety net. the internet became my university and shipping became my religion.
this week i flew to her city with 4 of my elders, the men who stood where my father would have stood. we did it the old way. flowers. sweets. blessings. and when her family asked what i do, i just smiled and said "i build software".
they don't know about the DMs from companies you'd recognize. they don't need to. let your work be discovered, never announced.
she said yes.
this photo is me at the airport the next day, everyone scrolling, me running agents, pushing code from the gate. because the man she said yes to is a builder, and builders don't stop being builders on the good days.
the good days are made OF the building.
wedding in january. launching my platform in spring. everything i've built was the trailer.
locked in for the greatest 6 months of my life. watch anon.
Show more
anon. if you want into local ai and don't know where to start, here it is.
grab a used rtx 3090. six years old, 24gb of vram, still the best value per dollar in the game. load qwen3.6 27b dense at q4. that pairing is the king of the card, and i'll stand on that.
that one setup gets you a real build companion and retires a subscription or two. your ai bill becomes your electricity bill.
Show more
what was the ram in your first computer, and what's in your current one?
many won’t understand, at least not yet, but local ai is required for humanity survival.
i am back. so so so fucking back man.
what was the ram in your first computer, and what's in your current one?
anon. if you want into local ai and don't know where to start, here it is.
grab a used rtx 3090. six years old, 24gb of vram, still the best value per dollar in the game. load qwen3.6 27b dense at q4. that pairing is the king of the card, and i'll stand on that.
that one setup gets you a real build companion and retires a subscription or two. your ai bill becomes your electricity bill.
Show more
fable 5 max inside cursor is the closest thing to agi an engineer can touch right now, and nothing else is close. that's it, that's the post.
tell me your vram and i'll tell you your future.
tell me your vram and i'll tell you your future.
have to give nvidia their credit. they set me up with an NGC account, free access to their whole model lineup, including Nemotron 3 Ultra, their 550B flagship.
open weights, open data, and now free hosted access so builders can actually run them. while the big labs gatekeep harder every quarter, nvidia quietly became one of the most open players in AI.
i love the direction they're moving. respect where it's due.
Show more
what's stopping nous research from building this?
Everyone who signed up in the last hour should have gotten invites to the Hermes Agent Mobile App.
Happy testing!
the things that actually changed how i work are small and unglamorous, a tmux config, a control script, the git setup my agents live in, and i open every one of them daily.
build something you come back to.
Show more
most people treat git as a chore. commit, push, don't forget, a discipline you impose on yourself. in an agentic setup it stops being that, git becomes the thing your agents talk through.
one agent does work and commits. the next one pulls and now it has everything, the code, the docs, the context the last agent left behind. you spin up a fresh agent and it is not a blank slate, it pulls the repo and already knows, no re briefing, no pasting context into a chat window.
the agents never have to talk to each other directly. one leaves state in the repo, the next picks it up, async and durable, and every commit is a log of exactly what each agent did, so you can audit the whole run after.
that is why the git server being private and yours matters. it is not about secrecy, it is that the repo is infrastructure now, the shared memory the whole system runs on. a merge agent sits on top and handles the conflicts.
private git isn't a step you enforce, it's the medium.
Show more
@DavidBennett__ not nagging, it's the architecture. i use private git, not github, the repo of code and docs is the memory itself. every new agent pulls it, gets full context, commits back. a merge agent handles the merging. git isn't a step you enforce, it's how the agents share state.
Show more
