Register and share your invite link to earn from video plays and referrals.

Sudo su
@sudoingX
GPU/local LLM. more RAM and OSS... everywhere
Joined August 2022
1.1K Following    39.6K Followers
i keep watching people walk right past the door and the door to local ai is a 12, 16 or 24gb gaming gpu > the rtx 3060 is still the #1# desktop gpu on steam > 16gb is now the most common vram on steam, 26.9% of everyone > 65.7% of steam sits between 8 and 16gb that's the hardware. here's what it runs today, measured: > 8gb: 27b with a 48k ctx > 12gb: that same 27b at 50.8 tok/s with 131k ctx > 16gb: 262k ctx, and it sees > 24gb: the king qwen 3.8 27b q4 a lot of the people arguing would never spend $500 on the card that ends the argument. yes, gpu prices are dumb right now. it's still the cheapest seat you'll ever buy in this race because the second the model runs on your own card, the rules flip i watched opus 5.5 get cut off for reading anthropic's own blog. my local model has never cut me off once. it runs with the wifi off, it does the tasks the cloud won't touch, and for the first time you get to taste what owning your thinking actually feels like local ai is the most underrated, under adopted thing, and the door is already sitting in two thirds of the gaming pcs on steam what card is in your rig right now?
Show more