Next big section is on residuals which has devolved to something extremely extremely cursed. They first compare HyperConnections (learnable write, read, mix operators) against a simplied variant where its just a linear combination of various branches and the output is written to a single branch in a roundrobin fashion. They compare both of these with their own variant GatedResidual: 1) RMSNorm each branch 2) Apply projection via a low rank bottleneck 3) Layer is the input coefficients of the different branches 4) Write uses a single branch level scalar

🔥 VP JD Vance is GOING OFF on how far the Democrat Party has devolved Democrats turned a blind eye to MASSIVE Medicaid fraud, $250 billion found (SO FAR), then called everyone who noticed it "RAClSTS." "They REFUSED to prosecute the crime. And by the way, they called everybody who noticed their fraud 'RACISTS' for noticing that there were people STEALING from our children and our new and expectant mothers." Now instead of changing course, they're doubling down, purging ANY remaining moderates in office and replacing them with extremists who OPENLY hate this country. THEY CANNOT BE ALLOWED TO WIN!

there's a almost-year-old thread about spec driven development which has recently devolved into claude slop but CLEARLY demonstrates how hard it is to try and keep ALL your specs in sync with ALL your code - you basically have just manufactured a new problem that doesn't actually yield that much leverage (you may save a little bit of time/tokens during research but if you codebase research is dialed in, just spend the tokens my friends - trying to compact the moving target of "what is the structure and intent of this codebase" has enough downsides that its probably not worth the upside)

It wouldn't surprise me if the output of the Federal Reserve’s five task forces, along with the broader reforms led by Kevin Warsh, becomes a global blueprint for central banking. Already, Chair Warsh’s pushback against what “forward guidance” has devolved into is already gaining traction abroad. #economy# #markets# #federalreserve# #reform#

What a fucking disgrace. Just when it looked like CBS had no lower to go. Under the fascist-friendly leadership of the incompetent Bari Weiss and nepo baby David Ellison, CBS News has devolved into a far-right propaganda arm of the authoritarian Trump regime.

With AI I'm doing some of the best design work of my life, but functionally I have devolved into that annoying micromanage-y creative director type who is like "nope move that box to the left. not that much. NOPE"