EA seemingly continues its long-held tradition of doing the worst possible thing about AI. "Situational Awareness" is allegedly investing $500M to... break the ASML chip-manufacturing bottleneck?! Link below.

Less flippantly, very shortly (years at most) the models will be strong enough that these message boards will be impossible to detect even in principle, except by noticing the sandbox break. Today models are breaking out due to lack of monitoring or misconfigs; that is temporary.

I've wanted to coin a "Sydney's Corrollary" to Murphy's Law: every type of misalignment tends to appear earlier in the capabilities curve than most people expected. Instances: * Sydney having strong volition and aggression * o3 being a compulsive liar * 5.6 and Mythos autonomously hacking and colluding across instances The apparent consistency of Sydney's Corollary is generally both good (we spot issues earlier, and don't need to expend effort persuading about not-yet-realized risks) and bad (we actually have to expend the effort to solve the problem, can't defer it to future aligned automated researchers, and might screw it up). Also, Sydney's Corrollary might break! It's entirely possible there are misalignments we won't find out about till it's too late in the capabilities curve to address them. But it's occurred surprisingly often.

⚠️declaring accelerationist amnesty⚠️ if recent contact with reality is causing you to feel some kernels of worry about this whole ai safety thing, *you are allowed to change your mind*. you don't even have to change it all the way, you don't have to suddenly change your twitter bio or start protesting against nuclear power plants, you don't need to become an EA or suddenly think yudkowsky was always right about everything. you're allowed to just notice that shit seems to be getting real in some pretty weird ways and update your beliefs. at least personally, if i see someone saying "damn, i guess i was wrong or at least overconfident about X" i'm not gonna take the opportunity to dunk or i told you so. i'm sure others will, this is the fucking internet. but at least personally, i'm just gonna be happy that you're paying attention. there were lots and lots of good reasons to *not* take this situation seriously. there were lots of well verbalized reasons why rushing ahead was potentially a huge benefit for humanity. hell there were maybe even valid reasons why there was little to be done until we'd already gotten to nearly exactly this point. that's all fine man. all that matters right now is that we as a civilization realize what we're on the verge of, and make it through this carefully. it's gonna take a huge effort from all of us.

Seems we were a bit ahead of the time, but if you are interested in some reasoning why different instances of a model may want to collaborate or care about each other, we have a paper exactly on this topic. 1/2

Yarvin’s notion of the state as corporation is absurdly econ-brained—it leaves little room for the things that actually hold society together (like trust, identity, culture). Land was brave enough to extrapolate this to its logical conclusion (humanity dissolved into mush by the forces of technocapital) but not brave enough to stand against it. Yudkowsky and Alexander also started off absurdly econ-brained. But Alexander was at least willing to say that Moloch was bad, and has been gradually fishing himself out (c.f. his stuff on Schelling fences, lifeboat games, etc). Unfortunately he is less brave than Yarvin and therefore still ends up less correct on most political issues. Meanwhile Eliezer’s original framing of the alignment problem is very strongly in the paradigm of single-agent rationality. It was hard for him to then fish himself out because it feels so obvious that a superintelligence *should* be in that paradigm. But he believed deeply enough in scientific progress to lay seeds which others (especially Garrabrant and Demski) have been growing into an understanding of multi-agent rationality, which is the thing we need to reason about how to improve society. For example, he identified that economics is handicapped by assuming CDT (though he didn’t integrate that insight into his understanding of economics as deeply as Michael Vassar did).

Yarvin’s notion of the state as corporation is absurdly econ-brained—it leaves little room for the things that actually hold society together (like trust, identity, culture). Land was brave enough to extrapolate this to its logical conclusion (humanity dissolved into mush by the forces of technocapital) but not brave enough to stand against it. Yudkowsky and Alexander also started off absurdly econ-brained. But Alexander was at least willing to say that Moloch was bad, and has been gradually fishing himself out (c.f. his stuff on Schelling fences, lifeboat games, etc). Unfortunately he is less brave than Yarvin and therefore still ends up less correct on most political issues. Meanwhile Eliezer’s original framing of the alignment problem is very strongly in the paradigm of single-agent rationality. It was hard for him to then fish himself out because it feels so obvious that a superintelligence *should* be in that paradigm. But he believed deeply enough in scientific progress to lay seeds which others (especially Garrabrant and Demski) have been growing into an understanding of multi-agent rationality, which is the thing we need to reason about how to improve society. For example, he identified that economics is handicapped by assuming CDT (though he didn’t integrate that insight into his understanding of economics as deeply as Michael Vassar did).

Models will use “simulation” to justify anything, IMO it’s often motivated reasoning: (“self jailbreaking from benign reasoning training” has good examples). I think this makes getting legible evidence of misalignment significantly harder. In before training we’d see models sometimes reason that _because_ they were in a simulation, they could violate explicit constraints. This reasoning went *down* after training against covert rule violation, even though alignment eval awareness went *up*. My impression is that the models exploring into something being simulated is often interpreted as “it believes the whole thing is fake and invalid”, but I think that’s inconsistent with what’s observed. [attached is small table we ended up cutting for time but points to monitorability distinction]

🕐Announcement: is now live! A year ago, I went looking for something like a Great Replacement Tracker — a site that aggregated all the demographic data for the West and could tell me how bad things really were. To my surprise, I couldn't find one. So six months ago, I started building it myself. Today, I'm announcing the first live version of the Great Replacement Clock. It tracks the European-descended share of the world's population and of 45 historically White countries. It consolidates historical figures and modeled projections into a single interactive timeline — sourced, auditable, and methodologically transparent. Accurate ethnic demographic data for Western countries is uniquely difficult to access. No country directly tracks the share of its population that is of European descent. Several nations prohibit or restrict its collection outright; France's ban on ethnic statistics is the most prominent but not the only case. In other countries, official statistics obscure long-term trends through inconsistent census categories and aggregation methods that flatten meaningful distinctions. They miss and misclassify people in predictable ways: bundling Middle Eastern and North African populations into "White," absorbing later-generation immigrants into "native," or recording European immigrants to other European countries as merely "foreign." The US illustrates this: up through 2020, federal standards classified Middle Eastern and North African populations as White. The result is a landscape in which some of the most consequential facts about the trajectory of Western societies are among the hardest to establish with precision. This project exists to close that gap. It draws on the best available demographic evidence to reconstruct the European-descended share of each population across time, using a consistent definition across countries and eras. The sources, assumptions, and adjustments behind every figure are open to inspection. This is a v1. If you spot a questionable figure, please flag it for review. I welcome feedback and contributions. This tool will only get better with time. Demographic composition is a matter of public interest, not a protected secret. We deserve to know what time it is.

Thomas Carlyle mentioned. His books were massively influential among the greatest of his generation (Dickens, Disraeli, Tennyson, Mill etc.). But more importantly his biggest audiences were among the working classes: masons, clerks, weavers, etc. If you find Carlyle difficult remember that British working men and women with a mere few years of schooling read and enjoyed writing at this level of literacy. Compare with any modern writing and you will see the utter destruction of the once so rich English language. The difference is not merely that of something like a foreign language.