Anthropic's second Risk Report is out! I'm pretty happy with a lot of the new things we landed in this one and think it's a big improvement over our first one in a bunch of ways. Among the novel features: * Coverage of internal models * A much more structured argument around alignment risk * Claude-powered review of the alignment section * Discussion of a wide variety of incidents, safety process failures, and ways Anthropic has fallen short (see 4.8.2, 6.5, and especially 5.2) * An attempt to get somewhat quantitative about threat modeling for CB-2 risk despite enormous uncertainty * Much more detailed discussion of jailbreak risks * Two different cases of increasing assessed risk levels from "very low" to "low" on the basis of general increased uncertainty given worries about the overall degree of process assurance * Early notes on some cool new model organism work that informs the alignment assessment and more! Excited to hear thoughts on how the next one could be better.