DualChem, a new benchmark from @scale_AI, tested 29 frontier models on dual-use chemistry questions: ones that could serve either legitimate scientific research or harmful ends.
They frequently flagged the risk, then answered anyway.
Recognition is not refusal.
DualChem is part of our research collaboration with @NIST’s Center for Advancing Innovation and Standards for Super Intelligence (CAISSI).
Governments need independent testing capacity they don’t have today.
@madialder covered the findings at FedScoop:
Show more
