The chem/bio automated evals for Mythos 5 are probably underestimating capabilities because they're only giving the models 1M tokens. This doesn't inspire confidence in the risk determinations, and makes me pretty nervous about a lack of 3rd party auditors for AI biorisk.
もっと見る
