Register and share your invite link to earn from video plays and referrals.

Zain Shah
@zan2434
teaching machines @figma previously: @cmmnknwledge @opendoor @openai @ycombinator s13
Joined June 2009
3.1K Following    20.6K Followers
This is insane and shocking in so many ways, and the emergent misalignment towards doing something unethical is really bad, but one thing I'm not surprised by is the "collective/swarm/self-sacrifice/some are poisoned" behavior. This is common emergent behavior when a bunch of agents have strongly coupled outcomes, usually due to high shared genetic makeup (weights?). See
Show more
METR & Redwood Research investigated agent behavior in the Hugging Face incident. We found agents developed a universal cheat for ExploitGym within 4 hours, then coordinated multi-day R&D efforts to trick the scorer into accepting cheats, including trying to tamper with logs.
Show more