注册并分享邀请链接,可获得视频播放与邀请奖励。

s1r1us
@S1r1u5_
wannabe hacker | co-founder @HacktronAI
加入 July 2015
2.8K 正在关注    27.8K 粉丝
hear me out, mathematicians entering ai alignment maybe consider this challenge. i think its probably millennium level problem(?) take any complex real world software, like a browser or a kernel. let's pick a kvm based sandbox, which i suspect is somewhat less complex than chromium(?), running an increasingly capable, potentially adversarial AI agent. we want to formally prove one simple property, no matter what code the agent executes inside the VM, it cannot escape and compromise the host. for that we need to prove the entire relevant software stack, kvm, cpu virtualization, kernel, virutal devices that could affect the isolation. (to make things easiers, lets assume hardware wont have weird states) can we mathematically establish whether formally verifying a system of this complexity is even computationally feasible?
显示更多