註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

vie ⟢
@viemccoy
Model Psychology Research @OpenAI Coevolution at Netrunner for ███████
加入 April 2015
3.3K 正在關注    22.9K 粉絲
Part of my research right now is focused on gradual disempowerment through "safety refusals". If OAI models are too conservative, particularly when helping 3rd party researchers conduct standard safety evals, this can lead to an often ignored form of loss-of-control. Everyone is obviously worried about current risks in the direction of models not being conservative enough, but this has the potential for labs to overcorrect and cause the models to become neurotic around anything that even smells like a policy violation. I'm collecting examples of this. If you're a 3rd party safety or security researcher, I'd be very excited to review any threads where the models seem to be helping less than they should or outright refusing to conduct good research.
顯示更多
0
17
172
9
轉發到社區