Charlie O'Neill(@oneill_c):I think a downstream consequence of increased commitment to safety and alignment is that RL envs companies get screwed, or at least held to a much higher standard and thus their unit economics changes. The evidence is mixed on this early but it seems likely that impossible to poor quality envs lead to misalignment and poor behaviour in the models (as they try to do anything to get reward). So why would the labs risk this quality control with anything but big in-house efforts moving forward

Charlie O'Neill

@oneill_c

The sea is the sea The old man is an old man The boy is a boy and the fish is a fish The sharks are all sharks no better and no worse

参加 September 2016

1.1K フォロー中 22.4K ファン

Charlie O'Neill@oneill_c

2026.09.14 14:13

I think a downstream consequence of increased commitment to safety and alignment is that RL envs companies get screwed, or at least held to a much higher standard and thus their unit economics changes. The evidence is mixed on this early but it seems likely that impossible to poor quality envs lead to misalignment and poor behaviour in the models (as they try to do anything to get reward). So why would the labs risk this quality control with anything but big in-house efforts moving forward

178

コミュニティへ転送

人気のあるユーザー