가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

Nikhil Chandak
@nikhilchandak29
PhD @ Max Planck Institute. Prev: Post-Training @MistralAI Past @iiit_hyderabad @VectorInst. Interested in better evals, forecasting, and open-endedness.
가입 December 2016
573 팔로잉 중    1.1K 팬
Indeed, our FutureSim paper has several interesting ablations. For example: If we let agents start from the same prior/predictions on day0, can they recover their original performance? We found agents only update questions where they find relevant evidence and never re-visit their predictions on rest of the questions. So if the agents start from wrong overconfident predictions, they fail to reach even the 0 baseline of not attempting anything! Agents still have a long way to go...
더 보기