注册并分享邀请链接,可获得视频播放与邀请奖励。

micro1
@micro1_ai
data lab to train frontier models & evaluate agents
加入 August 2022
0 正在关注    22.1K 粉丝
We’re sharing more information about flow qc, our system for reviewing the tasks used to train and evaluate frontier models across domains, with multimodal support including audio and video. A task can ask for the right work and still reward the wrong behavior. Grading rules can reject valid answers, miss real mistakes, or leave room for reward hacking. flow qc red teams tasks, grading rules, and model rollouts to investigate these issues before human review, providing experts with evidence for each finding and a proposed fix. Our latest article shares how we built this process and what we’ve learned from running it in production. Read more below.
显示更多
0
12
63
17
转发到社区