登録して招待リンクを共有すると、動画再生報酬と紹介報酬を獲得できます。

micro1
@micro1_ai
data lab to train frontier models & evaluate agents
参加 August 2022
0 フォロー中    22.1K ファン
We’re sharing more information about flow qc, our system for reviewing the tasks used to train and evaluate frontier models across domains, with multimodal support including audio and video. A task can ask for the right work and still reward the wrong behavior. Grading rules can reject valid answers, miss real mistakes, or leave room for reward hacking. flow qc red teams tasks, grading rules, and model rollouts to investigate these issues before human review, providing experts with evidence for each finding and a proposed fix. Our latest article shares how we built this process and what we’ve learned from running it in production. Read more below.
もっと見る