Register and share your invite link to earn from video plays and referrals.

micro1
@micro1_ai
data lab to train frontier models & evaluate agents
Joined August 2022
0 Following    22.1K Followers
We’re sharing more information about flow qc, our system for reviewing the tasks used to train and evaluate frontier models across domains, with multimodal support including audio and video. A task can ask for the right work and still reward the wrong behavior. Grading rules can reject valid answers, miss real mistakes, or leave room for reward hacking. flow qc red teams tasks, grading rules, and model rollouts to investigate these issues before human review, providing experts with evidence for each finding and a proposed fix. Our latest article shares how we built this process and what we’ve learned from running it in production. Read more below.
Show more