Dennison
@DennisonBertram
Open for Collabs. Building a startup per week.
Prev: @tallyxyz
Joined December 2009
2.1K Following 12.9K Followers
Great, means the market for human generated data continues to be infinite.
:-)
Today we are introducing Dyna-2, a world-action model pre-trained on one million hours of human video. At this scale, for the first time, we discovered several new scaling laws:
• world-action models exhibit scaling law on human data across four orders of magnitude, from 1000 to 1,000,000 hours,
• this human data scaling law implied a scaling law on never seen robot data,
• both data and objective matter; world modeling and scaling on video data are essential for cross-embodiment scaling transfer to emerge
🧵
Show more
