Very impressive work and exciting results. Also, congrats to
@JasonMa2020 and the Dyna team for being the first to really launch this at scale. Everyone is now learning from humans. The end of this year is going to be crazy. I’d love to learn more about the dataset composition—what percentage is monocular vs. stereo, how much includes wrist cameras, and whether you have any additional metrics that capture the dataset’s diversity
Today we are introducing Dyna-2, a world-action model pre-trained on one million hours of human video. At this scale, for the first time, we discovered several new scaling laws:
• world-action models exhibit scaling law on human data across four orders of magnitude, from 1000 to 1,000,000 hours,
• this human data scaling law implied a scaling law on never seen robot data,
• both data and objective matter; world modeling and scaling on video data are essential for cross-embodiment scaling transfer to emerge
🧵