Research
Researchers turned internet videos into 5 million moves a Unitree G1 can actually perform, and released the model
Humanoids have a data problem, and this team went to YouTube-scale video to fix it. "Zhejiang University and Unitree Robotics have released Movens-5M, a dataset of 5 million motion sequences for training humanoid robots," XRoboHub posted on X on Friday. "The model weights and training code are public, too."
What is in the dataset
According to the paper summary on Microsoft Research, one of the partner institutions, Movens-5M contains 15 million human-motion sequences and 5 million "physically executable humanoid-motion sequences spanning over 10,000 hours", aligned with text, video, speech and music. The project page lists Zhejiang University, Unitree Robotics and their joint lab among the authors, with others including Microsoft Research, Peking University and the National University of Singapore.
The hard part is turning human video into motion a robot can do. The project page describes a five-stage pipeline that cuts clips, filters for quality, labels them, reconstructs and retargets the human motion to Unitree's G1, then checks it by running it in closed-loop simulation. Motions the robot cannot reproduce are dropped.
What the model does
The data trains Movens-Zero. The researchers say text, video, speech and music share one motion space, and the model replans in real time from the latest instruction and the robot's state. XRoboHub says the demos show a G1 following written and spoken commands, copying moves from videos and dancing to music.
Why it matters
Motion capture is precise but expensive, while internet video is huge but messy. A pipeline that filters video down to physically checked motion could give robot makers far more training data. Releasing weights and code means other labs can test that claim. The work is built around Unitree's G1, one of the most widely used research humanoids, covered in our Apple Halo story.
Demo videos show the best cases. How well the model handles motions it has not seen is a question for independent tests.
