Meta releases V-JEPA 2 to train AI on real-world physics
Meta introduced V-JEPA 2 on Wednesday, a new AI “world model” designed to enhance an AI agent’s comprehension of its environment. V-JEPA 2 expands upon the original V-JEPA model released last year.
Video: Meta
The V-JEPA model was trained using over 1 million hours of video footage. This training aims to assist AI agents, particularly robots, in navigating the physical world by predicting outcomes based on concepts, such as gravity.
Meta gives the example of a robot holding a plate and spatula while walking toward a stove with cooked eggs. The AI should predict that the next likely action would be transferring the eggs to the plate using the spatula. Meta reports that V-JEPA 2 operates 30 times faster than Nvidia’s Cosmos model, which also aims to improve intelligence related to the physical world. Meta stated that these measurements may have been evaluated using different benchmarks from Nvidia.
Video: Meta
The company’s chief AI scientist, Yann LeCun, stated in a video, “We believe world models will usher a new era for robotics, enabling real-world AI agents to help with chores and physical tasks without needing astronomical amounts of robotic training data.”