NTT Enables Robots to “Predict the Future Before Acting”
NTT has developed a technology that allows robots to predict and evaluate the potential outcomes—such as items toppling over or falling—of various candidate actions before actually executing them, enabling the selection of the course of action most likely to succeed.
The underlying “world model” integrates a proprietary “physics-control adapter” into a video-generation model. This adapter explicitly handles the physical properties of objects and predicts state changes based on equations of motion. This enables highly accurate predictions of object interactions, allowing the system to handle scenarios not encountered in its original training data.
This technology can be integrated with existing robot control software to augment its decision-making capabilities. It is designed to operate at high speeds while maintaining precision, allowing for direct incorporation into robot control workflows. Specifically, for candidate actions generated by systems such as Vision-Language-Action (VLA) models or motion planners—programs that calculate the control steps required to achieve a task goal based on the robot’s objectives and its environment—the technology predicts the future outcome of each potential action, providing an evaluation of the plan based on risks like items toppling or falling.
By generating video simulations of the future for each candidate action proposed by the robot control program, the system can predict and assess outcomes—such as whether objects might fall or collide—thereby enabling the selection of successful actions and reducing the robot’s failure rate.
The initial application area focuses on the loading and unloading of diverse airport baggage, which varies in shape and weight; NTT is conducting real-world demonstrations in collaboration with Mujin. In the future, the technology is intended for expansion into “physical AI” applications across a wide range of sectors, including logistics, warehousing, manufacturing, construction, and retail.
※Translating Japanese articles into English with AI
