This article discusses a new generative evaluation system for assessing robotics policies using the Veo World Simulator. It demonstrates how video models can predict robot performance across various scenarios, including out-of-distribution conditions and safety testing. The system has been validated through extensive real-world evaluations of multiple policy checkpoints.

Gemini Robotics 1.5 introduces advanced AI models that enable robots to perceive, plan, and execute complex tasks in the physical world. The models enhance a robot's ability to reason, learn across different embodiments, and interact naturally, marking a significant step towards achieving artificial general intelligence (AGI) in robotics. Developers can access these capabilities through the Gemini API in Google AI Studio.

Humanoid robots are poised to transform the workforce, with companies like Agility Robotics and Tesla planning significant production increases. However, challenges such as demand, battery life, reliability, and safety must be addressed before these robots can scale effectively in real-world applications. While the potential for humanoid robots is acknowledged, the current technological and market realities suggest a cautious path forward.