Stanford lets robot clean kitchen with GPT-6 Astra

Researchers from Stanford and Caltech have presented an innovative system called HomeBody, which is capable of autonomously exploring, cleaning, and retrieving objects from drawers in an unknown kitchen with a Unitree G1 robot. This project serves as a new test for the robotics capabilities of the language model GPT-6 Astra, highlighting advances in planning and executing concrete tasks in a physical environment.

The HomeBody system begins by mapping the kitchen using the robot, which then creates a digital twin in Nvidia's Isaac Sim. This allows the robot to store objects and locations in a sort of spatial memory, which is essential for effectively locating items and navigating purposefully. In tasks such as