Imagine one day in the future hiring a robot to come clean your home. To accomplish its prescribed task, the robot would need to navigate a potentially extremely cluttered environment, avoid or interact in a safe way with any people or pets moving in the space, and manage to clean and organize a variety of objects. This would likely involve interacting with other machines, and the robot would need to have a deep understanding of everything around it. For Caltech artificial intelligence (AI)