John Biggs of Tech Crunch reports, "A new research project by a computer science team at Cornell University is using human volunteers to train robots to perform tasks. How is it unique? They’re showing robots how to infer actions based on very complex, human comments. Instead of having to say 'move arm left 5 inches' they are hoping that, one day, robots will respond to 'Make me some ramen' or 'Clean up my mess.' The commands are quite rudimentary right now and focus mostly around loose requests like “boil the ramen for a few minutes” which, with enough processing, can be turned into a step-by-step set of commands. For example, in the video above a subject asks for an affogato, basically coffee with ice cream. The robot has learned the basic recipe and so uses what is at hand — a barrel of ice cream, a bowl, and a coffee dispenser — to produce a tasty treat for its human customer."
Biggs continues, "We’re not quite at 100% accuracy yet. But, interestingly, the robot performed the right steps 64 percent of the time even when the commands changed and the entire scene was reorganized. 'There is still room for improvement,' said the researchers. 'In order for robots to perform tasks in real world, they need to be able to understand our natural language commands. While there is a lot of past research that went into the task of language parsing, they often require the instructions to be spelled out in full detail which makes it difficult to use them in real world situations,' they wrote. 'Our goal is to enable robots to even take an ill-specified instruction as generic as ‘Make a cup of coffee’ and be able to figure out how to fill a cup with milk or use one if it already has milk etc. depending on how the environment looks'.”