PaLM-E does this by analyzing data from the robot's camera ... that takes RGB image and natural language instruction, and outputs end-effector control commands. PaLM-E is a next-token predictor ...