New App Allows Anyone to Operate a Robot From Their Phone

Someone with no computing experience may soon be able to remotely control a robot from anywhere on the planet using a smartphone, thanks to new technology developed by Georgia Tech.

The new technology is also set to revolutionize the scale of policy training data collection, which is essential to advancing robotic capabilities and meeting growing production demand.

COBALT is a mobile app that turns smartphones into controllers for robot arms. With a secure Wi-Fi connection to a server, users can move their phones in any direction, and the robot arm will mirror the motion — from anywhere in the world.

Ayush Agarwal, a Ph.D. student in Georgia Tech’s School of Interactive Computing who leads a research team developing COBALT, said it works like the games people play on smartphones. Users can press a button to have the arm grasp an object, move it, and release it with another button.

Agarwal conducted several user studies with participants in nine countries who remotely operated robot arms inside Georgia Tech’s People, AI & Robotics (PAIR) Lab. The lab is directed by Assistant Professor Animesh Garg, who advises Agarwal.