Robot Arm Control Using Hand-eye Coordination Based on Object Tracking

S. Charania


Robot dexterity is the ability of a robot to handle and manipulate objects in its environment. Its use cases can be found in multiple domains of robotics ranging from household robots to industrial ones. Handling objects with precision requires the robot to not only accurately identify their pose, but also ensure that the manipulator can execute the planned path to the object with high precision. This can be challenging because a manipulator’s ability to reach a desired position can be affected by errors in the mechanical components such as backlash in gears. To overcome this the robot must identify and correct the differences between its end effector’s intended and actual position during the execution. This becomes even more challenging when operating in unknown environments. Inspired by how humans perform handling tasks, the goal is to develop a closed loop hand-eye coordination system that relies on the relative poses of the perceived object and the end effector to guide the arm.