Caterpillar Inc.
Semi-autonomous robot path planning

Abstract:

A robot controller is disclosed. The robot controller may include one or more processors, communicatively coupled to the one or more memories, configured to: receive, from a vision sensor, an image of a path marker disposed on a workpiece, the path marker having a work path identifier corresponding to a work path to be traced by a robot end effector; determine, using a computer vision model, the work path based on the image, the computer vision model having been trained to detect the work path identifier and identify the work path based on the work path identifier; determine a set of coordinates within a workspace of the robot end effector based on the work path; generate a work path instruction to guide the robot end effector according to the set of coordinates; and cause the robot end effector to operate according to the work path instruction.