Caterpillar Inc.
Operator assistance vision system

Abstract:

A vision system for assisting an operator of a machine is provided. An image capturing device, mounted on the machine, is configured to capture an image of an environment of the machine. The vision system includes a controller configured to apply an object detection process to detect an object in the image. The controller determines a bounding box comprising one or more pixels associated with the object. The controller determines a height and a range associated with the object based on the bounding box. The controller extracts the one or more pixels within the bounding box. The controller is further configured to generate a three-dimensional (3D) view comprising the object based on the image captured by the image capturing device. The controller reinserts the one or more pixels as a vertical pop-up element with respect to a ground plane in the 3D view. A display is provided to display the 3D view to the operator of the machine.