Luminar Technologies, Inc.
Early fusion of lidar return data with camera information

Abstract:

Lidar return data is fused early with camera information. In one embodiment, a voxel is detected in a frame of a lidar corresponding to an external scene. The voxel is mapped to a patch in a frame of a camera of the external scene corresponding to the voxel. The patch has a plurality of pixels. Each pixel has a plurality of color values. The voxel is augmented with the patch of pixels and the augmented voxel is delivered to a perception engine.