Luminar Technologies, Inc.
COMBINING LIDAR AND CAMERA DATA

Abstract:

A system operating in a vehicle includes a lidar module, a camera, and a controller communicatively coupled to the camera and the lidar module. The lidar module includes: a light source configured to emit pulses of light, a scanner configured to direct the emitted pulses of light in accordance with a scan pattern to illuminate a field of regard of the lidar module, and a receiver configured to detect the emitted pulses of light scattered by one or more remote objects to capture a set of lidar pixels of a scan frame, in a sequence defined by the scan pattern. The camera has a field of view that at least partially overlaps the field of regard of the lidar module. The controller is configured to cause the camera to capture multiple images while the receiver of the lidar module captures the set of lidar pixels of the scan frame.