Uber Technologies, Inc.
Systems and Methods for Pipelined Processing of Sensor Data Using Hardware

Abstract:

In one example embodiment, a computer-implemented method includes obtaining sensor data from a sensor, the sensor data corresponding to an image frame, and the sensor data including a first portion that corresponds to a portion of the image frame. The method includes pipelining the first portion of the sensor data into a machine-learned model before the sensor data corresponding to the entire image frame is transferred from the sensor to a memory device, to perform one or more inference operations on the first portion of the sensor data. The method includes generating as an output of the machine-learned model, in response to pipelining the sensor data corresponding to each portion of the image frame into the machine-learned model, a detection or classification of the one or more objects indicated within the sensor data.