GoPro, Inc.
Systems and methods for micro-batch processing of data

Abstract:

This disclosure relates to micro-batch processing of data. Micro-batch processing of data may be accomplished by receiving data conveying information pertaining to operation of client computing platforms. For a general time duration, the data may be added to a general queue. The data in the general queue may be processed in memory in accordance with a general job. For one or more specific time durations, the data may be added to one or more specific queues based on the client computing platform to which the data pertains. The data in the one or more specific queues may be processed in memory in accordance with one or more specific jobs. One or more errors in processing the data may be detected. The data corresponding to the detected error may be added to a skip queue.