eBay Inc.
PARALLEL EXECUTION OF API CALLS USING LOCAL MEMORY OF DISTRIBUTED COMPUTING DEVICES

Abstract:

Methods, systems, and computer storage media are provided for providing an application programming interface ("API") for executing a query are provided. The API call, scheduling, and assignment processing engines may generate and schedule assignments, along with associated dataset portions, based on the query. Based on the assignments and datasets, the assignments may be scheduled for execution by processes of nodes in a distributed system. The API call and query may also include implementation instructions that require storing dataset portions into memory that is associated with a process executing the assignment for an in-memory database implementation. As the assignment is executed using a dataset portion that is stored on memory associated with a process, results may be stored in a file. Once each assignment has been executed and has a result file, the result files are merged to provide results of the query and API call to the user.