one
Sorted parallel processing of a large dataset

Abstract:

Disclosed herein are system, method, and computer program product embodiments for sorted parallel processing of large dataset to provide quicker search results to a user. An embodiment operates by receiving a search request containing a first attribute from a user, determining an intermediate result set of items in a database based on the search request, and sorting the items based on a second attribute of the items. The embodiment further operates by dividing the sorted items into a plurality of batches with sequential IDs, determining a result corresponding to the first attribute for each item in parallel, creating a sequentially-ordered list of determined results, identifying a subset of determined results based on a comparison between the determined results and a target result, determining a final result set of items, and returning at least a portion of the final result set of items to the user.