Microsoft Corporation
OPTIMIZING INPUT STREAMS FOR A STREAM JOIN MODEL HAVING A THRESHOLD FUNCTION

Abstract:

The present disclosure relates to systems, methods, and computer-readable media for receiving and processing multiple data streams using a stream join model and based on the stream join model having a threshold function for which an output of the stream join model crosses the threshold two or less times (e.g., where the threshold function is a convex function, linear function, monotonic function, or other function having a similar property). The systems disclosed herein generate filtered data streams using a number of techniques and algorithms without risk of false negatives and missing instances where an output of a stream join exceeds or violates a threshold condition. The systems disclosed herein can significantly reduce processing expense, particularly in cases where one or more devices have limited memory and where caching tuples from incoming data streams consumes significant processing resources.