ServiceNow, Inc.
Intelligent load balancer

Abstract:

Techniques for routing requests on a network are described. In accordance with certain aspects, a temporal window is incremented or moved over time to facilitate dynamic routing decisions. The temporal window may be used to project or estimate incoming request traffic based on a suitable probabilistic distribution model, such as a Poisson or Gaussian probability distribution, applied to the window so as to estimate or predict traffic at different times as the window is incremented. Estimated execution times for incoming requests may also be computed so that arrival and completion times of each request or traffic event can be modeled. Processor-implemented routines may be employed to solve the sub-problems defined by the temporal window incoming traffic estimation and the estimated execution times efficiently, allowing the parent or overall routing decision problem to be solved efficiently using dynamic processes, including in real-time contexts.