ServiceNow, Inc.
ACTIVE QUEUE MANAGEMENT IN A MULTI-NODE COMPUTING ENVIRONMENT

Abstract:

Systems and methods for processing computing jobs of a managed network are disclosed. Each of one or more worker nodes may implement a scheduler thread and a pool of worker threads. Upon waking up from a sleep state, the scheduler thread may determine a current number of jobs in an in-memory job queue that are waiting for processing by a worker thread, and may compute a job-completion rate of jobs processed by threads of the pool. Based on the job-completion rate, the scheduler thread may perform one or more of retrieving more jobs from a centralized database job queue and adding them to the in-memory job queue; removing one or more jobs from the in-memory job queue and returning them to the database job queue; leaving the in-memory job queue unchanged; or adjusting the duration of the sleep-interval timer. The scheduler thread may then return to a sleep state.