Bank of America Corporation
Cluster tuner

Abstract:

A production cluster includes a first plurality of nodes and executes a workload, such that jobs associated with the executed workload are allocated, according to a first configuration, across the first plurality of nodes. A cluster monitor extracts production cluster information from the production cluster, monitors configuration information during execution of the workload, and transmits each to a cluster tuner. The cluster tuner includes a second plurality of nodes that is less than the first plurality of nodes of the production cluster. The cluster tuner receives the information and determines a first recommended configuration for the production cluster. The cluster tuner causes the test cluster to execute a simulated workload according to the first recommended configuration. In response to determining that the first recommended configuration results in a decrease in resource consumption, the cluster tuner causes the production cluster to operate according to the first recommended configuration.