International Business Machines Corporation
SCALABLE DISCOVERY OF LEADERS FROM DYNAMIC COMBINATORIAL SEARCH SPACE USING INCREMENTAL PIPELINE GROWTH APPROACH

Abstract:

A computer implemented method includes generating a pipeline graph having a plurality of layers, each of the plurality of layers having one or more machine learning components for performing a predictive modeling task. A plurality of pipelines are operated through the pipeline graph on a training dataset to determine a respective plurality of results. Each of the plurality of pipelines are distinct paths through selected ones of the one or more machine learning components at each of the plurality of layers. The plurality of results are compared to known results based on a user-defined metric to output one or more leader pipelines.