International Business Machines Corporation
HYBRID ENSEMBLE MODEL LEVERAGING EDGE AND SERVER SIDE INFERENCE

Abstract:

In an approach for a hybrid ensemble model leveraging edge and server side inference, a processor receives data on an edge device. A processor sends the data to a server. A processor performs, in parallel, inference on the data using a first model on the edge device and a second model on the server. A processor returns a result of the second model to the edge device. A processor ensembles, on the edge device, a result of the first model and the result of the second model based on a set of weights to produce an ensembled result. A processor outputs the ensemble result for a user to view through a user interface of the edge device.