VMware, Inc.
FEDERATED INFERENCE

Abstract:

In one set of embodiments, a computer system can receive a query data instance for which a prediction is requested and transmit the query data instance to a plurality of computing nodes. The computer system can further receive, from each computing node, a per-node prediction for the query data instance, where the per-node prediction is generated by the computing node using a trained version of a local machine learning (ML) model of the computing node and where the per-node prediction is encrypted in a manner that prevents the query server from learning the per-node prediction. The computer system can then aggregate the per-node predictions, generate a federated prediction based on the aggregated per-node predictions, and output the federated prediction as a final prediction result for the query data instance.