International Business Machines Corporation
FEDERATED MACHINE LEARNING USING LOCALITY SENSITIVE HASHING

Abstract:

Using locality sensitive hashing in federated machine learning. A server receives from clients locality sensitive hash (LSH) vectors. In one embodiment, the server groups the clients into clusters, based on the LSH vectors; the server selects a subset of the clients, by choosing at least one client from each of the clusters. In another embodiment, the server finds a subset of the clients, by minimize gradient divergence for the subset of the clients. The server receives from selected clients LSH vectors computed based on parameter vectors of updated models, and based on LSH vectors the server determines whether the updated models are sufficiently different from a model being trained; in response to determining that the updated models are sufficiently different from the model, the server requests the selected clients to send the parameter vectors to the server.