Microsoft Corporation
Sequential sampling from multisets

Abstract:

Systems, devices, media, and methods are presented for dynamically sampling training elements while training a plurality of machine learning models. The systems and methods access a plurality of training elements and generate an element buffer including a specified number of positions. The systems and methods generate a random value for each position for the element buffer and map a training element of the plurality of training elements to each position within the element buffer in a first order. The systems and methods generate a second order for the training elements and allocate the training elements to a plurality of machine learning models according to the second order.