Electronic Arts Inc.
Multi-objective experiments with dynamic group assignment

Abstract:

Methods for providing multi-objective experiments with dynamic group assignment are provided. In one aspect, a method includes receiving, from a configuration component of an experiment management system, a plurality of objectives and at least one constraint for an experiment. The method also includes assigning a test population of the experiment into a plurality of groups. The method also includes determining a progress summary that predicts completion rates for the plurality of objectives according to the at least one constraint. The method also includes modifying a prioritization of the plurality of objectives to optimize the predicted completion rates. The method also includes receiving a request to add additional users into the test population. The method also includes distributing the additional users into the plurality of groups according to the modified prioritization. Systems and machine-readable media are also provided.