Walmart Inc.
Shared experiment control

Abstract:

Systems and methods for providing a shared control group are disclosed. A request for a page is received and each user device is assigned to a shared control pool or one of a plurality of experiments. The shared control pool includes a first percentage of user devices and each of the experiments includes an experimental percentage. For each user device in the shared control pool, a base version of each element is transmitted; for each user device in a first experiment, a first variant element is transmitted; and for each user device assigned to a second experiment a second variant element is transmitted. A record indicative of interactions that occur after transmission is received and the interactions of a first subset of the shared control pool is compared with the devices assigned to the first experiment and a second subset is compared to the devices assigned to the second experiment.