Microsoft Corporation
Customer engagement platform experimentation framework

Abstract:

Systems and methods provide a customer engagement platform experimentation framework. Experiments are created to determine which variation of a particular promotion (i.e., an experiment) is most effective. Initially, users are split into buckets that define whether a particular user is in a control group or a treatment group for a particular experiment. Users are assigned into buckets differently for unrelated experiments and similarly for related experiments. This ensures the users are in either the control group or the treatment group for all related experiments. Key performance indicators (KPIs) of users that experienced the experiment are compared with KPIs of users that did not experience the experiment. An assessment of the experiment can then be provided based on the compared KPIs.