Microsoft Corporation
TRAINING A MACHINE-LEARNED MODEL BASED ON FEEDBACK

Abstract:

Techniques for training a machine-learned model based on feedback are provided. In one technique, reformulation data that comprises a plurality of sequence pairs is stored. Also, feedback data that comprises a plurality of sequence triples is stored. Based on the reformulation data and the feedback data, one or more machine learning techniques are used to train a sequence-to-sequence model. Training the sequence-to-sequence model involves using a loss function that comprises (1) a first term that takes, as input, sequence pairs from the reformulation data and (2) a second term that takes, as input, sequence triples from the feedback data. After training the sequence-to-sequence, a search query is received from a computing device. In response to receiving the search query, a set of embeddings is retrieved, each corresponding to a token in the search query. The set of embeddings is input into the sequence-to-sequence model, which generates one or more query suggestions. The one or more query suggestions are then presented on the computing device.