International Business Machines Corporation
Evaluation framework for intent authoring processes

Abstract:

Evaluating intent authoring processes, by a processor in a computing environment. Results are received of a simulated intent labeling effort of a dataset comprising utterances of interactive dialog sessions between agents and clients for a given product or service. Figures of merits for respective algorithms used to perform the simulated intent labeling effort are computed. Each of the respective algorithms are evaluated according to the computed figures of merits; and one of the respective algorithms is implemented for labeling intents of a remaining corpus of the synthesized dataset according to parameters evaluated in the computed figures of merits.