International Business Machines Corporation
Augmented reality virtual order assistant

Abstract:

An approach is provided for generating an interface. Using natural language processing and natural language understanding, ingredients are derived from audio data from a customer's spoken order of ingredients of a food item. Locations of the ingredients in a preparation area are identified. A location of an employee is determined. Distances of the ingredient locations to the employee location are calculated. A sequence of selecting the ingredients is determined so that the employee selecting the ingredients in the sequence optimizes a speed at which the food item is prepared. An overlay to an interface for viewing in an augmented reality (AR) headset worn by the employee is generated and displayed. The overlay includes indicators overlaying an image of the preparation area. The indicators mark the ingredients, mark the sequence of selecting the ingredients, and distinguish the ingredients from other ingredients in the preparation area.