International Business Machines Corporation
Chatbot enhanced augmented reality device guidance

Abstract:

In an approach to interact with a chatbot through an augmented reality device. Embodiments consist of receiving a query from a user including a video feed, collecting visual information from the video feed, and determining additional visual information is required to respond to the query. Further, embodiments consist of dynamically identifying the additional visual information that is required, providing activity instructions to the user on how to collect the additional visual information in the form of a new video feed, and directing user actions via an augmented reality device while the user collects the additional visual information according to the activity instructions. Additionally, embodiments consist of identifying, in a knowledge corpus, a recommended response to the query based on the visual information from the video feed and the additional visual information from the new video feed, and presenting, via the augmented reality device, the recommended response to the user.