Bank of America Corporation
Virtual assessments using augmented reality user devices

Abstract:

An augmented reality system that includes an augmented reality user device. The augmented reality user device includes a display for overlaying virtual objects onto objects in a real scene, a camera, and a global position system sensor. The augmented reality user device includes a processor implementing an object recognition engine, a virtual assessment engine, and a virtual overlay engine. The object recognition engine identifies tangible products from an image. The virtual assessment engine authenticates the user, identifies a user identifier for the user, and identifies a vendor based on the geographic location of the user. The virtual assessment engine captures an image and performs object recognition on the image to identify products in a cart. The virtual assessment engine sends a token to a remote server, receives available offers for the user from the server, and presents the available offers as virtual objects overlaid with the products in the cart.