Bentley Systems, Incorporated
Tool for onsite augmentation of past events

Abstract:

In one embodiment, at an initial time, a capture system records a 3D video stream and an audio stream of a first user interacting with the physical environment. A processing device receives the 3D video stream and the audio stream, isolates the first user from the physical environment, and stores at least a portion of the isolated representation and a portion of the audio stream. At a subsequent time, a second user uses a camera of an augmented reality device to capture a scene. The augmented reality device loads the portion of the isolated representation of the first user and the portion of the audio stream, aligns the 3D video stream with the captured scene, and calculates a pose of the augmented reality device. The augmented reality device then produces an augmented scene, which is displayed to the second user while the portion of the audio stream is played back.