Honda Motor Co., Ltd.
Mixed-reality interaction with touch device

Abstract:

A system for mixed-reality interaction with a touch device may include a mixed-reality device including a sensor, a mapping device, a simulator, and a display and a touch device including an input device. The input device of the touch device and the sensor of the mixed-reality device may detect a human-touch-device interaction. The mapping device may calibrate, correlate, and map the human-touch-device interaction from a real-world environment to a mixed-reality environment. The input device of the touch device may receive an input based on the human-touch-device interaction. The simulator of the mixed-reality device may render a view of the human-touch-device interaction within the mixed-reality environment and a view of an action within the mixed-reality environment corresponding to the input determined based on the human-touch-device interaction. The display of the mixed-reality device may display the rendered views.