View, Inc.
System and method for facilitating virtual interactions with a three-dimensional virtual environment in response to sensor input into a control device having sensors

Abstract:

Various implementations provide for a three-dimensional trackpad in which sensors and a three-dimensional physical region may be used to interact with a three-dimensional virtual environment. The methods, systems, techniques, and components described herein may facilitate interactions with virtual objects in a three-dimensional virtual environment in response to sensor input into a control device having one or more sensors implemented thereon. The control device may be coupled to a display that may be configured to display the three-dimensional virtual environment. In various implementations, the sensor(s) capture physical movement of a user interaction element (a hand, a stylus, a physical object, etc.) within a specified three-dimensional physical region. The physical movement may be translated into a virtual interaction with the three-dimensional virtual environment. A virtual action in the three-dimensional virtual environment may be identified and displayed.