Microsoft Corporation
Augmenting the functionality of non-digital objects using a digital glove

Abstract:

The disclosed technologies address technical problems, including improving human-computer interaction, by augmenting the functionality provided by non-digital objects using a digital glove. To provide this functionality, a machine learning model is trained using sensor data generated by sensors in a digital glove and data generated by a user input device while the digital glove is utilized to manipulate an object like a user input device. Once trained, the machine learning model can take sensor data generated by a digital glove while manipulating a non-digital object and generate virtual user input device data that can be utilized to control a host computer. A digital glove can also be utilized to perform selection operations using non-digital objects when pressure data generated by one or more of the pressure sensors in the digital glove indicates that pressure was exerted at a finger of the digital glove in excess of a threshold value.