eBay Inc.
Lip-Reading Session Triggering Events

Abstract:

Techniques for lip-reading session triggering events are described. A computing device is equipped with lip-reading capability that enables the device to "read the lips" (i.e., facial features) of a user. The computing device determines when a triggering event occurs to automatically cause the computing device to switch from one input type to a lip-reading session. Lip-reading is also used in conjunction with other types of inputs to improve accuracy of the input. Machine learning is used to personalize the lip-reading capability of the computing device for a particular user.