Wipro Limited
Method and system for controlling an internet of things device using multi-modal gesture commands

Abstract:

A method and system are described for controlling an Internet of Things (IoT) device using multi-modal gesture commands. The method includes receiving one or more multi-modal gesture commands comprising at least one of one or more personalized gesture commands and one or more personalized voice commands of a user. The method includes detecting one or more multi-modal gesture commands using at least one of a gesture grammar database and a voice grammar database. The method includes determining one or more control parameters and IoT device status information associated with a plurality of IoT devices in response to the detection. The method includes identifying IoT device that user intends to control from plurality of IoT devices based on user requirement, IoT device status information, and line of sight information associated with user. The method includes controlling identified IoT device based on one or more control parameters and IoT device status information.