Meta Platforms, Inc.
Message-based device interactions for assistant systems

Abstract:

In one embodiment, a method includes receiving, from a client system via an assistant xbot of a messaging application, a first user input comprising a command for controlling a network-connected device, wherein the device is associated with a contact identifier (ID) in the messaging application, identifying the device based on the contact ID, generating one or more control instructions for the device based on the command, sending, to the device via a network, the control instructions to cause the device to perform one or more actions associated with the command, receiving, from the device via the network, a response to the command, and sending, to the client system via the assistant xbot, an output based on the response from the device. The first user input may include a character string that specifies the command or an indication of a selected user interface feature that corresponds to the command.