Meta Platforms, Inc.
Analyzing screenshots to detect application issues

Abstract:

A client management server manages client devices deployed throughout an enterprise facility that may be used for various applications such as wayfinders and internal and external meeting room computers. The client management receives screenshots from the client devices and applies a classifier to classify an operating state of each device as corresponding to a normal operating state or an error state. If the operating state is classified as corresponding to the error state, a remedial action is triggered. The classifier may be a machine trained model that is trained using supervised or unsupervised learning, including by simulating errors on the clients.