The Boeing Company
Intelligent video analysis

Abstract:

An apparatus is provided. The apparatus receives a video feed and processes the video feed in real-time as the video feed is received. The apparatus performs object detection and recognition on the video feed to detect and classify objects therein, performs activity recognition to detect and classify activities of at least some of the objects, and outputs classified objects and classified activities in the video feed. The apparatus generates natural language text that describes the video feed, produces a semantic network, and stores the video feed, classified objects and classified activities, natural language text, and semantic network in a knowledge base. The apparatus generates a graphical user interface (GUI) configured to enable queries of the knowledge base, and presentation of selections of the video feed, classified objects and classified activities, natural language text, and semantic network.