Lockheed Martin Corporation
Interactive mixed masking system, method and computer program product for a simulator

Abstract:

A system comprising a device including a chromakeyed tactile touch-sensitive surface (TTSS) and touch-sensitive input (TSI) circuit to sense touch applied to the TTSS by a hand. A processor registers a location of a chromakey mask, the device, and a virtual portal location within a virtual reality (VR) scene including virtual pixels of virtual user-interactive simulator (VUIS) controls. The processor detects and isolates, within the mask, first pixels having a non-chromakey color overlapping the chromakey mask and second pixels matching a color of the chromakey mask. The first pixels are preserved to form a pass-through image. A composite mixed reality scene is formed with the VR scene and preserved pixels registered to the VR scene. Those VUIS controls corresponding to the preserved pixels are omitted from the VR scene and remaining virtual pixels of the VUIS controls overlap and link to the TSI circuit.