International Business Machines Corporation
METHOD FOR AUTOMATIC VISUAL ANNOTATION OF RADIOLOGICAL IMAGES FROM PATIENT CLINICAL DATA

Abstract:

Presented herein are methods, systems, devices, and computer-readable media for image annotation for medical procedures. The system operates in a parallel manner. In one flow, the system starts from clinical terms and image and applies image detection module in order to get visual candidates for related radiological finding and provide them with semantic descriptors. In the second (parallel) flow, the system produces a list of prioritized semantic descriptors (with probabilities). The second flow is done by application of a reverse inference algorithm that uses clinical terms and expert clinical knowledge. The results of both flows combined by matching module for detection the best candidate and with limited user input images can be annotated. The clinical terms are extracted from clinical documents by textual analysis.