SAP SE
Handwritten diagram recognition using deep learning models

Abstract:

Systems, methods, and devices are described herein for handwritten diagram recognition using machine learning. A machine learning component receives a digitally encoded image having a handwritten diagram. The machine learning component localizes and classifies a plurality of objects within the handwritten diagram. A structure recognition component identifies connections between each symbol of the plurality of objects based on content of the respective object. A handwriting recognition component interprets one or more alphanumeric text strings within a portion of the plurality of objects. A digital structured model of the digitally encoded image is automatically generated, without human intervention. The digital structured model has the identified connections among the plurality of objects and is in a computer-readable editable format.