SAP SE
Converting Handwritten Diagrams to Robotic Process Automation Bots

Abstract:

Systems, methods, and computer programmable products are described herein for generating a robotic process automation bot script from a handwritten sketch. A digitally encoded image having a handwritten diagram with objects is received. The handwritten diagram is converted into a digital flowchart having a plurality of nodes. A confidence score is determined for the nodes based on (i) a textual similarity of contents of the node and a plurality of executable bot activities or (ii) a contextual similarity between a set of activities which measures how often they coappear in a plurality of reference bots. A robotic process automation bot script is generated by mapping the plurality of nodes to an executable bot activity of the plurality of executable bot activities based on the confidence score. The robotic process automation bot is then provided to a robotic process automation system for further modeling.