UiPath Inc.
GRAPHICAL ELEMENT DETECTION USING A COMBINATION OF USER INTERFACE DESCRIPTOR ATTRIBUTES FROM TWO OR MORE GRAPHICAL ELEMENT DETECTION TECHNIQUES

Abstract:

Graphical element detection using a combination of user interface (UI) descriptor attributes from two or more graphical element detection techniques is disclosed. UI descriptors may be used to compare attributes for a given UI descriptor with attributes of UI elements found at runtime in the UI. At runtime, the attributes for the UI elements found in the UI can be searched for matches with attributes for a respective RPA workflow activity, and if an exact match or a match within a matching threshold is found, the UI element may be identified and interacted with accordingly.