Inspector

Inspector is a window displayed in the ELMA RPA recording mode that helps you save time when automating a process. Inspector allows you to view the actions recorded in the current session and manage the recording process. The Inspector window is displayed in the lower right corner of the screen and is pinned on top of all windows. The window consists of three sections.

inspector-1

  1. The window name containing the current element search method.
    Hover over the process-recording-2 icon to view the hotkey to call the radial menu (Ctrl+Alt+Q) in the recording mode. There is a button for collapsing/expanding the window to the right of its name.
  2. The list of actions recorded by a user (the last three). It also displays the activity name with the current search method and a screenshot of the captured interface element. Click the 9 button to delete the last action.
  3. The process recording control panel:

process-recording-3simulate a click without actually performing the click action when recording the process. It is used to record actions without opening forms and clicking on elements. For example, you need to record how to click the button to close the document. However, you don’t want to close it while recording. To do this, left click and hold the process-recording-3 icon, hover the cursor over the interface element and release the button;

14 — end the recording of the current session and save the process in ELMA RPA Designer. After clicking the button, a pop-up window will appear. Click Ok to confirm saving;

pause-1 — temporary pause the process recording. After clicking the button, the red frame changes its color to gray, and the caption "REC" in the top left corner changes to "PAUSE". To return to the recording mode, click the  button in the Inspector window;

change-method — change the element search method (Native or Vision);

13 — end the recording session of the current process without saving.

Element search methods

When modeling a process, you can interact with different programs. However, not all the programs provide system data about the item you want to click or read. For example, a website or a program can be designed in a way that it is impossible to extract any labels or features when recognizing them. It is usually due to the implementation technology. For example, an RDP client only shows a screen image of the virtual machine we are connected to but does not transmit the information of open windows, elements, etc.

For these purposes, there are three element search methods used in the ELMA RPA that differ in interaction approach: Native, Vision, and Internet.

  1. Native is a search method that extracts system information about the object of interaction — certain signs that help identify the element among other similar ones.
    native search method
  2. Vision is a search method used when Native method cannot extract object features. The object image is saved, and with the help of computer vision algorithms, the required object is determined among the entire working area.
    vision search method 2     vision search method
  3. Internet is a search method used for exact recognition of the web elements. This method is available only when the ELMA Web Recognizer extension is installed. It is set automatically when working with browsers.

начало внимание

Computer vision algorithms do not simply compare the required image with the specified one. These algorithms include methods that help classify the object of interaction, which increases the system operating speed.

конец внимание

Found a typo? Highlight the text, press ctrl + enter and notify us