Automatic mouse and keyboard summoners how to#

To store a text in the clipboard, highlight the text using either the Send keys or the Send mouse click action. To retrieve text from the screen and store it into a variable, deploy either the clipboard actions or the Extract text with OCR action. To navigate through the web page or application and interact with its components, use the mouse and keyboard actions.įor example, deploy the Send keys action to use the available keyboard shortcuts, or the Move mouse to image and Move mouse to text on screen (OCR) actions to move the cursor to a specific image or text, respectively. Use the Wait action to wait for a set amount of time, the Wait for image action to wait for an image to appear/disappear, or the Wait for text on screen (OCR) action to wait for a text to appear/disappear. If you need to wait for specific components to load before running an action, use the wait group of actions.

In both alternatives described above, the best way to navigate is using mouse clicks and keystrokes which are explained in the actions reference.īefore building your automation, ensure that the appropriate window is focused and maximized using the Focus window and Set window state actions. Information on OCR capabilities can be found in the respective actions reference.

Automatic mouse and keyboard summoners how to#

Read more on how to automate using images in this topic.Ĭonversely, for cases that an image can't be used as a point of reference, consider using the OCR capabilities to navigate through the screen.

Image-based automation can be either recorded by the image-based recorder or developed manually. The image method, captures sections of the screen which are then used as references to perform clicks, send text and mouse clicks. For cases that a user isn’t able to access the UI elements of web or UI applications and thus can’t automate using Browser or UI actions or the recorders, it’s strongly recommended to use alternative methods of automation such as the use of Images or mouse and keyboard.