UI Automation in Power Automate for Desktop (Full Tutorial)

Рет қаралды 25,380

Күн бұрын

This video tutorial shows how to do UI Automation in Power Automate for Desktop. Using drag-n-drop and no code, it's easy to click buttons, fill in text, and extract data from the applications. The advanced part of the tutorial demonstrates how to create dynamic selectors.
COURSE MATERIALS:
📂 andersjensen.org/microsoft-po...
VIDEOS FOR YOU:
🔹 Power Automate for Desktop Tutorial: • Power Automate Desktop...
🔹 Power Automate Cloud Beginners Guide: • Microsoft Power Automa...
👨‍👩‍👧‍👦 Discord: / discord
- Join my network with 2800+ RPA Developers, where we solve RPA problems, network, and help each other upgrade our careers. It's free!
FOLLOW ME:
💼 LinkedIn: / andersjensenorg
📸 Instagram: / andersjensenorg
👨 Facebook: / andersjensenorg
🐦 Twitter: / andersjensenorg
💌 Email Newsletter: andersjensen.org/email-newsle...
MY MONITOR (Amazon affiliate):
🖥️ Samsung 49-inch CRG9 Curved Monitor = geni.us/MDpejc
- If you are buying this, I can recommend the Mi Monitor Light Bar = geni.us/3Wwad
0:00 Intro
1:37 Open Application in Power Automate for Desktop
The Run application action needs to be used to open an application in Power Automate for desktop. First, fill in the Application path.
2:17 Close Application
Use the Terminate process action to close all instances of an application.
5:25 Click UI element in window
To click a button in an application the Click UI element in window action is used. Find the button in your application and press Ctrl + the left mouse button. It's best practice to rename the UI elements to make the process easier to maintain and update.
6:26 Create a Dynamic Selector
Dynamic selectors are very powerful, as they allow us to move away from a static solution. We use a variable in the selector.
10:58 Extract data from window
The Extract data from a window is used to extract data from a window. Create a UI element, and the result will be stored in a variable.
12:48 Get subtext
Use the Get subtext action to manipulate text and get a part of the text. Remember that the character position is zero-indexed.
#office365 #powerautomate #microsoft

Пікірлер: 67

@andersjensenorg 2 жыл бұрын

Is this video helping you? 😊 You can help me a lot, by then giving it a thumbs up 👍 Thank you. Kind regards, Anders

@ayushmoudgil9345 2 жыл бұрын

Will definitely check it out

@andersjensenorg 2 жыл бұрын

Thanks a lot 🙋‍♂️🙏

@engineerjunaid5029 7 ай бұрын

Brilliant teacher Brilliant method Thanks for such amazing tutorials

@brucekleine1775 Жыл бұрын

Thank you Anders for your step by step tutorial. Very helpful!

@andersjensenorg Жыл бұрын

You're very welcome, Bruce Kleine - your support helps me a lot 😍 You're more than welcome at my Discord, where we're 5000+ RPA developers networking and solving problems: kzfaq.info/get/bejne/rr12rZCEnpy8d6M.html

@dpwood44 Жыл бұрын

Quick and easy! Really enjoyed this one.

@andersjensenorg Жыл бұрын

Hey dpwood44, I'm so happy to hear, thanks a lot 🙌🙂

@ASO-xh5vu 2 жыл бұрын

New subscriber. You are the only person who takes educating people in this software seriously. The is absolutely no serious content about this that is consistent. Please make more content about Power Automate. Thank you so much Anders!

@andersjensenorg 2 жыл бұрын

Hey ASO, wauw what a nice comment - thanks a lot 😊 I will definitely creat a lot of Power Automate for desktop content within the next weeks. Have a great day. Kind regards, Anders

@ASO-xh5vu 2 жыл бұрын

@@andersjensenorg You are welcome Anders. Seriously the comment is sincere. Especially desktop. There is a huge gap. As a learner I found it hard to learn the software until I found your videos. It's impossible someone doesn't understand the tools that you are explaining. So there is also the educator skill there... You are the best. Cheers,

@craignorton8678 Жыл бұрын

Another great video from Anders.👍

@andersjensenorg Жыл бұрын

You're very welcome, Craig Norton - your support helps me a lot 😍 You're more than welcome at my Discord, where we're 5000+ RPA developers networking and solving problems: kzfaq.info/get/bejne/rr12rZCEnpy8d6M.html

@grzegorz2852 2 жыл бұрын

another great video! Thanks man!

@andersjensenorg 2 жыл бұрын

Thanks a ton, Grzegorz 🤩 Have a great day. Kind regards, Anders

@lakshmitalwar3401 Жыл бұрын

Very useful. Explained very well.

@andersjensenorg Жыл бұрын

Thanks a ton, lakshmi talwar 🤩 Have a great day. Kind regards, Anders

@ALVINMAN452 8 ай бұрын

Very good Quality. Great Video. Thank you.

@andersjensenorg 8 ай бұрын

Thank you so much, Alvin 🤩🙋‍♂️

@PitakYT Жыл бұрын

Thank you so much. Great Video!

@andersjensenorg Жыл бұрын

Thanks a lot, Pitak N 🤗 Your feedback helps me immensely. Kind regards, Anders

@markjudeestrera Жыл бұрын

Thank you Anders new subscriber. Very concise and well explained.

@andersjensenorg Жыл бұрын

Hey Mark. I'm so happy to hear - thanks a lot for the nice words. Kind regards, Anders

@LapaConsult_Ex_Macraris 2 жыл бұрын

Thank You! this video help consolidating basis of UI

@andersjensenorg 2 жыл бұрын

Thanks a lot, Macrais. All you nice viewers being active here in the comments helps my channel a lot 😊 Have a great day. Kind regards, Anders

@maurovmorais 2 жыл бұрын

Thanks Anders!!!

@andersjensenorg 2 жыл бұрын

Thanks a lot, Mauro 🤗 Your feedback helps me immensely. Kind regards, Anders

@sazzarello 4 ай бұрын

Excellent Video! I have spent alot of time developing my Excel Power Query skills with Leila Gharani, but I wanted to see what this Power Automate can do or me. I have followed along to a number of your KZfaq videos and am very satisfied with your ability to teach these concepts. TY for sharing! You are the number one in this area on KZfaq.

@andersjensenorg 4 ай бұрын

Thank you so much for the nice words. When you're done with these videos, I recommend learning the best practices from this video. It's a complete project, that teaches you everything, step-by-step 😊 Kind regards, Anders

@ahmed462462 Жыл бұрын

Very helpful 💪💪💪💪💪

@andersjensenorg Жыл бұрын

Thanks a bunch, Ahmed! 🥳

@thepragmatic6383 2 жыл бұрын

You are very professional as an educator, Very well explained. It's sad that the module (UI Automation) isn't free for home users. But I can use these same functions with an AutoHotkey script. It's just a little more complex, but much more powerful. Allows you to navigate and control the functions of third-party applications by switching from one to another.

@andersjensenorg Жыл бұрын

Thanks a lot, The Pragmatic 🤩🤗

@ayushmoudgil9345 2 жыл бұрын

This might potentially change my future as I am looking to switch careers, and by following you I hope i can make it happen!!!

@andersjensenorg 2 жыл бұрын

Hey Ayush. Thanks a lot - there will be more videos this week 😊 I can recommend going through them step-by-step and doing all the actions with me instead of just passively watching. You can just rewind or pause the video. It's designed for that. You're welcome at my Discord; the link is in the video's description. Here we're more than 2700 RPA developers helping each other and networking (and it's entirely free). Have a great day. Kind regards, Anders

@alfredpereira9152 Жыл бұрын

Nice teaching

@andersjensenorg Жыл бұрын

Thanks and welcome, Alfred 😊

@DonnieDish Ай бұрын

🎯 Key Takeaways for quick navigation: 00:25 *🎯 Handling Static UI Elements* - Understanding UI elements with static attributes, - Importance of static attribute values in automation. 01:01 *🔄 Transition to Dynamic UI Elements* - Introduction to dynamic UI elements, - Challenges posed by dynamically changing attribute values, - Need for handling dynamic UI elements effectively. 02:04 *🛠️ Strategies for Dynamic UI Element Handling* - Recognizing dynamic web or UI elements, - Adapting CSS/UI selectors for dynamic attributes, - Customizing Controls Repository for dynamic element management. Made with HARPA AI

@andersjensenorg Ай бұрын

Thank you 👍😀

@mbhagyasri88 2 жыл бұрын

Thanks Anders. This is something i wanted to try . Quick ask, can I ope. Word file and update data from excel? With this command

@andersjensenorg 2 жыл бұрын

Thanks a lot, Sudhansu 🙌🙂 Just to get it right do you want to fill in different word docx with excel data? Can you elaborate please. Have a great day. Kind regards, Anders

@mbhagyasri88 2 жыл бұрын

@@andersjensenorg thanks for so quick responding was watching another videos of urd to convert CSV to XLS files. Yes i want to write excel data to word file placed in a folder on desktop or SharePoint

@sridevisatheeshkumar 10 ай бұрын

in windows11,terminate process shows "CalculatorApp"

@andersjensenorg 10 ай бұрын

Thank you 🙂

@trraucer Жыл бұрын

Hi Andres, Is there an option to use "Simulate Click" in Power Automate? (I don't want to lose control of the mouse in the automation)

@andersjensenorg Жыл бұрын

Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 4900+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzfaq.info/get/bejne/rr12rZCEnpy8d6M.html Kind regards, Anders

@adityaprasad6795 3 ай бұрын

Hi I have stucked one of the project using power automation desktop if its possible you can explain one to one

@andersjensenorg 3 ай бұрын

Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzfaq.info/get/bejne/rr12rZCEnpy8d6M.html Kind regards, Anders

@anantchirmade600 Жыл бұрын

I am trying to add an UI element from an app but in that app the element chooser just shows Full Pane as element instead of small element inside the Pane. Due to this I am unable to click on that item specifically. Do you have any idea how to solve this

@andersjensenorg Жыл бұрын

Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 6000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzfaq.info/get/bejne/rr12rZCEnpy8d6M.html Kind regards, Anders

@sudhajgvir4560 Жыл бұрын

How to convert 3columnd into rows by using set variable

@andersjensenorg Жыл бұрын

Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 5800+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzfaq.info/get/bejne/rr12rZCEnpy8d6M.html Kind regards, Anders

@moh-rezahmadi177 11 ай бұрын

Please don't lower your voice tone during your speech. Thank you for your efforts and generousness.

@andersjensenorg 11 ай бұрын

My pleasure. Do you think the volume level is too low? Kind regards, Anders

@arijitmajhi4311 8 ай бұрын

I am not able to close the calculator using the Terminator process

@andersjensenorg 8 ай бұрын

Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 10,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzfaq.info/get/bejne/rr12rZCEnpy8d6M.html Kind regards, Anders

@joshuacammeraat6047 3 ай бұрын

Hi Anders, I’ve got a problem and I don’t know how to fix it. The element ID is different everytime I open my page. So now the ID is “370”, but if I restart the page the values are different. So how could I make this work, so that the ID updates all the time, so it clicks the right button on the page.

@andersjensenorg 3 ай бұрын

@KeinNiemand 3 ай бұрын

Is there anything else that can automate GUI like this (as in without relying on exact pixel coordinate or image recocnition to know where to click)? Power Automate can't be automated in the free version.

@andersjensenorg 3 ай бұрын

What do you mean it can't be automated? 🙂

@i_lost_my_hitpointsdkpd1024 Жыл бұрын

Hey I have a question. Is there a way to do this in the background so people can do something else on the computer at the same time?

@andersjensenorg Жыл бұрын

Hey friend. It depends, if you want to work in the UI (that is, do clicks etc.), then no. You would have to set up a secondary PC, virtual machine etc. You're more than welcome on the I Love Automation Discord for more help on this topic: kzfaq.info/get/bejne/rr12rZCEnpy8d6M.html Kind regards, Anders

@i_lost_my_hitpointsdkpd1024 Жыл бұрын

@@andersjensenorg alright thank you

@nadsgamingliveofficial 2 жыл бұрын

Hello Anders, Saurabh here I have just dropped an email to regarding problem which currently I am facing. Can please check your mail box. Your all videos are helping us can you please find the solution of problem. Thanks.

@andersjensenorg 2 жыл бұрын

Hey Nads. Thanks a lot 😊 I'll reply to the email in 5 minutes. Have a great day. Kind regards, Anders