Web Extraction in Microsoft Power Automate Desktop - Full Tutorial

  Рет қаралды 38,172

Anders Jensen

Anders Jensen

Күн бұрын

In this complete use case, you'll learn how to do advanced web extraction in Microsoft Power Automate Desktop. By the end of this tutorial, you will have a solid understanding of using Power Automate Desktop to build a complete web scraping project.
📂Course materials: andersjensen.org/microsoft-po...
VIDEOS FOR YOU:
🔹 Power Automate Desktop for Beginners: • Power Automate Desktop...
🔹 Power Automate Desktop PDF Extraction and Application Entry: • Power Automate Desktop...
POWER AUTOMATE DESKTOP GROUPS:
👨‍👩‍👧‍👦 Discord: / discord
- Join my network with 6000+ Automation/RPA developers, where we solve Automation/RPA problems, network and help each other upgrade our careers. It's free!
👩🏻‍🎓 LinkedIn: / 12566435
👨🏻‍💻 Facebook: / 754059285247921
FOLLOW ME:
💼 LinkedIn: / andersjensenorg
📸 Instagram: / andersjensenorg
👨 Facebook: / andersjensenorg
🐦 Twitter: / andersjensenorg
💌 Email Newsletter: andersjensen.org/email-newsle...
00:00:00 Intro
Download the course materials. We will create a complete web extraction flow that reads an Excel sheet, web scrape data, and write it back to Excel. Everything is done with Microsoft Power Automate Desktop.
00:02:28 Initialization
We use Regions to structure our flow well. Use variables for things that can change, like the project path or the URL.
00:05:17 Browser Automation
Navigate to the data we want to extract with a Launch new Microsoft Edge action, a Set drop-down list value on web page action, and a Populate text field on web page action.
00:09:42 Web Extraction
Web scraping is straightforward in Power Automate Desktop. We can automatically extract web data by drag'n'drop and clicking.
00:15:53 Excel and DataTables
We work with DataTables in Power Automate Desktop since it's faster than doing it directly in Excel.
00:24:02 Dynamic File Naming
We use the current date and time for dynamic file naming.
00:26:58 Regular Expression on the Extraction
Regular Expression is a series of characters that defines a search pattern. Next, we'll use Regular Expressions, RegEx, to extract specific data, e.g., remove unwanted text from the extraction.
00:35:58 Extract URL from Search Results
With CSS selector work we extract the URL from the search results with Power Automate Desktop
00:44:48 Extract Multiple Topics
We want to do multiple web searches and extract each search result into a separate Excel sheet.
00:54:00 Extract Multiple Pages
Each search has its results on multiple pages. Therefore, our Power Automate Desktop flow must move to each page and extract the data.
01:05:59 Merge Two DataTables
We cant join two DataTables directly in Power Automate Desktop. So instead, we'll create a workaround with a loop to merge the DataTables.
#powerautomate #powerplatform #microsoft365

Пікірлер: 137
@andersjensenorg
@andersjensenorg Жыл бұрын
Thanks for all your likes and support 🙌🔥 Watch this video next: kzbin.info/www/bejne/rmbPaIKtbNhogtE
@user-jg5dx4pk8x
@user-jg5dx4pk8x 4 ай бұрын
Thank You so much sir, can you do a tutorial to extract all reviews of a product in amazon
@user-jg5dx4pk8x
@user-jg5dx4pk8x 4 ай бұрын
Is it possible, plz replt😐😑
@PubgSpeed-wl8yo
@PubgSpeed-wl8yo 4 ай бұрын
div > div > div > div > span > div > div:eq(1) > span:eq(0) > a > div > h2 > span > span > span div > div > span > div > div:eq(1) > span:eq(0) > a > div > h2 > span > span > span div > div > span > div > div > span:eq(0) > a > div > h2 > span > span > span div > div > div > div > span > div > div > span:eq(0) > a > div > h2 > span > span > span div > div > div > div > span > div > div > div:eq(1) > div:eq(1) > h2 > a > span I get five duplicate headers in amazon and can't do anything about it, each of them where there is a signature (Sponsore) is added to a separate header. In other categories the output is different and the situation is quite different, you showed in the tutorials the simplest output when it is displayed by list You can do your homework where it's hard, not where it's easy - Amazon varies from category to category. In other categories, the situation is different
@shaunrowley7230
@shaunrowley7230 Жыл бұрын
This was an excellent lesson took me 6 hours to complete with rewinding back to ensure that i had got it right but has enhanced my knowledge of RPA and PAD as it combined webscraping, Excel, variables/datatables, CSS Selectors and RegEx all into one project - thanks again 👍👏
@andersjensenorg
@andersjensenorg Жыл бұрын
Hey Shaun. Thanks a ton! 🙌😎 I like your attention to details. Have a great day . Kind regards, Anders
@carlosaguilarc
@carlosaguilarc Жыл бұрын
WOW! Thank you so much, Anders! I had the exact same problem extracting the URL behind a text from a webpage my company uses in the aquisitions department! I learned how to navigate the selectors route like you did with so many DIV and other elements.
@andersjensenorg
@andersjensenorg Жыл бұрын
Hey Carlos - thanks a lot for letting me know, highly appreciated 😀 Have a great day. Kind regards, Anders
@MM-un7wg
@MM-un7wg Жыл бұрын
Fantastic video! Great demonstration
@andersjensenorg
@andersjensenorg Жыл бұрын
My pleasure, MM - kind regards, Anders
@ALVINMAN452
@ALVINMAN452 8 ай бұрын
Another excellent video for learning. Great quality. Thanks
@andersjensenorg
@andersjensenorg 8 ай бұрын
I'm so happy to hear, Alvin, thanks a lot 💯🙂
@d3.finance
@d3.finance 7 ай бұрын
Really enjoying you channel Anders. Thank you
@andersjensenorg
@andersjensenorg 7 ай бұрын
I'm so glad to hear, thank you 👍😊 Kind regards, Anders
@hostile_technics
@hostile_technics 8 ай бұрын
Love your tutorials. Thank you for the great content
@andersjensenorg
@andersjensenorg 8 ай бұрын
I love your comments, thank you so much 😍 Kind regards, Anders
@PitakYT
@PitakYT 11 ай бұрын
Thank you so much, Anders! This is great training video. 😆
@andersjensenorg
@andersjensenorg 11 ай бұрын
Hey Pitak, I'm so glad you could use it 🙌😊 Kind regards, Anders
@Mohsin.Siddique
@Mohsin.Siddique 10 ай бұрын
Tried this, thanks alot for such a detailed video ❤
@andersjensenorg
@andersjensenorg 6 ай бұрын
My pleasure, thanks for the nice comment 🥰 Kind regards, Anders
@Pedrohd3280
@Pedrohd3280 Жыл бұрын
Mr Anders Jensen, excellent teachings. like this guaranteed. Thank you so much for the lesson.
@andersjensenorg
@andersjensenorg Жыл бұрын
Hey Pedro. Thank you so much 🥳😊💪
@RavikumarKondala-mk4ij
@RavikumarKondala-mk4ij Ай бұрын
This is a very detailed training video. Thanks a lot for your efforts
@andersjensenorg
@andersjensenorg Ай бұрын
I'm so glad to hear, thanks a lot 🙌
@pianosathornlak
@pianosathornlak Ай бұрын
Thanks!
@andersjensenorg
@andersjensenorg Ай бұрын
Wow, you really don't have to - THANK YOU! Kind regards, Anders
@ryanlebear
@ryanlebear 5 ай бұрын
This is helping me get up to speed with PA, I think I'm ready to tackle pulling in products to my store from the wholesalers site now. I just need to figure out how to drill down into each product page and retrieve more data. Veyr helpful, I hope you do more on web scraping this is so useful. Thanks!
@andersjensenorg
@andersjensenorg 5 ай бұрын
Hey @ryanlebear. Thanks a lot 😊 Have a great day. You're more than welcome at my Discord, where we're 11,000+ RPA developers networking and solving problems: kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@PubgSpeed-wl8yo
@PubgSpeed-wl8yo 4 ай бұрын
@@andersjensenorg Did the video you were asked about above show up?
@lss1022
@lss1022 7 ай бұрын
It's good to know how to get the next button by using css selector. Get data from one datatable to another is a good one as well. Thank you for the video.
@andersjensenorg
@andersjensenorg 7 ай бұрын
My pleasure, happy you could use it 😍
@grzegorz2852
@grzegorz2852 Жыл бұрын
another great, and super useful tutorial
@andersjensenorg
@andersjensenorg Жыл бұрын
Thanks a lot 🙌🙏😎
@PaweW-td3wt
@PaweW-td3wt Жыл бұрын
Great job as usual! Thank you for sharing your invaluable knowledge with us. Based on your instructions, I did some web scraping from another website, and it wasn't as easy as scraping from Amazon. This website provides different results for the same search term 2 out of 10 times, showing sponsored ads (for the searched product) and other content at the top of the search results that cannot be automatically detected. I implemented a solution where I tried to read various elements that appear during the search. I'm not sure if it's the right approach, but I managed to get the results into an Excel file. Additionally, I added a short VBA code that converts "http ..." to clickable links.
@andersjensenorg
@andersjensenorg Жыл бұрын
Hey PawelW, wow great job 💪 Based on what you did, I'm sure you didn't needed the video 😀 Thanks a lot for reporting back, appreciated. Kind regards, Anders
@sbisca
@sbisca 4 ай бұрын
Great, thanks so much for the lesson. Like guaranteed !
@andersjensenorg
@andersjensenorg 4 ай бұрын
Thanks a lot for all the support 😊🙌
@nandansubramanya
@nandansubramanya Жыл бұрын
Thanks a lot for putting in time to do it. I learnt a lot of new things on PAD. I was surprised that put did not use pager on "Extract Data From Webpage", then when I tried it, I could not get it to work... so I understand why you did it. In 38:52 , if you right click "The Smartest Way to Learn Python Regex: Learn the Best-Kept Productivity Secret of Code Masters" and click inspect , it will take you to the exact SPAN/. Otherwise clicking the little box-arrow icon on the top left of the "Developer tools section, and clicking "The Smartest Way to Learn Python Regex: Learn the Best-Kept Productivity Secret of Code Masters" will take one to the HTML code. I find this the fastest way to get to it.
@andersjensenorg
@andersjensenorg Жыл бұрын
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 8000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@wmferreira
@wmferreira 10 ай бұрын
Amazing solutions on paginations 👏👏👏tks
@andersjensenorg
@andersjensenorg 6 ай бұрын
You're very welcome, @wmferreira - your support helps me a lot 😍 You're more than welcome at my Discord, where we're 11,000+ RPA developers networking and solving problems: kzbin.info/www/bejne/roipq2CJbpuLfdE
@craigduran7508
@craigduran7508 15 күн бұрын
Thank you Anders. This is an EXTRAODINARY video. It seems daunting but I am going to try to duplicate your training.
@andersjensenorg
@andersjensenorg 22 сағат бұрын
Hey Craig, THANKS A LOT 😍😍😍 Go for it, we can all do it 😊 Kind regards, Anders
@happy9955
@happy9955 Жыл бұрын
very nice
@andersjensenorg
@andersjensenorg Жыл бұрын
Thanks a lot, happy99. It's my most extensive web extraction/scraping video to date. Have a great day. Kind regards, Anders
@garylhaas2005
@garylhaas2005 Ай бұрын
you are awesome
@andersjensenorg
@andersjensenorg 27 күн бұрын
Thank you very much 😊🙌 Kind regards, Anders
@andreeapalici3970
@andreeapalici3970 Жыл бұрын
Hi Anders. Great tutorial, I learned a lot. The only thing I don't understand is why you didn't use 'Set element as pager' for the Next button in the 'Extract data from web page' action. It would have been very simple, as simple as a right click, instead of a complicated loop.
@andersjensenorg
@andersjensenorg Жыл бұрын
Hey Andreea, thanks a ton. The reason is that the "Set element as pager", doesn't work (or at least haven't worked for the past 2 years - I haven't tested it the last months though). Another one is that we can set the number of pages to extract, since it will take all pages. Kind regards, Anders
@theprofessor4487
@theprofessor4487 11 ай бұрын
100% Subscribing! Anders, I love the way you teach! I have viewed hundreds of hours of KZbin videos and reviewed documentation on Power Automate and Power Automate Desktop and everyone wants you to follow along, yet no one really explains WHY they are doing what they are doing. The result is, I find myself copying but not able to create flows on my own, until now. I am now able to build flows without copying from videos even though I still refer to videos from time to time. I have run into a problem extracting data from a webpage where the data on the site does not have the header or span but shows Table Data Cell (outlined in red). I can click the cell and click Select Element as Text but it does not populate the Live Web Helper Window Extraction Preview Window. Any Suggestions?
@andersjensenorg
@andersjensenorg 6 ай бұрын
Thanks a lot, @theprofessor4487 🤗 Your feedback helps me immensely. You're more than welcome at my Discord, where we're 11,000+ RPA developers networking and solving problems: kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@rockero160
@rockero160 3 ай бұрын
Hi! Great vid! What would you recommend for a web with multiples pages. The web automatically refreshes every 5 or 6 minutes. How do I continue from the last one?
@andersjensenorg
@andersjensenorg 3 ай бұрын
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@jeremynorbury
@jeremynorbury 7 ай бұрын
Very good - learnt a lot. I have a question - how would you deal with an advertisement pop-up?
@andersjensenorg
@andersjensenorg 7 ай бұрын
Hey Jeremy, thanks a lot. First of all, can I be sure it's always there? If not I need to create a check for it and then, if it exists, click to close it. Kind regards, Anders
@Kaigozen
@Kaigozen Жыл бұрын
ah yess lets watch this
@andersjensenorg
@andersjensenorg Жыл бұрын
Thank you, please let me know, what you think afterward 👍😀
@Kaigozen
@Kaigozen Жыл бұрын
@@andersjensenorg yes, thank you. I completed my project. it took in 2 weeks to understand how PAD words.
@abrar1111000
@abrar1111000 Жыл бұрын
Thanks Anders for the great tutorial. but i have one question. if there is no webpage number & Page is load only when scroll down. in that case how to extract multiple pages.
@andersjensenorg
@andersjensenorg 11 ай бұрын
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 8000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@TheMKTube
@TheMKTube 7 ай бұрын
Looks like an excellent video. I need to go a page deeper, for example, clicking on each product and extracting some details from the product page, and then clicking back to go back to all products, and then clicking on the next product, then clicking next page at the end and repeat. Couldn’t find a video like that on KZbin! Any suggestions?
@andersjensenorg
@andersjensenorg 7 ай бұрын
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 10,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@user-oo4yn2xm7l
@user-oo4yn2xm7l 5 ай бұрын
Thank you for a very comphrensive video. I'm working on my own version of this where I'm looping through a list of search terms - not using known dropdown items, I'm checking if the term exits in a news source page. I get an error message when the search term can not be found. What's the best way to program a "For Loop" that skips if an error is found or a term cannot be found?
@andersjensenorg
@andersjensenorg 4 ай бұрын
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@omuyamiracle3339
@omuyamiracle3339 Жыл бұрын
Thanks so much Ader, I followed your video step by step by I got stucked when i need to do the extraction, when i selected the Ist title as span and right click and hover the extract option, the mouse doesnt bring up the option to select text... Pls, what is can be done
@andersjensenorg
@andersjensenorg Жыл бұрын
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 8000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@nikcommerce
@nikcommerce 9 ай бұрын
hi anders.thank you for awesome tutorial.i have a question about scraping data on website.when i gathering data from website i saw this warning[[extraction preview displays only the first 20 items of the list]] but in each page i have more than 20 items.Why the others items didnt save on excell??
@andersjensenorg
@andersjensenorg 8 ай бұрын
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 10,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@marcogutierrez9339
@marcogutierrez9339 Жыл бұрын
Excellent tutorial, quick question, can you show us how to extract data from hover mouse action. This means if I move the mouse over an specific word, the webpage will show me the meaning, and I want to capture that information. Thank you
@andersjensenorg
@andersjensenorg Жыл бұрын
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 6000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@SandroMochiaro
@SandroMochiaro 6 ай бұрын
Hello Anders, your videos are great, congratulations! Is it possible to generate the affiliate link automatically, save it in Excel, and update the Geniuslink database? This complete tutorial would be greatly appreciated.
@andersjensenorg
@andersjensenorg 6 ай бұрын
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@ianpayling956
@ianpayling956 11 ай бұрын
Hi Anders Thanks for everything and your videos are a great source thank you I have one problem that you may be able to answer I have looked at most of your tutorials and cannot find how I could get what I am after? As an example you collect the URL for the individual products but what if I wanted to follow these links and collect further detail in addition to what we have already collected from the product that is not on the brief description especially if the link brings up a pop up window? Thanks again for all your help
@andersjensenorg
@andersjensenorg 11 ай бұрын
Thanks a lot 😊 Sure, check this: kzbin.info4zmviNtOFwA?feature=share Kind regards, Anders
@ianpayling956
@ianpayling956 11 ай бұрын
@@andersjensenorg Hi Anders this is great and just what I was looking for, I will use this as a guide for my own project much appreciated keep up the good work 👍
@ianpayling956
@ianpayling956 11 ай бұрын
@@andersjensenorg DONE!! fantastic you are a legend thank you so much it worked !!
@user-jg5dx4pk8x
@user-jg5dx4pk8x 4 ай бұрын
Thank You so much sir, can you do a tutorial to extract all reviews of a product in amazon
@andersjensenorg
@andersjensenorg 4 ай бұрын
My pleasure, sure, I do it with Google reviews here: kzbin.info/www/bejne/pGKygImljteteaM Kind regards, Anders
@zubairhumsafar
@zubairhumsafar 5 ай бұрын
Great work... Quick question what if I need all images downloaded nothing else. How to achieve that?
@andersjensenorg
@andersjensenorg 5 ай бұрын
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@m.salmanrahmat7712
@m.salmanrahmat7712 10 ай бұрын
LOVE FROM PAKISTAN
@andersjensenorg
@andersjensenorg 6 ай бұрын
Thanks a bunch, @m.salmanrahmat7712 🤩 I've created a Discord. We're more than 11,000+ RPA developers networking and solving problems here: kzbin.info/www/bejne/roipq2CJbpuLfdE You're more than welcome. Kind regards, Anders
@loopylee30
@loopylee30 4 ай бұрын
This is a great video and i followed everything step by step to the end getting correct results right up until the last part where we are supposed to be scraping the first 3 pages of results for each product. But when i run my final one, I am getting the 4 tabs added to the excel spreadsheet correctly but it seems to only be displaying the 3rd page of results for each product, i.e. it displays only 17 lines of entries for each product, and they seem to all be from page 3 of the results. Any clues on what i have done wrong please?
@andersjensenorg
@andersjensenorg 4 ай бұрын
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@mahmoudibrahim6061
@mahmoudibrahim6061 Жыл бұрын
Absolutely amazing training video, thanks Anders, I got from 0 to 100% in no time, one question i have though since i already implemented on a project of my own my scenario let's say is only one product so i applied exactly the same steps except from calling products name from the excel sheet, the challenge i have is after running the robot i get all the data correctly in the Base result but only last page appears in the excel sheet extracted any idea what could be done wrong?
@andersjensenorg
@andersjensenorg Жыл бұрын
Thanks for writing and the nice feedback 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 7000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@mahmoudibrahim6061
@mahmoudibrahim6061 Жыл бұрын
@@andersjensenorg Thanks a lot, definitely will join All the best!
@MonteBStJohns
@MonteBStJohns 9 ай бұрын
First off - great video and as usual better explanation on what/why you're doing stuff. When I test the RegEx code [ ]+ in RegEx 101 online to replace CR & LF with just CR it works, but when I add it using your RegEx technique in my Extract Data from Web for the appropriate CSS selector - the results return nothing. Any thoughts?
@andersjensenorg
@andersjensenorg 8 ай бұрын
Hey Monte, Thanks a lot 🙂 Can you try regexstorm (google it) instead? Kind regards, Anders
@mrmalone2222
@mrmalone2222 5 ай бұрын
Thank you for this tutorial. I have one question... It seems that the amazon algorithm changed (or I have a wrong setting) which shows all the results in grid view and the scrape is not working. Depending on the book searched it may come up with the list view and the scrape does work. Is there a way to make it work for grid view?
@andersjensenorg
@andersjensenorg 5 ай бұрын
Did you pick Books in the drop-down? 😊
@mrmalone2222
@mrmalone2222 5 ай бұрын
@@andersjensenorg Yes... about three weeks ago it was running perfect, and I remember seeing the results as list view. But now all results are in grid mode. It seems as they changed the way the results are displayed, and hence our method of scraping.
@andersjensenorg
@andersjensenorg 5 ай бұрын
@@mrmalone2222 I've just tested again, and nothing changed (still 16 rows and x columns). You're more than welcome to post the problem at my Discord. It's 100% free and the link is in the video description. Kind regards, Anders
@mrmalone2222
@mrmalone2222 5 ай бұрын
@@andersjensenorg I'll check it again on my side. Thanks for the reply and all the help on these tutorials.
@leonorsaianda4240
@leonorsaianda4240 Жыл бұрын
Excellent Tutorial! But im having trouble with the loop! Cause when it reaches the end it doesnt go to the label even though i put in the error to go to the label! It gets stuck in the loop!
@andersjensenorg
@andersjensenorg Жыл бұрын
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 7000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@nareshkumar-qo9qy
@nareshkumar-qo9qy Жыл бұрын
in previous version of pad when i put "-1" in css selector it directly clicks last link but after updating pad to latest version it shows "-1" as error. What to do for directly clicking the last link whithout clicking the before links
@andersjensenorg
@andersjensenorg Жыл бұрын
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 6000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@user-mfsc-2024
@user-mfsc-2024 7 ай бұрын
could i use a loop to extract all books of the same page instead of pick up each element of each book manually ?
@andersjensenorg
@andersjensenorg 7 ай бұрын
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 10,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@zubairhumsafar
@zubairhumsafar 5 ай бұрын
Quick question, when I select extract data from the web. It detects the pattern of half entries but only extracts 12 entries there are 24 entries on the page. Any quick solution please?
@andersjensenorg
@andersjensenorg 5 ай бұрын
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@hiteshhonmane
@hiteshhonmane Жыл бұрын
I have a question - How can I automate The file Upload like music file or videos on any platform like youtube or on any website ? How to select and upload it? can please guide me ?
@andersjensenorg
@andersjensenorg Жыл бұрын
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 6000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@virupakshakulkarni5904
@virupakshakulkarni5904 11 ай бұрын
Hi Anders, While I was going through this tutorial video in step extract data from web page the data which we are reading fields like cost and reviews from the web page the data is not getting extracted and is giving blank for most of the time. But the issue is very intermittent. Sometime it works and sometime it doesn't.. is there any solution to check why we are facing this issue??. Please suggest.. thanks 😊
@andersjensenorg
@andersjensenorg 10 ай бұрын
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 9000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@donald7862003
@donald7862003 3 ай бұрын
Does anyone know how to click on the details of each scrape what's inside and add that information as well?
@andersjensenorg
@andersjensenorg 3 ай бұрын
Hey Donald, please check this: kzbin.info4zmviNtOFwA Kind regards, Anders
@shenewtpsyman
@shenewtpsyman 15 күн бұрын
I have found a web page which seems to be protected from web extraction. When you hold ctrl to select what you want to extract, the red boxes disappear and the click just visits the link. Any ideas for to get around this?
@andersjensenorg
@andersjensenorg 15 күн бұрын
Are you using the Extract data from web page? Then right click and extract text 😊 Kind regards, Anders
@031-madhu3
@031-madhu3 Жыл бұрын
i don`t have search icon in web page i need it to take "enter" as command to automatically search for item how to automate it
@andersjensenorg
@andersjensenorg Жыл бұрын
You can use the "Send keys" action (find the enter in Misc). You might have to go into the Populate text field on web page just before - Advanced - untick the Unfocus.... That will work. Kind regards, Anders
@yannademcissoko5048
@yannademcissoko5048 28 күн бұрын
thx i follow your course , but they are not files in the files link
@andersjensenorg
@andersjensenorg 27 күн бұрын
Hey Yanna, I've just checked and I can find the files through the link, can you please try again? 😊 Kind regards, Anders
@pROaBDUR
@pROaBDUR Жыл бұрын
10:45 the drop down menu for extract element data doesn't work... please help
@andersjensenorg
@andersjensenorg 11 ай бұрын
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 8000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@user-mz4bg6hu7d
@user-mz4bg6hu7d 6 ай бұрын
I hope you're doing well. I've been working through the "Web Extraction in Microsoft Power Automate Desktop" tutorial. However, I've encountered an issue. During the training phase, the Amazon website appears vertically, but when I test the bot, it opens the website horizontally, resulting in an error. Could you please create a video to help resolve this?
@andersjensenorg
@andersjensenorg 6 ай бұрын
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 10,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@shenewtpsyman
@shenewtpsyman 24 күн бұрын
This was awesome except on the page I tried it on, next button thing didnt work. The next button becomes greyed out on the last page but the flow doesnt error and just continues through the loop over and over. Any ideas for a alternative way of doing this?
@andersjensenorg
@andersjensenorg 22 күн бұрын
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 12,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@shenewtpsyman
@shenewtpsyman 22 күн бұрын
I found a way around this. I got the number of pages from the "Page x or 20" message and messed with the string to get the number of pages. Then just looped this many times.
@vigneshvangala2235
@vigneshvangala2235 10 ай бұрын
How to get table of anchor tags urls in power automate desktop
@andersjensenorg
@andersjensenorg 10 ай бұрын
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 9000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@huyfe1347
@huyfe1347 Жыл бұрын
thank you for this video. You didn't click on the title of each book to scrap details regarding each book. Can you complete this video on showing me how to do this? It should be taken into acount that when we make the book search today, the list of books we will find today may be diffferent of the ones we can find tomorrow or other days.
@andersjensenorg
@andersjensenorg Жыл бұрын
Thanks a lot, I do it here: kzbin.info4zmviNtOFwA 🙂
@user-ib2bo1nr8n
@user-ib2bo1nr8n Жыл бұрын
Great tutorial but i am still stragling to take what i want, lets say that i have several pages of links and i want to scrape the same things from each link (structured)and the several pages(structured too) offcourse and in 1 case those pages are opening in a new tab. And in an other one case the element i want is after 1 click in the same page
@andersjensenorg
@andersjensenorg Жыл бұрын
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 8000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@peteharrison3241
@peteharrison3241 7 ай бұрын
I realise this is quite an old tutorial, but I hope questions are still answered. I have a webpage with television seasons, episodes and precise of the episode. The Seasons are split via UL/LI lists for each season if I select the Season H4, then the next season h4, I get a list of all the seasons in the extract from webpage popup - great. However, if I then select the episode title, the list breaks and all I see is season 1 season 2 and the first episode title. So I tried just selecting the episode titles, but then I only get the first season as they are split. Can I get Season 1 episode 1 title episode 1 description episode 2 title episode 2 description etc etc Season 2 episode 1 title episode 1 description episode 2 title episode 2 description etc etc or Season 1 episode 1 title episode 1 description Season 1 episode 2 title episode 2 description etc Season 2 episode 1 title episode 1 description Season 2 episode 2 title episode 2 description etc I cant find out how to get the data from the page where the lists are separate
@andersjensenorg
@andersjensenorg 7 ай бұрын
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 10,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@oluwafemihunsu6200
@oluwafemihunsu6200 Жыл бұрын
What if my website doesn't have a drop down to select a value
@andersjensenorg
@andersjensenorg Жыл бұрын
Then you skip that step 😊
@dj1480
@dj1480 6 ай бұрын
Today, all of my Amazon search results are displayed as Tiles instead of as a list. As a result the Extract data from web page does not return all the items, it only returns one row with the first book. I can't find any option or method on Amazon to force it to display a List, consistently 😖😖!! This is my life as a coder ... Maybe I'll get a different result tomorrow !
@andersjensenorg
@andersjensenorg 6 ай бұрын
Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 10,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders
@cavittosun1487
@cavittosun1487 Жыл бұрын
Pagination is way more complicated compared to Uipath
@andersjensenorg
@andersjensenorg Жыл бұрын
I agree. There is a Next page in the Advance Settings of Extract data from web page, but unfortunately it's not stable 😔
@cavittosun1487
@cavittosun1487 Жыл бұрын
@@andersjensenorg Very helpful tutorial though! Thank you
@andersjensenorg
@andersjensenorg Жыл бұрын
My pleasure 🙂
I CAN’T BELIEVE I LOST 😱
00:46
Topper Guild
Рет қаралды 100 МЛН
That's how money comes into our family
00:14
Mamasoboliha
Рет қаралды 8 МЛН
ИРИНА КАЙРАТОВНА - АЙДАХАР (БЕКА) [MV]
02:51
ГОСТ ENTERTAINMENT
Рет қаралды 13 МЛН
Smart Sigma Kid #funny #sigma #comedy
00:25
CRAZY GREAPA
Рет қаралды 15 МЛН
Simple maintenance. #leddisplay #ledscreen #ledwall #ledmodule #ledinstallation
0:19
LED Screen Factory-EagerLED
Рет қаралды 25 МЛН
Собери ПК и Получи 10,000₽
1:00
build monsters
Рет қаралды 2,3 МЛН