Table Extraction With Infinite Scrolling In UiPath - Full Tutorial

This full video tutorial shows how to extract tables from web pages with infinite scrolling in UiPath Studio. First, you learn how to use the Table Extraction wizard in UiPath while we work on an actual use case. Later in the use case, we do data filtering with the Filter Data Table activity and LINQ.
VIDEOS FOR YOU:
🔹 Complete UiPath Course: • Playlist
🔹 My RPA Developer Salary: • My RPA Developer Salar...
👨‍👩‍👧‍👦 Discord: / discord
- Join my network with 3100+ RPA Developers, where we solve RPA problems, network, and help each other upgrade our careers. It's free!
FOLLOW ME:
💼 LinkedIn: / andersjensenorg
📸 Instagram: / andersjensenorg
👨 Facebook: / andersjensenorg
🐦 Twitter: / andersjensenorg
💌 Email Newsletter: andersjensen.org/email-newsle...
MY MONITOR (Amazon affiliate):
🖥️ Samsung 49-inch CRG9 Curved Monitor = geni.us/MDpejc
- If you are buying this, I can recommend the Mi Monitor Light Bar = geni.us/3Wwad
0:00 Intro
Today we're building a real-time UiPath use case from scratch. We want to extract structured data, and our problem is that it's a web page with scrolling.
9:44 Handle Mouse Scrolling In Data Extraction
Before we can extract data, we need to ensure we're scrolled down the web page. Then, using the Mouse Scroll and Do While activities in UiPath, we compare the results and keep scrolling until we're at the bottom of the page. The best practice is always to ensure we validate the data before we extract the data.
27:06 The Table Extraction Wizard In UiPath
The table extraction wizard is easy to use. First, find the structured data you want to scrape. Then, you can even extract the URL. Finally, you can rename the headers to make the automation and output easier to interpret.
34:42 Save The Scraped Results To Excel
We use a variable for storing the folder path. This is handy if the path change or we're using the path several times in the UiPath workflow. To ensure we don't overwrite the Excel results, we create a dynamic file name using the .NET time format.
46:56 Filter Data In UiPath
The Filter Data Table activity in UiPath helps us define the data table rows we want to keep. Finally, we use LINQ to filter and sort data. LINQ is a powerful query language we use a lot in UiPath.
#uipath #rpa #roboticprocessautomation

[@andersjensenorg]

Thank you again for your support 🙌🔥 LIKE AND SUBSCRIBE IF YOU ENJOYED! Find all the lessons here: kzbin.info/aero/PLXXz88_TPiHrsQDDFImamh94ULuGF9G3b

[@vinayawasthi9241]

Hi Anders, Greetings from India, don't have words to expresses how thankful I am of your videos on modern design, reframework and other topics on UiPath. I am your subscriber and have one query: Is it possible to create a video on a web automation workflow with reframe work (linear process - No queues involved), considering that workflow is divided into multiple invoke workflow files (at least 2). Request to also include exception handling and trigger a mail on every business or system exception which could possibly occurs in anyone of the 2 invoke workflow files. Will be waiting for you reply and help on this matter. Regards Vinay

[@JonathonTan]

this video was extremely helpful, you are the best bro, thanks

[@andersjensenorg]

Hey Jonathon, I'm so glad to hear, thanks a lot 😊 Kind regards, Anders

[@elektromanyetik2296]

Thank you very much Anders, I learnt uipath with you. You are very good,nice teacher 💐🌟

[@andersjensenorg]

I'm so glad to hear, Elektro - thanks 😊🤩🥳

[@thomasgilman3283]

Thanks for this, your videos are great and i'm so glad to add mouse scrolling (to the final entry) to my bag of tricks. Also, I'll need to improve using LINQ due to its performance vs other methods.

[@andersjensenorg]

Hey Thomas, I'm so happy you could use the links 😀 Have a great weekend. Kind regards, Anders

[@juliensanchez-baldeon1566]

great video! Learned a lot.

[@andersjensenorg]

Hey Julien. Thanks a lot 😊 These live videos are less time-consuming and more stressed to create 😅

[@andersjensenorg]

* than "normal" ones

[@sangitaandhale1673]

Hi Anders, Thank you for your video could you please provide us the video on excel data which is has more than 50k rows. When i do table extraction it take only starting 26rows in extraction and to do the mouse scoll it will contain duplicate values.

[@andersjensenorg]

Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 6000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders

[@user-fn4tj9mc9z]

Hi Anders. It's really beneficial for me! I'm blocked by a little obstacle with Window 10. On Window 10 version, Scroll Activity is not compatible. Is there any other way to scroll down the mouse??

[@andersjensenorg]

Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders

[@Beasley1101]

Nice video. Question: How would you retrieve data that required you to "click" on each video? For example, if you wanted to see the number of comments for each video. How would you scrape that data?

[@andersjensenorg]

Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 12,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders

[@berkeakgun8480]

Hello, thank you very much for your information. When I do these operations, I can save 30 pieces of data. But I need to save more data, what should I do?

[@andersjensenorg]

Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 8000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders

[@Vijay_0815]

Nice video... Please provide English subtitles atleast further videos 💐

[@andersjensenorg]

Thanks a lot, Vijay. Do you have trouble understanding me?

[@Vijay_0815]

@@andersjensenorg almost we understand... But we miss some pronounsation, that's why asking. if you provide subtitles we canot miss any single word

[@Vijay_0815]

@@chrprior yes... I saw in same day, that's why I can't find that day. Now I can see subtitles... Any way thank you soo much for your patience 💐

[@akerelegideon6508]

And also for another Scraping, a pop-up comes up during the scrapping, so it affects the amount of information that is scrapped by the bot, And the pop-up doesn't have a specific time it comes up. What do you think i can do Sir? THANKS💜

[@andersjensenorg]

Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders

[@suraj_singh321]

Hii Anders Jensen sir can you make a video on a single cell containing multiple values initials by Hash how can I split those into row by row in uipath and write cell row by row in uipath

[@andersjensenorg]

Hey Suray, unfortunately that's not in the plans, sorry 😒 Kind regards, Anders

[@adelinaonofrei6430]

Hei! Thank you for the video! I have a problem when I open Data Extraction and I press on video title, there's an error and I can't do the process..."Error HRESULT E_FAIL has been returned from a call to a COM component.". Please, do you have any solution for this?

[@andersjensenorg]

Hey Adelina Onofrei Thanks for writing. I'm getting more than 50 questions/comments every day and having difficulty answering everyone (I try my best). I've created my UiPath Groups, where we all can post and solve problems or hang out around our favorite tool, UiPath. So you're very welcome. Get the addresses here: kzbin.info/www/bejne/eWfbnnqcerFjbas Have a great day. Kind regards, Anders

[@SaiGanesh-gh9ew]

Hi Andersjensen is same thing possible in power automate desktop?

[@andersjensenorg]

Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders

[@user-mc8rr6xy7s]

Anders - Could you please develop flow with UiPath 2023-12-0 modern design experience version.

[@andersjensenorg]

Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders

[@suraj_singh321]

Hii Anders Jensen sir can you make a video Tutorial on SQL Database connection using uipath

[@andersjensenorg]

Hey suraj singh Thanks for writing. I'm getting more than 50 questions/comments every day and having difficulty answering everyone (I try my best). I've created my UiPath Groups, where we all can post and solve problems or hang out around our favorite tool, UiPath. So you're very welcome. Get the addresses here: kzbin.info/www/bejne/eWfbnnqcerFjbas Have a great day. Kind regards, Anders

[@suraj_singh321]

Hii Anders Sir can you explain me if a single cell containing Multiple values with # how can I split that and write row by row in uipath

[@andersjensenorg]

I would go with Regex 🙂

[@suraj_singh321]

@@andersjensenorg explain I used system.text.regularexpressions.regex.matches logic than to not possible justify it if possible

[@suraj_singh321]

Can you make a whole tutorial of Excel VBA code And Macros in uipath

[@andersjensenorg]

Hey suraj singh Thanks for writing. I'm getting more than 50 questions/comments every day and having difficulty answering everyone (I try my best). I've created my UiPath Groups, where we all can post and solve problems or hang out around our favorite tool, UiPath. So you're very welcome. Get the addresses here: kzbin.info/www/bejne/eWfbnnqcerFjbas Have a great day. Kind regards, Anders

[@relax_music668]

如何滚动到指定的视频行，例如这个在滚动了三次的页面中，或者五次，这个次数是不确定的，或者如何使用mouse scroll to element

[@andersjensenorg]

Can you speak English please? 😊

[@sidcoolguy7]

I am using a feature of Opera Web Browser on Windows OS called 'My Flow' which lets the user send any message/file/website link to the 'synced' mobile device in real-time via right-click menu or if it is a webpage, then via an arrow symbol at corner of the omni-search bar/address bar. (one may search this feature of Opera browser online) So, using that feature, I want that whenever a particular website updates, the updated pdf file link/links are sent to the 'My Flow' so that I am able to receive the files on the mobile device which is in sync with the PC web-browser. It may happen that multiple links to the pdf files are updated at the same moment and I want that all the updated links are sent to 'My Flow' of the browser. How to do this👆

[@andersjensenorg]

Hey Siddhant Sharma Thanks for writing. I'm getting more than 50 questions/comments every day and having difficulty answering everyone (I try my best). I've created my UiPath Groups, where we all can post and solve problems or hang out around our favorite tool, UiPath. So you're very welcome. Get the addresses here: kzbin.info/www/bejne/eWfbnnqcerFjbas Have a great day. Kind regards, Anders

[@drashtidudhatra84]

Hi ! If data table have multiple page so How can scroll to every page for data extraction. I have solution for only one page as per your explanation but I want scroll next page so please give me the solution?

[@andersjensenorg]

Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 4900+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders

[@davidm3894]

Are there free/open source RPA platforms that are like UIPath?

[@andersjensenorg]

Hey David - check this: kzbin.info/www/bejne/kKqTZZiJed5miKs It's almost UiPath 1-to-1 (except som of the advanced AI features). Totally free 🙂

[@suraj_singh321]

How can we ignore the blank cells empty cells in a row by row in uipath

[@andersjensenorg]

Hey suraj singh Thanks for writing. I'm getting more than 50 questions/comments every day and having difficulty answering everyone (I try my best). I've created my UiPath Groups, where we all can post and solve problems or hang out around our favorite tool, UiPath. So you're very welcome. Get the addresses here: kzbin.info/www/bejne/eWfbnnqcerFjbas Have a great day. Kind regards, Anders

[@eminyilmaz7320]

Hello sir, I click on the title but it gives me this warning."this element type is not eligible for table extraction.Please select elements which are part of a table"

[@andersjensenorg]

Hey emin, then it's not a table and you need to use the Get Text. Check this video: kzbin.info/www/bejne/oWrVZXtrn9CUmKM Kind regards, Anders

[@user-jt9bv9mk6f]

I am not able to extract title its shows empty, But able extract its url.

[@andersjensenorg]

Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 8000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): kzbin.info/www/bejne/roipq2CJbpuLfdE Kind regards, Anders

[@user-qq8ni6pb9i]

Is this fixed ?

[@maymaymagsakay4893]

I followed the steps but keep getting exactly the first 30 items, i dont know what im missing here

[@andersjensenorg]

Hey MayMay Magsakay Thanks for writing. I'm getting more than 50 questions/comments every day and having difficulty answering everyone (I try my best). I've created my UiPath Groups, where we all can post and solve problems or hang out around our favorite tool, UiPath. So you're very welcome. Get the addresses here: kzbin.info/www/bejne/eWfbnnqcerFjbas Have a great day. Kind regards, Anders