Automate collecting tabular data from web page and insert into excel file - Selenium UI flow (RPA)

[@pavansrikarnarayan6392]

Reza, Thanks a lot I have been exploring on the UI flows for a long time and happy to see this kind of explanation .

[@RezaDorrani]

Thank you

[@qman1274]

Thank you so much for this. This was invaluable. I got around the double quotes issue by using Store instead of execute script. I was able to get to the jsonVal variable in the instant flow just the same. But still, this video was perfect!

[@RezaDorrani]

Very happy to know you got this to work. Great work. Its been a while now and UI flows has made a lot of progress since. The new Power Automate Desktop is now in preview and provides a lot more capabilities with a lot more intuitive interface.

[@ashu49]

Absolutely Brilliant....."Walk the Talk" kind of stuff.Thank you for this.

[@RezaDorrani]

Thank you Ankesh

[@khadimali9755]

Awesome tutorial. Hats off for you, Reza.

[@RezaDorrani]

Thank you

[@Lethal83]

Hi @Reza. This video was invaluable for me. Nearly covered off everything I needed to do. Great video!!!

[@RezaDorrani]

Glad it was helpful!

[@talsdaddy]

Reza, this is an awesome video. Thank you very much.

[@RezaDorrani]

Glad you liked it! This definitely is one of my most watched videos :)

[@kevinekikuvuidi5114]

Hi Reza, Thanks for the link you had sent me the other time, in any case it helped me a lot, and from this link I got many suggestions for the desktop flow, which I have been following this last time. The question I still can't find the answer to, if you can get the explanations: For unattended desktop flow execution that is triggered with a scheduled cloud flow, will this flow execute correctly if the target machine is turned off? Thanks in advance.

[@RezaDorrani]

I did respond to this same comment :) Machine will need to be ON.

[@jameshenryhinton]

Brilliant! So useful - thank you Reza!

[@RezaDorrani]

Thank you

[@gayathridrawpathy7694]

Thank you so much Reza.Very informative.

[@RezaDorrani]

Your welcome

[@1in1x10n6]

Hi Resa, thank you for your work. Thi shas helped me as a hobbyist. How do you keep your JSON clean if the scraped data contains a " ?

[@RezaDorrani]

That would have to be done in the flow calling the RPA flow. You can use expressions to manipulate the data obtained. To learn flow expressions: aka.ms/learnexpressions

[@ravichandrababu9133]

Great Demo Sir! ...thumbs up

[@RezaDorrani]

Thank you Sir 🙏

[@williammarchek9078]

This is brilliant!

[@RezaDorrani]

Thank you William

[@rajasekar5069]

Awesome bro

[@RezaDorrani]

Thank you

[@pashupatimishra9335]

Great video 👌.

[@RezaDorrani]

Thank you

[@saqibshaikh3411]

Awesome! I want to know is there any way we can read cells one by one from an excel file and extract data for that particular text from the webpage? I m trying to work on my mini project but stuck.

[@RezaDorrani]

Check Power Automate Desktop Tool. It has a lot of possibilities.

[@javier_ilde]

Reza, you are a star!! Thanks a lot for the video. I am not a technical person but I am trying to do my best thanks to you videos. May I ask you a doubt I have? I am in trouble when a field captured with your method, contains a single quote. For instance, O'Grady. It fails. Any guess? Not sure if there is any way "replace" that character in Selenium for Flow. Thanks a lot in advance.

[@RezaDorrani]

I have not tried with a special character. Is error at in flow or selenium? In flow you can run expressions to manipulate the strings

[@javier_ilde]

Wow! Thanks for your quick response. I refer to Selenium IDE, at your Step 53, executing the script where you join strings on ${JsonVal}. If a variable include a single comma, send a single error "Test ended with 1 error". It is because the text captured from a tabular table contains a comma. For instance: O'Grady , Microsoft's. That comma is killing me :(

[@pashupatimishra9335]

Just have a question,how can we achieve queue processing in PowerAutomate,like other RPA tools, where we work on a case in multiple stages. Like multiple flows working on 1 case in sequence.

[@RezaDorrani]

If multiple RPA requests are sent at the same time, they automatically queue up. Only 1 RPA will run on a server at 1 time. You can also setup load balancing using data gateway to have requests run on multiple servers.

[@pashupatimishra9335]

Thank you 😊

[@maxi88564]

Hi Resa, your video is very useful. Thanks a lot! Now is possible to use “ in the execute script command?. I would like to generate the JSON object inside a while loop and at the end of the process save the JSON object into a variable with the Store Json command

[@RezaDorrani]

Possible. I have done this video long back so it would be tough for me to go back to this and try out the changes :) Power Automate Desktop is the new tool that one should be using for RPA in Power Platform. I would recommend to give that a try.

[@Suryaprakashgadi]

Hi@Reeza your videos are wonderful and worth can we read data from excel and insert into selenium ide what is the connector for that. Which command we use in selenium ide. Thanks in advance Surya

[@RezaDorrani]

Here is the list of selenium ide commands www.selenium.dev/selenium-ide/docs/en/introduction/faq

[@ChrisDCowin]

If your table doesn't have an ID, but has a class, use css=table.[class name] in the target field.

[@RezaDorrani]

Yes. As long as you can parse the DOM and get to your element. Typically I try to grab the id of a parent element to the table (if no id for table) and then use xpath to drill down to the table

[@pranithamaddi6054]

Hi I am a beginner and just started exploring on creating the PVA (chatbots) I don't see the option to create UI flow? May I know how to get that option?

[@RezaDorrani]

UI flows are now rebranded as Desktop flows. Check kzbin.info/www/bejne/sGKcdHSNppangZo

[@MrSunni10]

Hi Reza....can you please add video on how to open a webpage with login info and then select parameter an then save the output to csv file. Thank you

[@RezaDorrani]

I will add this request to my backlog. I would need a lot more requests on this topic to give it a higher priority though :)

[@MrSunni10]

@@RezaDorrani Thank you Reza.

[@Theworldofeverything_67]

Sir,what if the table has fixed number of columns and rows forever,will the process become simple?

[@RezaDorrani]

Yes. your formulas would be more simple.

[@nakulmandhre3897]

Can we do this to copy data from LinkedIn sales navigator to excel?

[@RezaDorrani]

Yes, possible.

[@MauriDR5]

it there a way to get the same result in power automate desktop without using Selenium IDE?

[@RezaDorrani]

This is surely possible with PAD. I do not have a video on that though.

[@lavanyareddy246]

we are unable to open this la fitness link which you show in this video will you please provide the link.ASP

[@RezaDorrani]

Hi Lavanya, The LA fitness link was just given as an example. Currently, due to COVID LA Ftiness schedules are not posted and the link is not accessible.

[@cmac6877]

I always get a flowsessions error when I try to run

[@RezaDorrani]

Ensure you have the latest version of the UI flows installed.

[@selwynvanrooyen9432]

Why do i not see UI flows (preview) ?

[@RezaDorrani]

They have been renamed to desktop flows and there is a new tool called Power Automate Desktop that should be leveraged.

[@sampadamirashi9557]

Can you please provide LA Fitness URL

[@RezaDorrani]

-Hi Sampada, LA Fitness is currently closed due to COVID hence the class schedules have been taken down. Here is the link lafitness.com/pages/classscheduleprintversion.aspx?clubid=322 This video is just a simple demo on how you can fetch tabular data from any web page.-

[@tiagosantos4679]

you can escape by \"

[@RezaDorrani]

Correct

[@yinxiaopeng]

Can you confirme escape work? I have used escape but the issue still persists.

[@yinxiaopeng]

@@RezaDorrani if quote is in the variable, execute script will through an error. Do you have any good idea/workaround? Much appreciated.

[@yinxiaopeng]

@@RezaDorrani one question, why use execute script rather than store? i found this may be easier and can eliminate the quote issue.

[@Riskninjaz]

Why not just use power query?

[@RezaDorrani]

To scrape a web page?

[@Riskninjaz]

Reza Dorrani yea

[@madamaczone]

I'm Mac user, and Power Query isn't available for Excel, that could work for Mac users. I have a doubt this software aren't free right? They need a subscription plan?

[@selwynvanrooyen9432]

Can you schedule a reload with power query?

[@Riskninjaz]

@@selwynvanrooyen9432 just update source file dude. PQ does all the heavy lifting from there