Web Scraping with Selenium | Python Programming | Automation - Tutorial

[@SATSifaction]

Thanks and be sure to like and subscribe. Check out my video on building a bot with selenium 👉🏽 kzbin.info/www/bejne/lZzXqZusnZKMr80

[@johnnylademakhi2204]

Perfect tutorial. Love the fact your share the source code on github

[@DomMarrone5]

Super helpful.. exactly what I needed to get across the finish line. Thank you!

[@SATSifaction]

You’re welcome

[@laithbhais]

Very nice. I'm looking for such content. Thank you

[@sumant9189]

Only best in the web Thanks a million

[@SATSifaction]

My pleasure

[@sumant9189]

@@SATSifaction hi, Could you please help me with how could I acces when multiple values with same "div" class name.. Like: m1 m2 How could I access m1, m2? Thanks.

[@paulohsgoes1959]

Excelent job. You've just got a new subscriber!

[@PrinceKumar-kr5ig]

Amazing....!!!!!

[@SATSifaction]

Thank you

[@kunited9]

Great explanation & code thank you

[@dnetvaggos4443]

thank you for your awesome tutorial well done !!! actually i was looking to work with a little bit with pandas framework and you did it :D

[@husseinbanjak3805]

Great explanation, thanks a lot! Would you please make a video to show how to avoid being blocked when scraping known websites like Amazon, ebay....

[@SATSifaction]

The best way to avoid this is by using a vpn/proxy service. Here is a good option: NordVPN 👉 bit.ly/2W87je0

[@davidrobles3377]

when scraping data can I go more deeper in details? for example in this book website could I go inside each book and get more specific data?

[@happychuckprogramming6048]

good tutorial. well done.

[@SATSifaction]

Glad you enjoyed it

[@petcon29]

Thank you for the video! Which scraping method do you prefer from the 3 you used in your videos, and why? Which one would you recommend to a casual user (not a programmer)?

[@SATSifaction]

As a casual user I would consider using beautifulsoup. Scrapy and Selenium would have specific use cases and could be more complex

[@androidtester33]

Hey, are there any tools to execute a javascript function (which is part of the website I am scraping) via my scraping code? By firefox console I am able to execute these functions but how can I do this by my own code?

[@sumant9189]

hi, Could you please help me with how could I acces when multiple values with same "div" class name.. Like: m1 m2 How could I access m1, m2?

[@kanavsingl28]

Can yuo make video on how to run this selenium web scraping on cloud such as aws or gcp

[@danishmallick920]

Hi I am trying to scrape the page www.yellowpages.ca/search/si/1/Restaurants/Toronto+ON but i keep receiving the error next = driver.find_elements_by_css_selector('div.view_more_section_noScroll a')[0].click() IndexError: list index out of range Please help

[@tomashoracek8475]

Why are there [0] in the end of "find_elements.... " in loop?

[@kiran59345]

next = browser.find_elements_by_css_selector('div.cobalt-Button--ghost.cobalt-Button--standalone a')[0].click() IndexError: list index out of range help me

[@Kaptanadb]

how if the website that i want to scrape the data required username and password, i do have that username and password, and it required captcha to enter. could you please send me the video link tutorial of that kind of scrape? thanks

[@SATSifaction]

Usernames and passwords can be accomplished using selenium or you can use session cookies to login and then use beautifulsoup to scrape. Capcha is very hard to bypass. I haven’t tried it yet but perhaps I will at some point

[@NoName-lq7kt]

bro how do all these people have terminals with sublime text why omfg how about make a video on that

[@vivek4991]

I keep getting an error - WebElement is not iterable.

[@androidtester33]

Hey, are there any tools to execute a javascript function (which is part of the website I am scraping) via my scraping code? By firefox console I am able to execute these functions but how can I do this by my own code?