A Better Web Scraper - 3 Steps Demo Python Web Scraping

[@Neil4Speed]

Hey John, thank you for sharing - your skills are really appreciated and has given some inspiration to me.. I have never coded in my life and I have been able to follow along your scripts and instructions! Can't wait for more videos!!

[@JohnWatsonRooney]

Thank you Neil! Always nice to hear

[@engineerbaaniya4846]

Awesome work best KZbin channel for understanding scraping

[@shacharbard1613]

Kudos mate, you're awesome. i'm learning from each one of your videos. you definitely should create a Udemy course or something. would also be great if you could do live sessions with Q&A

[@victormaia4192]

Thanks for the methods! I usually fell satisfied when I run the codes once, but when I have to revisit it sometimes I get lost reading the codes, will try to put it in action.

[@nurlansalkinbayev3890]

Hello John. Nice to meet you. Very informativ AND helpfull video. Thanks for your code.

[@JohnWatsonRooney]

You are very welcome

[@Kumar-lb8zg]

thanks for the info and well explained you gained a new sub

[@skellybrownston3641]

Amazing content Sir.

[@JohnWatsonRooney]

So nice of you

[@Neil4Speed]

Hey John, Quick one for you... do you think you could do a tutorial which shows the error handling for non-existant pages?

[@JohnWatsonRooney]

Yes good idea - I am working on a more detailed explanation on each step and I could definitely cover error handling

[@phantomsixtrading7094]

Could you use something like this as the foundation for setting up an email alert when a sold-out item comes back in stock?

[@JohnWatsonRooney]

Yes absolutely!

[@phantomsixtrading7094]

@@JohnWatsonRooney I'm trying to use 'in_stock = product.get("availability")' so that I can make an 'if statement' in a 'while loop' to monitor the product and then generate the email. However, I cannot seem to make that line work and create a variable from the dictionary result. Do you have a paypal or something so I can tip you for your time? I really appreciate your time and help, sir.

[@phantomsixtrading7094]

The website has changed the structure to 'li' class now and I cannot get your program to work the same with 'li' vs 'div' - please help

[@phantomsixtrading7094]

Got it - had to change 'item' to 'tag' in conjunction with the 'li'

[@madhuj2479]

Thank you. How to work with aspx sites n dropdown pagination

[@gitgosc7075]

great, thanks a lot John!

[@antonioja5912]

Thanks for the videos. You're the Best teaching about scraping in YT... Would u make a vídeo about export all the data to API or something? Thnx I really think that you love alcohol xD..

[@fbzz64]

Very useful video, ty 4 sharing.. new sub.

[@harshgupta-ds2cw]

Can you build a web scraper to scrape ott platforms? Please

[@celerystalk390]

Yes to functions. DRY: don't repeat yourself.

[@JohnWatsonRooney]

Absolutely!

[@hafizkurniawan3899]

Sir, what mean -i

[@JohnWatsonRooney]

I for interactive- we can test our functions in vs code terminal when we run “python -i pythonfile.py”

[@edcoughlan5742]

👊👊👊

[@JohnWatsonRooney]

👍

[@niteshkanojia5982]

how to scraoe woocommmerce websites with one script

[@garynash9957]

KOOL !

[@David-mj9st]

Hi John,I decide to learn all you tutorial on this channel.Nearly 2 years have past, there are some changes in this web.I use {item.find('h2').text.strip()}to get name, because apearing at both head and tail.Use {item.find('span', class_='price').text} to get the price.Before these, I use {soup.find_all('li', class_='product')} to get the block of each product,I was a bit worried about geting unnecessary infomation for 'product' is so common,fortunatly it work well. I also got problem when run 3step.py(it's my file's name) in terminal,and changed name to step.py.I use pycharm in windows10, i guess int couldn't be put at the begining of a .py file in windows10. I also need to improve my English😂.I am in lockdown in china for covid, at least 10days can't get out the comunity. Maybe its a chance to learn more. Best wishes for you!