Find the best prices for stuff with Python web scraping

[@Neil4Speed]

Very cool John, tackled this one today and found it pretty interesting! Next level would be alerting whenever there is a drop. Appreciate the video as always.

[@dzeykop]

Thank you for your work and time. I really like your way how you explain code stuff! (and you voice is really pleasant) 👍 Best regards, Joe

[@JohnWatsonRooney]

Thanks Joe 👍

[@emrekyak3901]

Thank you for the very helpful videos, John. May I ask whether you have had any content that you focused on web scraping on such products which have different variants such as size, colour and accordingly changes the Html link too?

[@bencole8301]

Hi John, trying to follow along with this video but getting a 'NoneType' message saying object is not subscriptable on the following line; price = soup.find('span', {'itemprop':"price"})['content'] I've double checked the code so am I using an old library or something else making it difficult to follow along? Thanks for the video sorry for the hassle.

[@JohnWatsonRooney]

Hi Ben - the concepts are still good but unforuantely this particular website has updated and changed making this approach no longer work. This is why you are gettingt the NoneType - the script isnt finding any data available to extract

[@teluguvibhagam5019]

@@JohnWatsonRooney is there any other way? :_(

[@teluguvibhagam5019]

I was rechecking my code multiple times until I saw this message :)

[@KelvinKagwima]

hello sir....if i may ask are you using any proxy?

[@SunDevilThor]

I can’t even start this one since the website has a captcha to just even access it. Getting response code 403, even with the custom headers.

[@JohnWatsonRooney]

Yes it has changed since I uploaded this video. Pick another one and apply the same principles

[@dmackle3849]

@@JohnWatsonRooney any advice on handling cookies etc to ensure the script is accessing the correct geographic store branch?

[@OceanWingsSeafarersEducation]

Hi John i tried this code however it gives me an error code : price = soup.find('span', {'itemprop': 'price'})['content'] Error: price = soup.find('span', {'itemprop': 'price'})['content'] TypeError: 'NoneType' object is not subscriptable

[@lamar4333]

I get the same thing. Still looking for solutions

[@sebastiencarre2416]

try : price = soup.find('span', attrs={'itemprop': 'price'})['content']