Web Scraping with BeautifulSoup and CSS Selectors

[@martin-xq7te]

Your videos are brilliant. Just one more to add to your list. Thank you

[@tnssajivasudevan1601]

One more great example of knowledge sharing. Great Sir. Pls keep going 🙏

[@__wouks__]

Always something interesting to learn and I have learned quite a lot from your videos. Just a note that with results.append(productinfo) you could have changed it to results.extend(productinfo) and then you wouldn't need to do the itertools.chain operation.

[@andriikorniienko]

this video desires a million views, thank you sir

[@wangdanny178]

Hey John. Every bit of John per day. I just ecounter some problems but I re-visited the first one on whisky. It is solved. Thank you very much. I will try my best to watch every vid you have and keep up your weekly updates. Many thanks.

[@alessandroceccarelli6889]

Great material! Thank you

[@mylordlucifer]

Great Job, from your learning i am become strong Thanks ,

[@JuckReis]

Really nice, thanks !

[@infocloudbiz4954]

Thank you for this video .Its very clear explanation. Expecting detail video for web scarping jobs search.

[@samman5980]

I agree CSS selectors are better to use. Not only are they easier, they're also more robust.

[@ehtishamulhaq5391]

one of my favourite teachers

[@brhnkh]

thanks a lot! this was very helpful

[@tonynelson8267]

Loved it

[@vladimirantonov4506]

Thanks a lot! Very interesting and informative!! :))

[@paulmiller591]

Great stuff John Cheers!

[@JohnWatsonRooney]

Thanks Paul!

[@nurlansalkinbayev3890]

Thanks for your code, sir.

[@tonynelson8267]

Great video

[@mushinart]

Great content, lived the way you used irtloos

[@abdulwali4920]

thanku so much

[@tonynelson8267]

Nice video!

[@tubelessHuma]

Nice and Tidy 🙂 👍

[@saloni.kataria]

Very useful

[@donaldandmijung]

thank you this tutorial! do you have a video parsing data out of a table using css selectors?

[@tonynelson8267]

Subscribed

[@imrushB]

Hey, great video! Could you explain how to make datacenter proxies in a server? Using a provider

[@ed_badilla]

Hi John, I was wondering is it possible to use "sort & filters" with bs4 before getting the data?? for example I just want to get items from specific country or specific price range... thanks

[@violence1371]

How can I select different css selectors from different webs?

[@mrsfunny669]

Hi how to export scraping result to markdown format (hugo) ? Thanks

[@apk1970]

Any chance of a video comparing web scrapers and parsers for speed and reliability, threading and non-threading? Think it would be a good one coming from a master with recommendations, pros and cons. I'm looking for a reliable and speedy system for js websites but one page at a time after building one based on your videos using bs and selenium. Not sure if it's fast enough compared to others.

[@alemazzuca]

Can you add concurrents to this scraper in order to make it faster.?

[@prod.kashkari3075]

Also do a video on scheduling web scrapers with Apache airflow

[@jb6395]

Is there a way to scrape, within seconds, the latest update of an item without having to repeatedly request over and over every 1 second?

[@saloni.kataria]

Do you have any video on how to scrape from multiple websites and can we scrape from an entire website rather than a particular category? Thanks

[@werjds4924]

Do question and answer session soon

[@grahamfeeley9944]

Is it possible to get the code ?

[@huzaifaameer8223]

hi there! can you use Regular expressions in scraping content like name, price, sku etc...

[@robertbalazsi]

Great videos, John! I'd be curious about your take on CSS Selectors vs XPath. That is, which one would you recommend over the other in certain scenarios.

[@JohnWatsonRooney]

I really only tend to use CSS selectors, mainly because I’m more proficient with them!

[@violence1371]

@@JohnWatsonRooney Is there any performance difference between them?

[@100daychallange5]

@@JohnWatsonRooney I need to write one generic script that can web scripting from 3 different sites. How i can do it?

[@saeeahmed5213]

the terminal is showing no result?? ples help

[@carsonlin313]

What theme do you use for vscode it look so good

[@JohnWatsonRooney]

Gruvbox Material dark - search for it, it’s in the extensions on vs code!

[@mrjt6404]

Hey Whats the VS code color theme/ File Icon theme you use

[@mrjt6404]

Gruvbox Material

[@mrjt6404]

or Remedy

[@JohnWatsonRooney]

Gruvbox Material by sainnhe!

[@mrjt6404]

@@JohnWatsonRooney Thanks

[@preetkochar]

Hello John, Thank you for making such wonderful videos. I got a question though What do you in case of URLs like this www.cisco.com/c/en/us/support/docs/csa/cisco-sa-sdwan-dosmulti-48jJuEUP.html The field Cisco Bug IDs: and CVE IDs only show up if you click on 'More' is there a way to do these without using selenium to interact with More ? Here is the base URL www.cisco.com/c/en/us/support/routers/sd-wan/products-security-advisories-list.html The intent is to parse the common information amongst all these vulnerabilities into an excel sheet. Thanks

[@prod.kashkari3075]

U could just use the extend() function which appends the elements from the list to another without adding the whole entire list.

[@tbaum9]

Or just result = result + product

[@Time2paw]

@@tbaum9 extend() do same but optimized by c and more faster

[@stephenmuyayi55]

I don't know why the main function always fails me, someone assist

[@codingspy6440]

i make a site & run it on local host port 3000 & i fetch the data of this site through url and stored in DB. After that i changed some tags info of my site that i have been run on local host & fetch the data through url again. now i compare these two contents and i want to show the difference only between the two contents

[@codingspy6440]

Please help me out this problem

[@iamshiva003]

Hello bro I need some help with Amazon product scraping Please

[@Suresh_Solution]

Bro, can you upload pubmed database webscraping

[@KhalilYasser]

Thank you very much. I always enjoy your videos. Can you share the code, please?

[@paulmiller591]

He added it on his Patreon subscription

[@KhalilYasser]

@@paulmiller591 Thanks a lot. But this needs a subscription !!

[@paulmiller591]

@@KhalilYasser I am not sure if you are across the economics of KZbin it makes very little money to the vloggers despite the significant effort to make a video. John's videos have saved me a huge amount of time and money so I am happy to pay something for it. A subscription could be a one-off if you don't see the ongoing value.

[@nurlansalkinbayev3890]

I beg your pardon.

[@rafael_tg]

results.extend(productinfo)

[@JohnWatsonRooney]

Yes good tip thank you

[@tonynelson8267]

Nice video!