Beautiful Soup 4 Tutorial #2 - Searching and Filtering

[@basman7620]

Great tutorial. text is now string in 2024, eg: tags = doc.find_all(["option"], string="Undergraduate")

[@igordc16]

Thanks Tim for your effort in bring to us all your tutorial videos. They are helping me a lot.

[@binaprajapati7709]

Happy teachers day Tim! One of the greatest teachers ever on KZbin On the way to become the G.O.A.T.

[@TechWithTim]

thank you so much!

[@pacman804]

@@TechWithTim you're a legend Tim. Love from Africa

[@Ghostly_Music]

What is the GOAT

[@jimstand]

@@Ghostly_Music Greatest Of All Time

[@redaabakhti768]

thanks a lot tim your tutorials really make a difference

[@SaurabhKumar-gj2xr]

Happy teacher's day Tim sir🎉🎉

[@Roknok]

Happy teachers' day Tim

[@arjix8738]

Nice video tim! I would suggest teaching about the .select() method, it uses css selectors and its easier than .find_all (ofc it has a .select_one for finding a single element)

[@Melker490]

Hi i agree it is more easy to use but i have a question, how do i select one tag if its multiple tags of same. Please help.

[@arjix8738]

@@Melker490 .select_one("...") Or .select("....")[0]

[@Melker490]

@@arjix8738 Page Title Information1 Information2 Information3 This is a paragraph. Soup.select_one("body h1") Please can you tell how to select information2.

[@ejoeditz6746]

Nice ...👍👍 Happy Teachers day Tim...

[@lennertsaerens2593]

Good soup.

[@nakamiakprossy7675]

Wow thats great thanks Tim for your time

[@benlong1062]

This was a great one, Thanks!

[@jamiluyahaya3018]

Amazing and talented tutor

[@DotcomWorld]

Your more than a brother big ups great stuffs

[@unpatel1]

Thank you for this nice video.

[@FedoraRose]

Could you make a video on how to WebScrape behind a login?

[@nontth5355]

Did you by any chance know that I'll be learning this in my next class and make this video for me? Thx!!

[@terryr5713]

Coding is very hard, I don't understand a single thing and in 2 years I'm going to finish school

[@Genaaa916]

Don't worry about it, it'll take more than 2 years to feel like you know something.

[@hollowr9953]

Nice video, as always

[@TechWithTim]

Appreciate that

[@alejandrocarmonaligeon]

Awsome video, it is helping me a lot

[@xxvoltage_9031]

Bro thank you for this series

[@namename-cl8kk]

More soup gud stuff

[@Kornchipzzz]

Amazing. Thanks!

[@MostafaAhmed-qh9ip]

THANKS 💟💟💟

[@techfunny114]

Nice

[@omerfarukbulut9295]

That is outstanding tutorial. Also can you make a tutorial about how to make webscraping on dynamic websites.

[@FoxInTheBasement]

Chatgpt was very helpful writing a scraper using Selenium and beautiful soup. As long as your linux environment is up to date you should be off to the races using the literal thousands of tutorials.

[@rahimalg]

@@FoxInTheBasement did you mean gpt -4 .

[@ScottRachelson777]

How would you filter a table with a specific "class" that also has a specific "caption" such as "caption" = Tropical cyclones in January 2020? I can filter the table by class, but I'm not sure how to also filter that class so that it is the table with the specific "caption" I want.

[@almaghror1]

Thanks

[@ehtisham_hashmi]

how error are indicated at the specific line in red at 11:09 , do u use someking of plugin?

[@landsfadern2]

Cool vid

[@WaelMaghrabi]

what about tag attributes include '-', ex: product-id = '90'

[@טוביהשיינפלד]

HEY is it possible to get html elements with click events?

[@mdraisulislamrimon9808]

if you find any resources, share it here, please, thanks.

[@JaveGeddes]

Does any one know how to change a reoccurring phrase in the results? The page I'm scraping lists "- source" for everything, and I can't get rid of it.

[@icecreamman520]

Quick question at about 8:45 in the video. Does python recognize plurals of variables? I'm wondering how it recognized 'tag' and separated the multiple tags out. I just tried it with 'tags' and it worked as well. Just kind of weird.

[@_isDev]

it doesn't. tag in the for loop is an index and can be named whatever you want (tag, tags, tagssss, TAGS, TAG, marico_el_que_lo_lea)

[@rekhasurya3536]

First!! Love your vids btw tim!!

[@TechWithTim]

Love your comments!!

[@abrahamamodu1181]

Looking for through text is not working for me? Please what do I do

[@vegaarcturus509]

I wonder where can this be use, in what field?

[@ReadInfo9737]

❤️

[@NewsChannel-y4g]

it would have been nice if the ['placeholder'] was shown in the html must have missed it seems to be done off screen.

[@franzmeier4472]

How can I filter by whether or not a tag has an attribute and not by specific values for attributes? Right now the only thing I can think of is to basically specify the attribute I want to include (let's say 'title') and then go: soup.find_all('a', title=re.compile([\w\W]*)) but that seems hacky as shit.

[@imranullah7355]

Sir I get empty list from soup.find_all("div",class_="some class"), although there are some children of this class What can be the reason?

[@tomasoon]

Same problem here.

[@rtshadfhab7125]

I find it better to just drop bs4 and focus on list comprehension, starting at a full string level, splitting by newline, slicing out tags, joining, then splitting by space, then splitting by ‘=‘ to build key value pairs for maps based on the tag and tag index. Sometimes I use a for loop that has switches for characters such as ‘

[@mdraisulislamrimon9808]

Error/Warning: DeprecationWarning: The 'text' argument to find()-type methods is deprecated. tags = doc.find_all(text=re.compile('\$.*')) Solution: Use 'string' instead. tags = doc.find_all(string=re.compile('\$.*'))

[@aryansharma7514]

how to find the value of an attribute?

[@nakamiakprossy7675]

one request please can you make tutorials for regex

[@andresj89]

I see many first and second comments 😂

[@amir3515]

Twelfth

[@amir3515]

@Amir What a weird word

[@ayush.kumar.13907]

where is the soup, man?

[@NewsChannel-y4g]

He ate it.

[@akhileshkumarmishra3650]

3rd

[@Tech_Wala_Friend]

2nd comment

[@natyacodes]

tim will pin this

[@nixer8605]

second hahha

[@Shivesh4]

FIrst

[@osamanajjar1934]

Forth :D