How do I filter rows of a pandas DataFrame by column value?

Let's say that you only want to display the rows of a DataFrame which have a certain column value. How would you do it? pandas makes it easy, but the notation can be confusing and thus difficult to remember. In this video, I'll work up to the solution step-by-step using regular Python code so that you can truly understand the logic behind pandas filtering notation.
SUBSCRIBE to learn data science with Python:
kzbin.info?su...
JOIN the "Data School Insiders" community and receive exclusive rewards:
/ dataschool
== RESOURCES ==
GitHub repository for the series: github.com/justmarkham/pandas...
"loc" documentation: pandas.pydata.org/pandas-docs/...
== LET'S CONNECT! ==
Newsletter: www.dataschool.io/subscribe/
Twitter: / justmarkham
Facebook: / datascienceschool
LinkedIn: / justmarkham

[@Diachron]

Most people would have simply demonstrated the short way, but by taking the time to elucidate what's happening behind the scenes, you're performing a far greater service. Great job.

[@dataschool]

Thanks so much for your thoughtful comment! I really appreciate your support.

[@trs4184]

Him: So here's how you filter out by certain values. Me: *Copies code* Gotacha, thanks. Him: But that's the long way and you'd never actually do that Me: Oh haha of course. *deletes code*

[@adityaladia3293]

Awesome explanation! I have referred to some resources on pandas earlier and felt like i could easily skip your content to get through faster and grab only the unknown piece of code in the process . But the way you explain things it shows your hold on pandas and i am highly motivated to go through the full video. Cheers great job.

[@guptaachin]

You say just the right words to get the concept and everything behind with lucidity. Thank you. i am a beginner but do not feel like so. :)

[@dataschool]

Wow, what a nice thing to say! :)

[@samuelgeorge6756]

I watch you at 1.5x :-D but like he said even a year later. Nice way to teach. Thank you.

[@alexcipriani6003]

you deserve my tuition money for that

[@saimaacademy5537]

kzbin.info/www/bejne/rJ3JZYOkbtOAq8k

[@guidogaggl4020]

Achin Gupta: my words. This guy is awesome

[@kingsleyobodomechine933]

you are a great tutor, taking the long road and then giving the short answer really teaches the concept very well. Thank you sooo much

[@dataschool]

You're very welcome!

[@FergusMcGee]

Thank you so much. I'm new to pandas as this was very helpful, I couldn't understand why it wasn't obvious how to filter rows. You explained it so clearly.

[@leonardoferigutti9039]

Everything you're doing here for us, it's gonna go back to you in a certain way in the future! Thank You a lot for this master piece!!

[@dataschool]

You are too kind, thank you! 🙏

[@guillermobarrio55]

When great teaching meets simplicity. Thanks so much!

[@dataschool]

Thank you so much! 🙏

[@seangriffin3601]

3 years later and this dude is still a legend and still saving my ass on basic stuff for work!

[@dataschool]

Ha! That's great to hear 😎

[@ASpace25]

It's imperative that you know the logic behind these codes. Thank you Mark for this amazing playlist.

[@dataschool]

My pleasure!

[@rohitekka2674]

I loved how you showcased every possible way, from the heavy technique of using a for loop and then right to using operators. It made things absolutely clear. Thanks!!

[@dataschool]

You're very welcome!

[@ThePRINCEBARPAGA]

Your voice is so soothing and makes the understanding of concepts much easier and enjoyable. Thank You

[@dataschool]

Thank you!

[@sanaullahkhanhassanzai8432]

You are the best Pandas teacher on KZbin. I saw your previous videos as well but this is by far the best. You made the whole concept so simple. Thank you very much

[@dataschool]

Wow! Thank you so much for your kind words! :)

[@jaywiji]

Your explanations are so clear. Thanks

[@yuriwrlk]

The explanations are really well conceived and you speak so clearly that even the youtube captioner can capture it, subscribed!

[@dataschool]

Awesome! Thanks for subscribing, and thanks for your kind comment!

[@zeeshantaj55]

You are the only man I can understand on KZbin about Data Science.

[@dataschool]

Ha! Thank you :)

[@GurunathHari]

You are an amazing presenter. Knowledgeable, fluent, crystal clear. Much respect. Let me know how i can give something back to you.

[@dataschool]

Thank you so much! If you want to support me, I'd love for you to join my community of "Data School Insiders" on Patreon: www.patreon.com/dataschool

[@MichaelCrossUK]

Your videos really are terrifically helpful, explaining things thoroughly from base concepts upwards as you do is just brilliant and your explanations are always extremely clear and precise. Thank you so much for all the time you spend on this - I'm tremendously grateful as I'm sure are many others.

[@dataschool]

Wow, thank you so much for your incredibly kind words! I'm very glad to hear that you have gotten a lot out of the series.

[@alessandrosarretta11]

Thanks, great step by step learning resource! I already knew the quick answer, but not the reason why it was working :-) Very informative!

[@dataschool]

+Alessandro Sarretta You're welcome! I think you will find that understanding how it works in this case will help you to better understand lots of other pandas functionality!

[@rishisagar4695]

Love these, helped with something I was stuck on for 2 days. I'm a beginner, loads of love

[@dataschool]

Great to hear!

[@LyyrRATM]

There is something charming in how you say "Okay" when you finish a thought :) The video is very helpful. Thanks for putting this up here.

[@dataschool]

Ha! Glad my verbal tics are charming :)

[@ludovicolaci9582]

@@dataschool Kevin.verbal_function.finish_thought is this right?

[@RAWRCoding]

Can't believe you do the entire video with so little edits. Amazing!

[@dataschool]

It requires a lot of planning... plus it helps that I love teaching this subject and I know it well!

[@rahulduvedi3341]

Sir,your content is the best for pandas. Thanks a Lot

[@ravivashatkar5585]

Love this video !! Exactly the one I was looking for. THANK YOU !... well explained..

[@dataschool]

You're very welcome! :)

[@KingLiongWong]

Very clear explanation and make me understand how the logic works behind the filter. Great thanks.

[@dataschool]

You're very welcome!

[@alabtv4879]

Explained with brilliance! Congrats.

[@dataschool]

Thank you!

[@sajeendrann]

It's was THAT simple, yeah? I wasted two days trying to figure it out myself. Life saver you are. Thanks for the wonderful vdo.

[@dataschool]

You're welcome!

[@lexboegen]

I like your in-depth explanation of _how_ it works, rather than a "recipe" of "just do it this way" without explaining _why_ it works. Now I'm off to see what other videos on pandas you have!

[@dataschool]

Excellent! I'm glad the depth of the explanation was helpful to you! My complete pandas playlist is here: kzbin.info/aero/PL5-da3qGB5ICCsgW1MxlZ0Hq8LL5U3u9y

[@oculusvirtualreality]

All the concepts very well explained. Your videos on pandas tutorial are just great !!

[@dataschool]

Thanks! :)

[@sapnapatil27]

Very nice tutorials. Easy to understand and to the point. Please prepare more for Data analysis.

[@dataschool]

Thanks for your kind words, and for the suggestion!

[@GrumpyDerg]

Many thanks for revealing the mystery behind the weirdness of the filtering syntax. I've been using it already, but now I realize the reason behind it, which is pretty cool!

[@dataschool]

You're very welcome! I find that understanding filtering helps you to better understand how to use pandas as a whole, which is why I decided to explain it. Glad it was helpful to you!

[@renevillalta27]

Best way to explain, simple and accurate. Thanks

[@dataschool]

Thank you!

[@tomhas4442]

Very nice thurrough explanation! 🙏 thanks

[@dataschool]

Thank you!

[@seshu124]

The best ever Python site! Many thanks for time and effort !!

[@dataschool]

You're very welcome!

[@mayanknaithani5412]

thanks , I learnt more from your videos than other online pandas resources combine

[@dataschool]

You're very welcome!

[@yucelozyazgan]

he put step by step all the stones in my brain and set the wall! :D Simply great !

[@dataschool]

I love the metaphor... thanks for your kind words! :)

[@yucelozyazgan]

;)

[@lucasfrancab]

Such a pretty explanation. Now I discovered the 'Why' i use the bracket. Thanks!

[@dataschool]

You're welcome!

[@rockspeed2010]

Awesome !! Your explanation is very clear and easy to follow. Keep up the good work !

[@dataschool]

Thanks for your kind words!

[@russnagel1]

Thank you. Great content is still great, even 5 years later!

[@dataschool]

Thanks very much for your kind words!

[@mylovelykids5795]

amazing explanation. thanks for your time and patience to educate all.

[@dataschool]

Glad it was helpful to you!

[@mohammadfahim8870]

Thanks !! I was looking for something very specific and 2 of your videos was just right on point ... just subscribed !!

[@dataschool]

Awesome! Thanks for subscribing :)

[@OxanaGafaitiGO]

Many thanks for your tutorials. They are powerful. You make complex things easier. Thank you for your work.

[@dataschool]

Thank so much for your kind comment! I'm glad they are helpful to you!

[@handet.6235]

Bro, you are just great teacher! Please keep going what you are already doing. I'll buy whatever you produce! God bless you! :)

[@dataschool]

Thanks so much, I appreciate it! :) Right now, I only sell one course, called Machine Learning with Text in Python: www.dataschool.io/learn/ But if you want to hear about new courses that I release, just subscribe to my newsletter: www.dataschool.io/subscribe/

[@immanuelsuleiman7550]

Expertly explained. Well done

[@dataschool]

Thank you!

[@erikahuerta2140]

Great videos! I have been struggling with the ideas and concepts behind decision trees and ensembles. I hope these are topics that you will cover in the future and if not, I would really appreciate any resources to gain a deeper understanding of this topic. Thank you!

[@dataschool]

Thanks! Regarding decision trees and ensembles, I highly recommend chapter 8 of this book for a conceptual understanding: www-bcf.usc.edu/~gareth/ISL/ Here are videos related to that book: www.dataschool.io/15-hours-of-expert-machine-learning-videos/ For Python code and more resources, see classes 17 and 18 of my data science course: github.com/justmarkham/DAT8 Hope that helps!

[@hoomandehghani2035]

Thank you. I believe by showing us the theory behind it, you're helping us remember the method for a far longer period

[@dataschool]

You’re very welcome!

[@hkrocksta]

Saved me so much time. Thanks for this !

[@dataschool]

Great to hear!

[@traveltripfamily7486]

You are very good teacher! Congrats!

[@dataschool]

Thanks!

[@avallette51]

I have learned much from your channel. You're a natural for teaching.

[@dataschool]

Wow, thank you so much! I really appreciate your kind words and your contribution!! 🙏

[@willykitheka7618]

You're an EXCELLENT TEACHER. Thanks a heap!

[@dataschool]

Thank you! 😃

[@venkateshkonangi2353]

Bro... Thanks for your great tutorials. I am beginner. From your videos i could understand the correct concept. Thank you very much.

[@dataschool]

Great to hear!

[@kieranbrugman4614]

Really great walkthrough, thank you!

[@dataschool]

My pleasure!

[@GiggsBeckham]

I've learnt so much through watching this one video. Thank you. Now, I may need to re-write some my existing codes to make it more efficient and simple to comprehend. :-)

[@dataschool]

Great to hear!

[@user-oj8nq4wn8n]

Despite the fact that English is not my native language, these are the best lessons about the Pandas that I saw! Thank you!

[@dataschool]

It's great to hear that my videos have been helpful to you! :)

[@srijitapal8100]

you are really a great teacher. It was so easy for me to understand pandas. Thank you so very much.

[@dataschool]

You're very welcome!

[@xiao2634]

Like your video. Very detailed and clear step-by-step explanation!

[@dataschool]

Thanks!

[@leythecg]

A really understandable and good explanation!

[@dataschool]

Glad it was helpful!

[@fourten0410]

Great videos and very clear explanations, thank you!

[@dataschool]

Thanks!

[@bitmagazin303]

Man. You helped million times more than pandas documentary..

[@dataschool]

Great to hear! :)

[@rprana12777]

Great teacher, practically my mentor haha

[@dataschool]

Ha! :)

[@reneebutouy]

You have outstanding skills to teach. Thank you.

[@dataschool]

You're welcome!

[@muradjahangir]

Thanks so much! Excellent step by step explanation of the concept and method! Your clear explanation shows how well you have those concepts and logic embedded in you brain 🙂 Must subscribe!

[@dataschool]

Thank you so much, Murad! I really appreciate your kind words, and also for joining as a channel member! 🙏

[@iccherherbarium9688]

a big thanks for putting an end to my last 3 hours' confused state.

[@dataschool]

Great to hear!! You are very welcome!

[@Maybe4433]

Awesome video, loved the intuitive explanation!

[@dataschool]

Great to hear!

[@leandrorberto]

You're an expert!!! Thank you so much!

[@dataschool]

Thank you!

[@tasneemhegde9588]

You are an amazing teacher.... So clear and so succinct

[@dataschool]

Thank you!

[@yashraut9977]

Lots of love from India 🙏🙏 you have done a great job sir thank you.

[@dataschool]

You're welcome!

[@dianavillescas]

Excellent explanation!! Thank you

[@dataschool]

You're welcome!

[@subbuktek]

Beautiful teaching technique. You purposefully did it the long way first. Wow!. So the condition that I always used in [ ] in pandas is actually just a Boolean Series whose length matches the length of the dataframe.

[@dataschool]

Exactly! :)

[@goingfurther8092]

This was such a good explanation

[@dataschool]

Thank you!

[@JustinLeu1]

Awesome breakdown and explanation, thanks!

[@dataschool]

You're very welcome!

[@mkoc2071]

That is so powerful explanation! Thank you!

[@dataschool]

You're very welcome!

[@cridelu80]

such amazing simple explanation!!! thanks you!!!!

[@dataschool]

You're welcome!

[@brijkishortiwari2077]

Thank you very much sir for all your videos. its really a great experience and help to learn many things.

[@dataschool]

Thanks!

[@Jonas89offsuit]

Boolean is three syllables. Thanks for your videos!

[@dataschool]

You are very welcome!

[@juanmarcusfabregas3139]

Lifesaver, i can't thank you enough!!!

[@dataschool]

You're very welcome!

[@manojkumarleo]

loc helped a lot.

[@robindong3802]

Very good tutorials. Thanks.

[@dataschool]

Thanks for your comment!

[@LonglongGuitar]

this is quite in depth explaining~~~awesome

[@dataschool]

Thanks!

[@alexandercrump2298]

@AchinGupta I completely agree. You break down the methods so they are very easy to understand. This is definitely helped by the fact that you have a solid grasp of pandas! Thanks again

[@dataschool]

Thanks for your kind comment! :)

[@techy0716]

Awesome. Thanks for explaining concept in details. Gr8 work. Thanks.

[@dataschool]

You're welcome!

[@MrMukulpandey]

Great explanation as always

[@dataschool]

Thanks!

[@aegystierone8505]

Never knew loc is a powerful filter tool!

[@shantanufadnisrides]

Thanks for explaining it in details.

[@dataschool]

You're welcome!

[@TR3NDSETR]

Another fantastic video, Im so used to the 8-9 min vidoes now , 13+mins was a bit intense :)

[@dataschool]

Thank you so much!

[@user-sp6dj8gv5k]

Tank you for your kind lecture. Always!

[@dataschool]

You're very welcome!

[@RufusVidS]

Your series is terrific, only one issue, as has been mentioned before in these comments: "boolean" has 3 syllables.

[@dataschool]

Glad you like the videos!

[@ballhockey10]

Excellent explanation

[@dataschool]

Thank you!

[@flexfpv1707]

This is very helpful! Your accent is so clear and it's very easy to understand you. Thanks!

[@dataschool]

Thanks!

[@sid-nejad]

I really enjoyed watching this movies and found it helpful. Thanks

[@dataschool]

Great to hear!

[@TalesFromTheCollection]

This was a great explanation! Thanks.

[@dataschool]

You're welcome!

[@Muuip]

Great presentations, many thanks!

[@dataschool]

You're welcome!

[@mehranzand2873]

what a teacher, thanks.

[@dataschool]

Thanks!

[@grchoudhary5259]

your way of teaching is awesome!!!!! Thanks bro

[@dataschool]

Thank you so much! 🙌

[@Yodad0110]

Great video!! Helped me a lot!

[@dataschool]

Glad it helped!

[@CartanSubalgebra]

you have my infinite respects. you are great

[@LOL-vt8jh]

Very clear! Thank you.

[@dataschool]

Glad it was helpful!

[@frankconte2457]

Thank you. Very clear.

[@saptarshibasu3718]

Absolutely brilliant. Thanks!

[@dataschool]

You're welcome!

[@vivekprajapati489]

thanks. was great help 1 points if u can tell: how to use multiple condition in the the data frame and select multiple columns of the same date frame

[@VariaAmore]

Thank you so much, it was a lot of help!

[@dataschool]

Glad it helped!