How do I select multiple rows and columns from a pandas DataFrame?

Have you ever been confused about the "right" way to select rows and columns from a DataFrame? pandas gives you an incredible number of options for doing so, but in this video, I'll outline the current best practices for row and column selection using the loc, iloc, and ix methods.
SUBSCRIBE to learn data science with Python:
kzbin.info?su...
JOIN the "Data School Insiders" community and receive exclusive rewards:
/ dataschool
== RESOURCES ==
GitHub repository for the series: github.com/justmarkham/pandas...
"loc" documentation: pandas.pydata.org/pandas-docs/...
"iloc" documentation: pandas.pydata.org/pandas-docs/...
"ix" documentation: pandas.pydata.org/pandas-docs/...
Summary of the pandas API for selection: github.com/pydata/pandas/issu...
== LET'S CONNECT! ==
Newsletter: www.dataschool.io/subscribe/
Twitter: / justmarkham
Facebook: / datascienceschool
LinkedIn: / justmarkham

[@dataschool]

As of pandas 0.20 (released May 2017), ix has officially been deprecated. Watch my new video, "5 new changes in pandas you need to know about", if you want to learn how to duplicate the functionality of ix using loc and iloc: kzbin.info/www/bejne/qpaYe6WJeLxggrs

[@averyhr]

Data School c

[@lenac3587]

Meh, lessons learned today. Should read comment first before sitting through the last confusing part on ix concept. Thanks for the tip that it's deprecated.

[@DelandaBaudLacanian]

thanks for the update, you're the best!

[@Friends.shorts]

thanks for update.

[@anokhikumari6900]

you are genious

[@elpintor2091]

I love how he teaches, slow, thorough, easy to understand and with plenty of examples

[@dataschool]

Thanks so much for your kind comment!

[@ankurgupta7102]

I watch it with 1.75 speed and still understandable

[@mabelleth]

Still applies today! I love it!

[@igorballesteros6012]

Your voice tone is perfect for learning. Great video!

[@dataschool]

Thanks! :)

[@mawkuri5496]

he sounds like nile red

[@svin30535]

Congratulations on your marriage! Thanks for making awesome data school videos, I learned and refreshed lots of my Python skills here.

[@dataschool]

Thanks for your kind words! :)

[@michellelee7585]

Just discovered this channel and I'm already eager to explore more! Thanks for breaking things down so simply and with tons of useful examples. I especially love it when you highlight to us efficient vs non-efficient / bug-prone codes.

[@dataschool]

Great to hear!

[@prodigyswifeybaby]

Your pace is excellent! I like how you show the different options and recommendations. Keep up the good work!

[@dataschool]

Thanks so much! I'm glad the pace and style of my videos is helpful to you!

[@TomSkinner]

Just wanted to pile on the accolades, thanks. Perfectly paced, clear, succinct. It was just what I needed.

[@dataschool]

Great to hear! Thanks so much for your kind comment.

[@AlexanderArtamonov]

After a few days of reading pandas documentation and numerous 'tutorials' I finally get a general principle of how loc/iloc works, thank you!

[@TheHoinoel]

you are a godsend! Thank you so much for these tutorials. I knew it couldn't be as complicated as other people always made it out to be! Much love

[@dataschool]

You're very welcome! Glad it was helpful to you :)

[@RufusVidS]

I dropped into this video from another video and am so happy it happened! You have a very clear voice in the video, you clearly know your stuff, you give plenty of good examples of good practice and practices to avoid, and are quite thorough. I enjoyed this one very much and plan to check the others out right away. Also, congrats on your marriage, I hope you are still happily together now that a couple years have passed!

[@dataschool]

Thanks so much for your incredibly kind words! I very much appreciate it! And yes, we are still married :)

[@ChiefKamek]

I'd like to thank you for this series! You are a fantastic teacher: the videos are clear and of good quality, you go over everything in a relaxed way and explain everything thorougly. This series is helping me out a lot, great work!

[@dataschool]

Wow, thank you so much for your incredibly kind comment! It's really great to hear that the series is useful to you!

[@genet480]

I really like all your video tutorials.You explain things in a very methodological sequence with high clarity and gentle approach which is vital for beginner data science learners. We are very fortunate to have a free access to such high-quality educational resource. You are one of my favorite you-tube instructors I have ever watched. Thank you one thousand times!!!

[@vman049]

Have watched this videos to refresh myself on two separate occasions. Very clear and concise with excellent examples. Thank you!

[@dataschool]

Thanks for your kind words!

[@chelseali4463]

Your explanations have been one the of best I have found so far on dataframes!

[@dataschool]

Thanks very much for your kind words!

[@michaelbachman5038]

Your explanations are clear and comprehensive. Glad I found your channel. Look forward to viewing more of your videos. Thank you!

[@dataschool]

Thanks so much for your kind comment!

[@TheFallibleFiend]

I've watched this video several times and followed through with the exercise. But I just used iloc at work for the first time. Very handy.

[@dataschool]

Great to hear!

[@MK-xm2nh]

Your tutorials are very useful, and contain a good number of use cases for the duration. Thank you!

[@dataschool]

Glad it was helpful!

[@rgseven6557]

Honestly, this is one of the best videos regarding panda data frames and column selection. Your explanation is to the point yet easy to comprehend. I sincerely thank you for taking the time to create this lesson. Its times like this where I consider myself so fortunate to have access to the internet. Subscribed!

[@dataschool]

You are so very welcome!

[@RaynerGS]

Good job, thanks! Keep on speaking high and clean as like in this video, this way facilitates so much for who is no English spoken native.

[@dataschool]

I'm glad to hear that my teaching style works for you! Really appreciate your comment :)

[@mohamedel-gazzar5818]

legend absolute legend. I have been recently doing a course on data analysis and I keep coming back to this man's videos for help.

[@dataschool]

🙌

[@PawanBathe]

Awesome buddy, I watched it 2x still was able to follow along , because I had some familiarity around the concept , but others are also praising you for slow explanation, that's unique, suits for both, thanks for clarity of audio. very concise and clear.

[@dataschool]

Thanks for your kind words!

[@pressiyamu2187]

Dude this was like the one function that I couldn't comprehend. Thanks a ton!

[@ziaw123]

Hi, this is the best explanation ever!!! Super clear and you teach it slowly and show us different ways of doing and also why we should/should not use certain methods. This is so helpful!!! Thank you so much!!!

[@dataschool]

You're very welcome! 😄

[@PatrickBateman12420]

Wow, best explanation on iloc/loc I have ever seen !!! Thank you for sharing!!!

[@dataschool]

Thanks so much! I worked very hard on that video :)

[@sanaullahkhanhassanzai8432]

You are one of the best on you tube and the best on Pandas without a doubt, Keep up the good work. Thank you so much for the videos

[@dataschool]

Thanks so much!

[@anastasiyan44]

the best explanation I've come across, and it actually applies to all your videos. Thank you!

[@uh6537]

I have stuggled a bit with loc and iloc but after 12 min here everything just became clear. Thanks for an awesome explanation of this topic.

[@dataschool]

You're very welcome!

[@ahe970]

Really great - though 4 years old video. Just learning Python and found u to be a great teacher. I will look for ur other videos Thanks

[@dataschool]

Glad it was helpful!

[@mandyma7243]

Thank you for being patient and really informative!

[@altunbikubra]

Thank you so much for the differentiation. I have taken an e-learning which now I realize that they did not even mention fatal functions of these usages. Now I can run my code, thank you !!!

[@dataschool]

You're welcome!

[@irakliberidze156]

Big thanks for your job!!! Do not stop. too many people need video tutorials like this. waiting your new videos.

[@dataschool]

More to come soon!

[@nicholasroman8071]

Very nice systematic break down of how to drill into a dataFrame. It was worth my time to watch this video.

[@dataschool]

Great to hear!

[@rinmulder2008]

The pace and tone is excellent. Thanks for making the simple things clear. I am a subscriber now

[@dataschool]

Thank you! 🙏

[@JonathanDewetfunlifegod]

Great video. Your voice is very clear even when sped up and you explained the concepts very well. Thank you.

[@dataschool]

You're very welcome!

[@zackhicks2433]

Thanks for these videos - hands down the best videos online for learning how to data science.

[@dataschool]

Thank you so much for your very kind comment!

[@joro8604]

Well done! Thanks for going over the "proper" way first, and then the shortcuts. Most docs and tutorials, go straight to the shortcuts which is frusterating for a newb or even intermediate.

[@dataschool]

Great to hear!

[@rajsx5]

Congratulations on your Marriage!! And thanks for creating so neat and informative videos, learned a lot, I really appreciate it. Thanks again!

[@dataschool]

Thanks so much for your kind words and your well wishes! :)

[@220piyush]

Thank You for this!!! I had so confusions regarding this topic and looking for a such a clear and informative video.

[@dataschool]

Glad it was helpful!

[@balford2112]

Thank you so much for this video. Very easy to understand and comprehensive.

[@dataschool]

Glad it was helpful!

[@harijayaram]

you are a very good teacher ...thanks again...i'm always using loc from now on

[@dataschool]

Thanks for your kind words!

[@aabedkashwa9125]

i swear to god, i love you and your talent in teaching .. you are an awesome teacher, sir this helped me alot, God Bless you.

[@dataschool]

Thank you so much! I'm so glad to be of help to you!

[@dean8147]

Amazing video. Been a few years since i last had any work related to Python.

[@dataschool]

Thank you!

[@sumanhalder1539]

Excellent explanation: was perplexed by various indexing protocols previously. Great pace and explanation was really helpful.

[@dataschool]

Great to hear!

[@jmachado9875]

I'm amazed at the clarity with which you explain those concepts and teach how to use them in a professional manner. I'm really glad I found your youtube channel! Can I also ask you what technique would you recommend to copy ranges and paste them into another excel file (appending, not overwritting)? Thank you very much for your shared knowledge.

[@dataschool]

Thanks very much for your kind words! Really appreciate it. As for your question, I don't know off-hand, but you could search through the API documentation to see if anything is available: pandas.pydata.org/pandas-docs/stable/api.html

[@jmachado9875]

Once again, extremely helpful! I'll look it up. Thank you for your kindness.

[@michaelakatwijuka3465]

I really have not found explanations as clear as this.Thank you Steven

[@dataschool]

Glad it was helpful to you!

[@jerx4959]

I know these vids are older, but thank you. You are an excellent teacher!

[@dataschool]

Thank you!

[@TR3NDSETR]

My brain is fried. I just watched 19 videos in 2 days and did every example also. But after watching I feel so much more confident. Im taking a class in a tech school currently, but your teaching is so much clearer. I learn more here, than in my class. My class is sooo fast, and long 5hr sessions at a time, its soo difficult to comprehend everything. Your videos are amazing. Thanks.

[@dataschool]

That is so awesome to hear... thank you so much!

[@poonamsachdeva9172]

Excellent video, very clear and practical description. I will watch your other videos on Python and Pandas as well. Thanks a lot.

[@dataschool]

Thanks for your kind words!

[@jaydock1]

this is the most clear version of this I've found! great stuff

[@dataschool]

Thank you!

[@noo-sho8500]

I think you're the best data science python tutor I had seen :D

[@dataschool]

Thank you!

[@harrwoodhouse2435]

Thank you so much, I've been stuck on this issue for ages!

[@dataschool]

You're very welcome!

[@yasermahfouz6263]

your lectures and your examples are very nice , thank you

[@dataschool]

Thanks!

[@Gloryisfood]

Most useful tutorial I've seen so far. Brilliant!

[@dataschool]

Wow, thanks!

[@suhanasharma2965]

your way of teaching is too good sir.thanks a lot

[@harrykaranikas7741]

Still... The best videos for Pandas on KZbin! Thank you!

[@dataschool]

Thank you!

[@ragavsathis]

Thanks for detailed explanation, able to solve my problem and understand in detail about loc

[@dataschool]

Great to hear!

[@niceday2015]

Thank you very much, I like your video very much, very clear! And the speed is perfect for learning!

[@dataschool]

You're very welcome!

[@nickiexu9919]

So far the best tutorials for pandas that I've ever seen. I like you explained in great details in both codes and logic. Your speed is slow and clear, leaves great room for audience to think. The examples are well designed, serve well for the purpose. I will try to go thru all your videos! Congrats to you for your marriage! Do you have videos on Groupby?

[@dataschool]

Wow, thanks so much for your kind words! I really appreciate it! I do have a video about groupby: kzbin.info/www/bejne/p6qTl3enpLJ9rpo Hope that helps!

[@Mufc_maddy]

Very nice video, Clearly understand the loc, iloc concept.

[@dataschool]

Great!

[@Seanog1231]

Thank you for the great instruction and welcome to the club!

[@dataschool]

You're welcome!

[@rutviktidke07]

Best channel for learning python... kudos to you 👏

[@dataschool]

Thank you!

[@archana0404]

Each video is nicely explained. Well done. Thankyou somuch for sharing these video.

[@dataschool]

You're very welcome!

[@Taran72]

Great Video! Ideal for a beginner like me. you explain everything in detail and straight to the point.

[@dataschool]

Thank you!

[@petertao287]

Good!

[@fluffmiller1084]

Wow This is a beacon of light in a sea of generally pretty badly presented and confusing KZbin vids/moocs/other resources (including paid ones!) about pandas. Thank you for taking the time to make this video. It addresses such an obvious point of confusion that, having seen it, I'm left wondering why almost no one else takes the time to clarify the differences between the three indexing methods. I particularly liked the fact that you didn't just present syntax, you gave the reasons why the syntax is the way it is. So much pandas (and some python) teaching simply presents syntax with the expectation that you'll remember it. When you understand why it is how it is, you don't need to commit half as much stuff to memory. Thanks

[@dataschool]

Thanks so much for your thoughtful compliment! For every video, I spend a lot of time thinking about what to present, how to present it, and what details to include and exclude. I'm so glad to hear that my teaching methodology works well for you!

[@UncleLoren]

It's interesting that .loc, though not the conventional choice of expression when specifying rows by NUMERIC POSITION, does in fact work provided the row index names are numeric. In contrast, .loc is not an option when specifying columns by numeric position (well, not unless the columns had numeric names). This video series is great for both "beginners" and for those who want a refresher b/c they've been spending more time using data frames in R and want to keep their muscle memory flexible to both worlds. Thanks a million, Kevin!

[@carlosastro21]

My friend, you have no idea how useful was this lecture for me. Pandas was turning in such a nightmare. And I don't even use it, ascii files have been good enough for me until today. But as a python user I wanted to check what I was missing with Pandas, and after many tries I was not understanding its logic. Even worse, I tried with MultiIndexed files from the beginning, so I was hopelessly crashing against a wall. But your input was really illuminating. So many subtleties.Thanks a lot! And best wishes in your marriage and future plans. Cheers

[@dataschool]

That is so great to hear, thank you for sharing! I really appreciate it!

[@Diachron]

Another winner of a video that cuts through the fog usually surrounding these methods. And congrats on the wedding.

[@dataschool]

Thanks very much! :)

[@AZ993k]

Thank you! That's just what I've looked for, in brief

[@dataschool]

Glad it was helpful!

[@kapilag]

Very clear and sound explanation. Thanks a lot Kevin!!

[@dataschool]

You're very welcome!

[@scottlucas3710]

SUPER CLEAR TUTORIALS. NICE JOB

[@dataschool]

THANKS!

[@georgesmith3022]

great explanation, perfect voice tone and pace

[@dataschool]

Thanks George!

[@DelandaBaudLacanian]

12:21 nice summary of loc() vs iloc(), lots of good information

[@dataschool]

Thanks!

[@urso15]

Aside from the good video, your way of speaking makes the content easier to understand to non-English native speakers.

[@dataschool]

Great to hear!

[@shreddersengupta7384]

I agree with you.

[@diegomedinaflores3362]

I found your video because I got this Warning: SettingWithCopyWarning: And you helped me to fix that issue. Thanks you a lot from Perú.

[@markslima1557]

this video is a little older but great content great instruction - you are making this really clear for me

[@dataschool]

Thank you!

[@louisthiebaud9999]

Remarquable et très pédagogique! Félicitations pour la qualité de votre prononciation. Thanks a lot!

[@dataschool]

You're very welcome!

[@chitranngoc9821]

Excellent video. I learned a lot from this video. Thank you very much.

[@dataschool]

Glad it was helpful!

[@prashantjoshi8847]

He is a great teacher,I wish he could be my professor,Great work Sir :-)

[@dataschool]

Thanks so much, I appreciate your comment! :)

[@amarn22]

Brilliant. You are a star. You must do more videos in python machine learning and NLP

[@haisonduong4726]

Your videos help me save a lot of money! Thanks!

[@dataschool]

Great to hear! :)

[@dhanushanthpushparajah1878]

This videos are awesome. Simple and clear. Thanks a lot brother.

[@dataschool]

Thanks so much for your kind words!

[@FFGaming32207]

Incredible explanation. Thanks a lot ❤❤

[@dataschool]

You're welcome!

[@goldensleeves]

This is GREAT. I'm in a software school right now and they did a MUCH WORSE job of explaining this. THANK YOU for this video. Thumbs up

[@dataschool]

You're very welcome!

[@MandlenkosiNgwenya]

Thank you sir for such great video, it is so easy to follow also

[@dataschool]

You're very welcome!

[@selimtanrverdi9639]

Very very useful series. Thank you so much.

[@dataschool]

You're welcome!

[@vinodkumaryadav1292]

It's really a helpful supporting video to learn python 🐼... Most appreciated.. Thank you for your support

[@dataschool]

You're very welcome!

[@angelanganga2945]

Awesome video, very easy to understand. Thanks

[@dataschool]

Thank you!

[@harikrishna-harrypth]

Your videos are very helpful! Thanks much!

[@dataschool]

Glad you like them!

[@dtsleite]

Great explanation and examples! helps a lot! Thanks!

[@dataschool]

You're very welcome!

[@davidpaez_co]

You explain things wonderfully, thank you!

[@dataschool]

You're welcome!

[@hhbbhvvbjhbbyjj]

wow this video is so clear and super helpful!

[@dataschool]

Thank you!

[@ManikandanRaju]

If had a million dollar with me, I would straight up come to you and give you the cash and learn from you. OMG!! You are a gem sir. I am new to Python. I'm finding all your videos extremely useful. Beautifully explained, clear and concise. Slow and steady. What else does one need! Hats off!!!! Thank you so much.

[@dataschool]

WOW! Thank you so much! I really appreciate your kind words! 🙏

[@drhf1214]

thank you so much. This video was very helpful. Thanks for the many examples.

[@dataschool]

You're very welcome!

[@garysee8]

I like the way you presented. do you have a video on for looping through a column then filtering

[@sibinh]

You did a great job! Happy wedding!

[@dataschool]

Thanks! :)

[@sachinsarathe846]

Thanks Kevin.... You are doing a great job. Your videos helped me a lot in learning Pandas God bless you 🙂🙂🙂

[@dataschool]

That's awesome to hear! 🙌

[@contractorwolf]

thanks man, your explanation of how to use ix was helpful

[@dataschool]

Great to hear!

[@ashishganga420]

Awesome Tutorial for absolute beginners..Really appreciate that sir..Thank You...

[@dataschool]

You are very welcome!

[@davidl3383]

Thank you so much. You are a really good teacher. evrything is clear for me now !

[@dataschool]

Thank you!

[@user-zy8sf7tv2f]

Man you are incredible, thanks for your teaching.

[@dataschool]

I appreciate that!