Learn how to use PANDAS in Python in 15 minutes - with 10 real examples

Pandas is the most useful data analysis package in Python. You can use it to clean-up, transform and analyze data. Recently, I had a chance to use Pandas for some work. So, in this video let me share a quick but fairly in-depth introduction to Pandas with a real-world case study.
📃❓✅SAMPLE FILES & INSTRUCTIONS:
==================================
~ i n s t a l l a t i o n ⚒ ~
Download and install Pandas & other data analysis packages:
- from Anaconda www.anaconda.com/
- from Pandas website pandas.pydata.org/
- from VS Code code.visualstudio.com/docs/da...
~ s a m p l e f i l e 📃 ~
- Direct Download chandoo.org/wp/wp-content/upl...
- On Kaggle www.kaggle.com/datasets/ronec...
~ c o d e 👨‍💻 ~
- Jupyter Notebook files.chandoo.org/py/pandas-i...
- Kaggle Notebook www.kaggle.com/ronecone/data-...
⏱ VIDEO CHAPTERS 👇
===================
0:00 - What is Pandas for Python?
0:55 - About the sample data & getting started
2:17 - Importing the libraries and loading data to data frame
4:08 - Fixing the data frame delimiter issue
5:21 - Using basic pandas functions (describe etc.)
7:15 - Fixing the text data issue by removing them
8:35 - Solving the problem correctly
11:20 - Adding a column with IF this then that type rule
13:38 - Filling the text value up (using fillna method)
16:13 - Removing the unnecessary rows
16:37 - Doing quick analysis of data (tables & graphs)
📚 LEARN MORE ABOUT PYTHON
============================
Watch my 1-hour Python Tutorial to understand and write your first programs - • Python for Absolute Be...
🤷‍♀️ Other ways to clean this data
===========================
We can also use Power Query in Excel to cleanse and process this data. See this tutorial for that - • Data Cleaning PRO Tip:...
📚 LEARN MORE ABOUT PANDAS
============================
Data Science with Pandas - Tutorial on VSCODE page - code.visualstudio.com/docs/da...
Pandas documentation & examples - pandas.pydata.org/docs/gettin...
📕📗📘 Pandas books:
Python for Data Analysis: Data Wrangling with Pandas, NumPy, and IPython by Wes McKinney - amzn.to/3QPTgCt
Pandas Cookbook by Daniel Chen - amzn.to/3ROiQbW
~
🐼 What do pandas use to record their thoughts?
Notebooks of course 📓 🤣
#pandas #python #datascience

[@likhithlicky2947]

Please upload complete playlist of python ( Numpy ,pandas , matplatlib),,,as we are eagerly waiting for it...your teaching is so heart touching that we feel like our brother is teaching to us.....please we need this complete playlist...

[@harshmehta6321]

True.

[@chandoo_]

Thanks for such kind words. Unfortunately, I don't use a lot of Python in my day-to-day life. So, creating a playlist or series is not possible at this time. But I will certainly keep this request in mind and as I learn and expand my knowledge, I will add such videos.

[@RK-wf7re]

Yes exactly ..It's need of the hour for BI analysts.

[@raghuram8645]

Please make a complete data analysis python video as it is the most extensively used tool.

[@saibalmukherjee3301]

Yes sir we need it desperately..

[@StefanoVerugi]

watching Chandoo's you realize that it's not a matter of easy or difficult programming languages but good or bad video tutorials, thank you sir for making things easier for the lot of us

[@soumadip.m]

Seriously, Leila and Chandoo, these 2 legends changed the way I think and use data in excel. You helped me crack a new job even. Thank you so much!

[@chandoo_]

Thanks Soumadip for such lovely words. Leila is an inspirational teacher.

[@danielurbaniak3602]

Hi Chandoo, I'd just want to say that you're doing a great job sir! Keep going!

[@harishpoalampalli9637]

This is cool and awesome !! Please share more videos on pandas like joins and automations !!

[@dattavalloju5160]

Python is executed line by line and you're explaining line by line very clearly... Love from Texas.

[@chandoo_]

Awesome, thank you!

[@AlbouryNdiaye-ro8qz]

This tutorial is a masterpiece. Thank you Chandoo!

[@chandoo_]

You're very welcome!

[@kadourkadouri3505]

Nice Job ! Keep it up

[@patlecat]

Great intro, thanks

[@hamidrezaakbari7611]

Thank you, Chandoo

[@AznBMan75]

Good video working with weird data and dates! Real-life issues.

[@shadmanjohn123]

Very helpful

[@hareshpatil6939]

Chandoo plz make a complete video list for data analysis using python especially libraries

[@chandoo_]

Thanks for the suggestion Haresh. I spend less than 5% of time doing coding work. As of now, I plan to add 1-2 videos on coding / automation every 2 months. If I end up doing more coding work, I will certainly share more topics.

[@user-oi3yb7mm7h]

There is no place for even the minutest amount of dirt in our hearts. Alexandre Dumas once said that it is difficult to understand others, but the most difficult thing is to understand yourself. Never allow yourself to fall into any trap. Never allow the least karmic obstacle to take form, nor harbour any unwholesome thoughts in your mind.

[@savagelandptyltd513]

It took me 15 weeks to finally complete this 15 minute video. I'm crying

[@chandoo_]

Congratulations. The first few steps are always hard. It took me almost 40 years to write my first lines of Python code.

[@sagarsamalla7313]

Thank you so much for starting videos on Pandas😀

[@chandoo_]

My pleasure Sagar.

[@nomahlubithunyiswa2761]

Looking forward to taking notes from this video. Thank you Chandoo.

[@chandoo_]

Awesome to hear that Nomahlubi.

[@nomahlubithunyiswa2761]

I'm still starting with Python, so this was a bit confusing for me. But I decided to replicate what you did using Power Query and I am so proud of myself 😁because it was my first time using a conditional column. After transforming the data on Power Query, I created a dashboard. Thank you Chandoo you have been so much help in my journey to data and analytics🤗.

[@andybecker5001]

Actually looking to solve this same scenario. Good stuff

[@chandoo_]

Glad to hear that.

[@abigail9457]

Who are you?!?!....Probably mind reader. Was about get started with pandas and you upload this. Real saviour...cannot thank you enough

[@chandoo_]

df.readmind()

[@Unbox9999]

Please upload video for all the mathematical concepts which is necessary for data analytics and science

[@alannavarrovaldez3117]

I started to read the book of data analysis for python from Wes McKinney, is really good and covers a lot of basic python stuff.

[@chandoo_]

I read a few chapters of it on eBook version a while ago. But doing a real-world problem solving (as shown in this video) is what helped me really appreciate and understand Pandas better.

[@huntershikhari2729]

Please post a complete or detailed tutorial on data analysis with python...

[@kadichidu4171]

Please make a full course on data analysis

[@zm2813]

Thank you for this video. Looking at data I first thought that data below headers that had NAs next to it in other columns, is below so you'd have do use fill down. I think it makes sense to understand the structure first and then make structural changes. Also want to commend your fast learning in this area. Did you also try using M code to come up to desired solution? Thank you for posting

[@muhammadobaidkhan4099]

Awesome

[@chandoo_]

😎😎😎

[@hgamedia3544]

why you so funny sir? i cant stop laughing at your first scene in every videos

[@nafishalam203]

Hello sir, thanks for this powerful video. I have been following you since past 2 years and your videos helped me alot in this.. I'm want to trasition my career into data analyst. Can yoh please give me some information about the career opportunity for data analyst or business analyst in new zealand or any other foreign countries

[@chandoo_]

You are welcome, Nafish. I am not an expert in job hunting or anything. So can't really talk about this.

[@Gaurav-ky8qw]

sir plz bring more videos on tips & trick in numpy and pandas ......

[@chandoo_]

Thanks Gaurav.

[@suhailhussain3629]

Nice video sir🙌🏻 By the way, will Machine learning also be used in future from Data analysts or not sir??

[@chandoo_]

You are welcome, Suhail. ML and AI are already widely used in data analysis.

[@basicinfoforall7306]

Let me see all about it.

[@vikeyvikey3149]

Why we don't use power bi or excel in this situation kindly tell me please 😢😢😢

[@chessmess5681]

The only favourite if I have to learn something new my youtube land me here always ........

[@chandoo_]

😊😊😊

[@osamahameed1236]

Is panda better than Excel? Or can panda replace excel?

[@edu1113]

Hi.. excellent video as always.. anyway, i remember at one point u mentioned that u were involved in HRM data analytics for the NZ Govt.. coincidentally, im applying for data analytics position which will look into HRDM data for our state.. any videos on that particular case? What would be your advice for someone applying for this job?

[@chandoo_]

I do have a playlist of HR data analysis. Check it out - kzbin.info/www/bejne/pKK8hqB9j7Khi5I

[@rohitkrishna2648]

@@chandoo_ please take data analyst test of relevel and put a feedback if it's tough or not.i couldn't crack that.its employment test by unacademy

[@sureshboddana33]

Nice chadooo. Great effort please do video on seaborne @ matplotlib

[@scotttheniceguy]

I've ben trying ro go through this tutorial using PyCharm and somehow Pandas won't install at all like it used to in the past.

[@chandoo_]

I had a similar problem at work the other day. Are you seeing any specific errors? I suggest either using pip or anaconda to get all packages in one go.

[@scotttheniceguy]

@@chandoo_ Just failure to install errors; I ended up using pip instead

[@Mania-zknowledge]

Sir, Can you do videos for data science students?

[@chandoo_]

As I solve such problems, I will share my knowledge with all. So far, I do very little DS work.

[@thamilanban]

Is there any reason for a Power BI user to learn Pandas?

[@chandoo_]

Depends. You can use Python from Power BI to do both ETL and visuals. Plus learning new things is fun and exciting for our minds.

[@BachelorS_Lifee]

Share dataset also for practice purpose

[@chandoo_]

Refer to the video description for the link to dataset

[@azaddeenazom1464]

wanna learn complete series like trumpexcel

[@chandoo_]

I do have courses for that. It is tricky to maintain series thru YT. If you want to learn Excel step-by-step in one place, do check out chandoo.org/wp/excel-school-program/

[@ManuRaviMaya]

😍