Python Pandas Tutorial (Part 1): Getting Started with Data Analysis - Installation and Loading Data

[@coreyms]

Hey everyone! Thanks for being so patient while I finished this course! I am still finishing the last few videos of the course and have many more to record, but I am hoping to release Part 2 tomorrow. The next video will cover DataFrame and Series datatypes. These datatypes are the backbone of Pandas and learning what they are and how to use them is essential, so be sure to check that out. I'd like to thank Brilliant for sponsoring this series. If you'd like to check them out then you can sign up with this link and get 20% off your premium subscription: brilliant.org/cms

[@yehudagurovich]

Thanks for the videos Corey! I learn a lot from you. Are you going to use excel files with pandas in the series?

[@coreyms]

Yehuda Gurovich Yes, ill have a video where we look at how to read and write to many different file types and also SQL

[@yehudagurovich]

@@coreyms Tyvm! Greetings from Chile btw :)

[@TOpCoder100]

Do you plan to cover DaskDataframes for parallel computing ? I think for those who already know Pandas it would be great to know how to parallelize pandas.

[@techbatika24]

Thank you so much Corey!! Was eagerly waiting for this. Much love.....

[@animeisaculture5556]

KZbin notification has been programmed to bring me here to learn about programming :)

[@michaelpacia7356]

I'm starting to learn Pandas today and will comeback to this comment once I become a Data Scientist!

[@rabiabatool1335]

so you did not become a Data Scientist

[@Concon-bu4bp]

​@@rabiabatool1335😂

[@angelokezimana]

😂😂😂💀💀💀💀

[@nishant1877]

Bro it's been a long time now. Where are you

[@ricptavares]

Hey bro, i hope you come back someday

[@theo_riveroooo]

Hi Corey, you're definitely the best teach, thank you from Brazil

[@abhishek8311]

Two Tutors which I look upto: Corey and Sentdex. Both have made my life easy. Thanks a ton Corey :)

[@ShubhamSharma-rm9ry]

This is the Perfect New Year Gift, Thank you, Corey.

[@PraveenKumar-zf6ks]

@@creeplabs Hi guys can anyone tell me where I can get the csv file

[@kartikesinghgaur4363]

@@PraveenKumar-zf6ks check the description there's a link stackoverflow survey download page

[@AAKFKEK315]

Did you make the most of your year?

[@aghilannathan8169]

Happy New Year

[@raghavnegi713]

Your videos build interest in python .

[@yo5175]

I got " SyntaxError: (unicode error) 'unicodeescape' codec can't decode bytes in position 2-3:" don't know why.

[@eng.ahmadmohammad2464]

The programming community can not thank you enough Corey, thank you so much for the huge effort you are making through several years, we all love you ❤❤❤❤

[@hunterhp]

Hey there how's it going Corey. In this comment I'm going to be thanking you for being a great teacher. So what that means is you're awesome. Now if you don't know what that means, I have written other comments that go into detail on how awesome you are and you can find it in the comment description below. Click here

[@dragosmanailoiu9544]

BAHAHAJA

[@alex.username]

One suggestion: I realized from watching a couple of videos your introductions are always super fast (maybe you accelerate the video, not sure). It can scare some people away if they assume it's gonna be like that throughout the whole video. Anyways, really great videos, just subscribed!

[@johndavis48076]

Hi. You can adjust playback speed on KZbin in settings.

[@alex.username]

@@johndavis48076 Seriously?! That's mind blowing.

[@macfearghas]

Hey friend, great video! Fyi, I think you mean "truncate" instead of "concatenate". Keep up the great work!

[@dmitryoctour824]

Corey: starts realising pandas tutorial Everyone liked that!

[@Bayo106]

releasing *

[@bigdaisy369]

if someone like me had trouble installing pandas. firstly, this is done in the command prompt or terminal(mac). NOT in python! secondly, if 'pip install pandas' does not work, try... py -m pip install pandas

[@Hamzolas]

you can install any library in directly jupyter with put a "!" beginning of the code like "!pip install pandas"

[@Hamzolas]

now i check on my both pc and mac with ! and without ! all is working I think there is something cause that we dont know

[@rebelScience]

Amazing stuff, as always! I would love to see a video of how you create your videos. How many takes you do, how you edit stuff. I started my own series, heavenly based on your stuff, and I find myself recording 40 mins and cutting 15-20 mins out of it due to hiccups and stuff.

[@coreyms]

Hey there! I'd love to do a video like that. I don't know when I can get around to it, but several people have requested that. I record and edit using Camtasia, and I'd say that I also cut about as much out as you said. If I record for an hour then the final edited video will likely only be 40 minutes or so.

[@ayaqz3144]

you are both amazing people , thank you for teaching us

[@snehapujar6666]

Corey ..i request you to do videos on numpy 🥺 please

[@jeromatu4879]

Hey Corey, I just want to thank you for your work. I've watched many videos about python but yours are by far the best. Keep up the good work and greetings from Germany 💪

[@coreyms]

Thanks!

[@md.imamulislam7]

Excellent video. Just a small nitpick, when you said "concatenate", you meant truncate.

[@markgreen2170]

...you keep using that word, "concatenate" ...i don't think it means what you think it means, lol! p.s. good video!

[@aloudia]

Thanks sir, I am a php developer on the road to become a data scientist. This serie will sure help for the first steps.

[@mctrjalloh6082]

Where are you from mister Diallo. Lol.

[@aloudia]

@@mctrjalloh6082 from Guinea (Conakry)

[@mirkafarkasova2425]

Sir Diallo, I'm just curious, why would a php developer change career to data science?

[@zhiguowang1596]

OMG, Corey updated again. Hey Corey, I have been learning all python from your posts and watching your videos repeatedly. Thank you very much for your awesome work.

[@coreyms]

Thanks!

[@spacescienceguy]

I'm a geophysicist, and I decided to learn Python a few weeks ago to upskill in data analysis. I finished an intro course in Python, and then landed here to learn Pandas. Thank you for this resource!

[@hananeougherb]

I’m doing the same thing ! Can you please tell me if you have a background in data science, or if you are directly learning pandas? Thank you.

[@spacescienceguy]

@@hananeougherb no background in data science, and minimal background in stats :)

[@angeatgr]

Hi Corey ! You were the first KZbinr to really help understand Python. After 6 month of learning I decided to go back to school to get a degree for Python developer, in one year i will be graduated ! Thanks for the great content and happy new year.

[@coreyms]

That's awesome! Great job!

[@alecdiraimondo7539]

Used your flask tutorial to do my project last semester, and now I will use your tutorials to help me complete my data mining hw :D. You da best

[@guiltytemple5937]

Hello can anyone help me here ? I tried installing panda and entered pip install pandas but I got an error and it said " This error originates from a subprocess, and is likely not a problem with pip. error: subprocess-exited-with-error "

[@easydatascience2508]

I can

[@dietrevich]

JUST FYI: concatenate means to join, not to cut off..so when you say that the rows or columns were concatanated it means that they were joined together which I'm sure is not what you meant. The correct word is truncated, which means to be cut off at the tail end of something.

[@rameshdev4015]

I'm getting error while installing pandas using simple command pip install pandas , please help me bro

[@nikitareichert1820]

Me too

[@Nehalpanchamia07]

Hi Corey - Your channel is by far the best on youtube in my experience. It's a no-nonsense and technical enough for anyone to learn Python language. Keep up the good work. God bless you!

[@magnusrodseth]

I'm just starting to learn Pandas TODAY, and this video pops up by the number 1 Python teacher on KZbin!

[@ShwetankT]

0.75x speed works for me ..

[@daevski]

I noticed: You keep saying 'concatenate' when you mean 'truncate.' (Great video, as always! Thanks)

[@johngriner7339]

looking for the dataset

[@khushbootiwari4688]

Hi Corey, I'm writing this comment to say thank you so much for all your videos, because your channel helped me to understand better. I really don't remember to how many people i have recommended your channel to learn Python from you as you're my fav teacher ever. Thanks for this and keep posting. :)

[@learndatabending182]

You may not know Polars outperform Pandas, and Peaks prepares to outperform Polars.

[@usmanjavaid4195]

you are gem of a person. I loved your past Django series and learnt a lot from them. you are the best teacher on KZbin. I would love to see more on machine or deep learning stuff from you in future after Pandas series.

[@joecole5868]

Thank you very mush Sir.. this video really helped..

[@ajitesh764]

It suddenly occured to me while watching the video that I had the ad block on...... @Corey Schafer it's pretty obvious what I did next.

[@dark4krad]

Oh God. This is going to be incredible. Thanks Corey sir. You're the best!

[@divyacyadav1855]

Where to do we get the dataset.I see only code from ur above link

[@somsubhra.g]

Great video as always! Btw, I believe you mean truncated when you say concatenated

[@AnirudhGiri]

You are objectively the best tutor of all time. Thank you, Corey!

[@dakeshwarverma8623]

can anyone please share me this dataset link to download Thanks in advance💗💗💗

[@mau_lopez]

This is fantastic, Pandas with the best Python explainer. Have been looking forward for this series. Thanks Corey !

[@azr_sd]

Hi Corey, the way you explain stuff just makes me learn more. I am really happy for your videos. Can we expect any ml/dl playlist soon? let me know :) Thank you for the absolutely quality videos and hard work you put into it.

[@rubenghazaryan6093]

--------------------------------------------------------------------------- ModuleNotFoundError Traceback (most recent call last) Cell In [4], line 1 ----> 1 import pandas as pd ModuleNotFoundError: No module named 'pandas' What can I do with this?

[@melophile7771]

Install pandas to your local venv

[@KrishNa-hm8mk]

For those who installed *Python 3.8* : If you getting errors when running *pip install jupyterlab* , try running *pip install --upgrade setuptools* first. This will update the tools needed to run jupyter like Microsoft Visual C++ 14. After this, run the install command. If you are getting *NotImplemented* error while launching jupyter notebook using the command jupyter notebook, checkout the first answer in the following Stack Overflow link and apply it. It will work fine after this fix. stackoverflow.com/questions/58422817/jupyter-notebook-with-python-3-8-notimplementederror

[@nikitareichert1820]

I got the notification command not found: pip, as I wanted to install pandas ans jupyterlab. Do you know why that is?

[@Mushsayer]

I'm really excited for this great video on pandas. Thank you Corey for the great tutorial.

[@renatoziraschi1686]

Thank you for this series. I really appreciate it. Your videos are easy to follow and do without the annoying music intros.

[@scottrerickson]

Would anybody be interested in an anki flashcard deck I'm putting together for becoming familiar with pandas syntax? I'm working on one right now and could release it here when it's done if anybody's interested.

[@bonitoflake191]

that sounds cool id b interested

[@7620313]

Best channel for Python tutorials. I'm very excited about this series!

[@gordonmorrow6945]

Corey strikes again! So happy to have the best programming teacher on KZbin tackling Pandas!!

[@neeraj1bh]

Was knowing you'd be uploading the video today. Thanks. And the waits over.

[@pthiago_s5075]

Right on the day I started thinking about learning data analysis. It can't be just coincidence

[@mctrjalloh6082]

Hey Corey, Very happy to see you come to the data science world. We're thankful. Hope you'll also move slowly into machine learning! Cheers.

[@Thedevineforce]

My reaction when I saw Pandas Tutorial by Corey Schafer :D:D:D. Love all your videos. Absolutely awesome tutorials. Keep going.

[@davebeckham5429]

Excellent tutorial Corey. Thanks for sharing.

[@juannunez6795]

You have a gift for teaching Corey. Thank you very much Sir.

[@daegudude1048]

Corey, I sometimes with you were my university professor, it's very understandable what you are explaining and I could sense how much effort you put it into these contents. Very unlike to my professors who just mumble stuffs. Thanks a lot!

[@dashuaiye5835]

ME TOO!!!!

[@CSSuccessGamer]

hey just found your channel. subscribed! I'm ready to become pro at pandas!

[@chandansarkar1123]

Yessss. This is the way we start celebrating the new year...

[@raghavnegi713]

Thanks a lot for this great tutorial !!

[@akashkanojiya5869]

I get confused when too use pd.DataFrame and when to use pd.Series and same for .sum() and .count_values()

[@modernmistyk4341]

Corey Schafer is one of my favorite youtube educators, really clear and concise.

[@coreyms]

Thanks!

[@abdulhamidkhorajiya2256]

liked your video without watching. you are great. will watch this tomorrow. thanks for uploading

[@adamgdev]

Back after watching (and following along) your virtual environment video. THANK YOU FOR THAT!!! I had a massive cluster fuck with anaconda, homebrew and pip that took me hours to untangle. Virtual environments seem like only way to go now. Thank you for that detailed video and explanation. Stoked to get into Pandas!!

[@Lars7878]

Thanks. Long waiting for pandas. Maybe you can build on this some more data analysis stuff. I would like to see some videos with plotly...

[@chaitusathvika2717]

Thank you so much corey schafer for helping us. You are like God for us. Life savior. May god bless you. Am impressed with command in your voice. When i started python half of the time i spend to search for nice videos for topic now only one hero and one god its you. Thankkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk you somuch

[@joysharma8599]

Hi Corey, Please create some videos on Numpy. Your tutorials are absolutely no non-sense top class technical lectures with good practical examples. Totally loved your teaching style!

[@TheGreatAnnouncer]

Thanks for everything big man

[@thearmoredfatboy]

'jupyter' is not recognized as an internal or external command, operable program or batch file. Been trying to fix this error when starting jupyter notebook SUPER fustrated...

[@niteshprajapat7918]

Hey fork, use cmd and type jupyter notebbok

[@ColdSun08]

try jupyter-lab or python -m notebook

[@ramansingh4068]

my jupyter notebook is taking only capital letters as input not lower case IN [ ] is showing not in[ ]

[@nikitareichert1820]

I got the notification command not found: pip, as I wanted to install panda and jupyter. May anybody help me please?

[@gordo_careta]

did you install python?

[@nikitareichert1820]

@@gordo_careta Yes I did

[@nikitareichert1820]

Nevermind fixed it

[@yuzhou4312]

Thank you so much. Coding was intimidating to me until I saw your tutorials. You're amazing!

[@Param3021]

Really Thank you so much sir, for this Pandas Tutorial series. 😊. I have watched all the videos and learned so much about pandas, your every video is really great and beginner friendly, easy to understand.

[@benmatt8940]

I love your work dude thanks for changing my life ;)

[@varunkrishnaKyathanpally]

I first liked and then started watching.

[@mau_lopez]

That was right, because with Corey it's sure that one is going to like any Python lesson : )

[@aksharpatel17]

I do that to every video i watch on KZbin

[@rafaelnegreiros_analyst]

Very good

[@Kwame2]

I cant wait to know what the rest of this playlist has in stock for me cause I'm already loving this first video and i believe I am at the right place to learn about pandas library

[@Ryan_online]

Thanks Corey! Stay blessed. This is good stuff as always.

[@GerdaBraun-ww4kg]

das ist so toll😃

[@ermrityunjaykumarsingh6513]

truly an amazing new year gift @corey Thank you :-) ton of thanks .

[@jeanaimegakwerere5359]

Thanks Corey! You tackle essential things within a short time.

[@DidaKusAlex]

Amazing video! thanks!

[@prajwal4400]

On my way to be a data scientist with your videos. Much love corey

[@sammyay-man2754]

Web Page Blocked The web page you are trying to visit has been blocked in accordance with company policy. Please contact your system administrator if you believe this is an error.

[@mitchellfolbe8729]

Just started this and had to clear some hurdles. For Windows/PyCharm users, make sure to use \\ in the pathway or you will get stuck. e.g. "C:\\Users\\Owner\\PycharmProjects\\PandasDemo\\survey_results_schema.csv"

[@seanseawright1501]

I am glad i iloced into a new video from you. Always great stuff sir!

[@muayad01]

i have this error : NameError Traceback (most recent call last) in ----> 1 df=pd.read_csv('C:\\Users\\Big MoMo\\Desktop\\python\\panda-demo') NameError: name 'pd' is not defined help plz

[@rashidakhan77]

Excellent teaching style and easy to understand materials. Thank you very much.

[@sunayanak2192]

Had few doubts, please help 1>How do we store filtered dataframe, for example the below code df[df['Gender'] == "Male"] 2> how do I use value_count() on question 1 3> when i run the code 'nba.dropna(axis= 1).head()' I am getting output with only index but not the column values 0 1 2 3 4 Note : nba is my dataframe name 4> When I run the below code pokemon.get(key=['Pikachu','Nonsense'],default='This is not a Pokemon') my output is Pokemon Pikachu Electric Nonsense NaN Name: Type, dtype: object Instead of 'This is not a Pokemon'

[@FarhanAhmed1360]

why pd.set_option('display.max_rows',85) not displaying 85 rows of df? It's only showing 85 rows of schema_df

[@rajbhalani7450]

Hey corey, where can I find that CSV file ??

[@easydatascience2508]

check mine

[@Esscapade]

I installed Pandas using: pip3 install pandas; however upon using df=pd.read.csv('....'); I get the following error: AttributeError: module 'pandas' has no attribute 'read' Can anyone advise please

[@SuperMilhauz]

wtf, why don't you use notepad and terminal, or even why do you use gui? why don't you just do it in binary? Is there any modern tutorial for people using vscode and gui?

[@hemantgautam1]

pd.set_option('display.max_rows', 85) is affecting only schema_df not df? Why is so?

[@gyaneshwarkumar2765]

Hi Sir, Could you please help me with this When I ran pd.options.display.max_rows=None command in order to show all rows of the dataframe(survey_result_public) everytime jupyter notebook shows waiting symbol it does not allow me to show all the rows with the side bar so that I can navigate to the workbook. Please help

[@staceybruestle6884]

I'm in the first couple of minutes of the video and have a very basic question. First, I had to stop to learn about making a virtual environment. Thank you for that. Now, I'm back to get going with this video. I'm seeing your prompt is a "$". I'm in windows and not seeing that. Is it a $ because you are on the mac? I'm thinking it would be $ if on linux as well. Am I on the right track? --- More questions... I continued on (working in windows). I'm following along running everything on my computer as it's being shown in the video. I have installed jupyter. I tried to open a jupyter notebook but get the following message: 'jupyter' is not recognized as an internal or external command, operable program or batch file.--- I'm wondering if this has anything to do with where I'm creating my project versus where python is installed on my computer.

[@swarupsarangi734]

I have one doubt, after we set "pd.set_option('display.max_row',85) " and run the df again, we didnt see the first 85 rows in df. Can anyone clear my doubt

[@mrmuranga]

Corey, the entire tutorial made my year...I started this course during covid intal days and within months I was doing very complex analysis for some big projects..awesome stuff

[@DANNYEL20122]

So you got a job now?

[@mrmuranga]

@@DANNYEL20122 Dude that was 2 years back and have since moved ahead with other projects, i still refer to occasionally to this great material

[@DANNYEL20122]

@@mrmuranga was just asking to get inspired

[@mr.pieced6766]

@@DANNYEL20122 Did you get inspired?

[@DANNYEL20122]

@@mr.pieced6766 lol

[@Al-Ahdal]

df = pd.read_excel("C:\Users\This Pc\Desktop\New folder\Data\3.IF-Function", sheet_name ='Supplier Selection') SyntaxError: (unicode error) 'unicodeescape' codec can't decode bytes in position 2-3: truncated \UXXXXXXXX escape Kindly help in that, tried backslash, fwdslash and everything, but could'nt able to read excel file. Please advise.

[@martvink2321]

Try and type a r infront of the path name, computes it to a raw string. All your questions are answered on stackoverflow by the way.

[@datageek8936]

before you open jupyter notebook cmd>> Cd copy file path >> open your jupyter notebook from there so you don't have to write the path of the file since your command line is running from there just write the name of the csv file name.csv

[@Al-Ahdal]

@@datageek8936, tried this but issue not resolved

[@Al-Ahdal]

@@martvink2321 tried with raw string, r but issue not resolved

[@datageek8936]

@@Al-Ahdal may b have u checked the name of the csv file