Python Tutorial: CSV Module - How to Read, Parse, and Write CSV Files

[@HellO-ly1bp]

I've just interviewed for an amazing Python job, and if I get it I swear I will owe you so much. Everyone says this already but they're right, your videos are fantastic, thank you for all your time and effort!

[@coreyms]

That's great, Nina! It makes my day to hear feedback like this. I wish you the best in getting the job. Good luck!

[@HellO-ly1bp]

So guess what... I got the job! Big big thanks again, it means so much to me to get a job like this. I'll be sure to keep on recommending your videos!

[@syedabdulrahmans3357]

Congrats Nina!

[@HellO-ly1bp]

I guess it's special to me because of the struggle it took to get here. My degree isn't in Computer Science, but I really wanted to get into programming and I thought it'd be too difficult to get my foot in the door. But the job I've just got is at a tier 1 investment bank as a Developer, so now I'll get to do something I enjoy for a job, get paid really well for it, and live/work in a beautiful part of London. Not a bad place to start!

[@RockDavid]

@@HellO-ly1bp Hey its been a year since you posted this. Im a CS well Computer ENgineer, and i learning this stuff for last 3 weeks goign for 3 months strait. I wanted to ask What did they ask about what you needed to know about Python and what are you constatnly doing at your job with Python? Like type of things your coding or editing? Thanks and its very late but grats on the job :)

[@jedsonguedes]

I gotta say: it's so rare to find someone with such a great ability for teaching. You should do another one for XML parsing.

[@scochran3265]

What I love seeing in the below comments is people actually helping other people. There isn’t any bashing or calling each other names. Lovely.

[@coreyms]

Yeah, when I first started making videos I was worried about the comments, but this community of people is fantastic. Super nice and helpful.

[@tlrlutz]

Love the tutorials Corey they help so much in learning Python. Just thought I would update this video because the syntax is off around 8:00. The context manager "with open('new_names', 'w') as new_file:" will return a CSV file with a blank row in-between each row. The quick fix is to add "with open('new_names', 'w', newline='') as new_file:" and the issue goes away.

[@francescob1904]

thanks you so much, I was wondering about what I did wrong...

[@ugestacoolie5998]

@@francescob1904yeah me too and I was wondering why there was an extra line after each original line XD

[@Xaminn]

Every time I need help with a certain topic (and you've made a video on it), your video pretty much instantly solves my problem. I've spent an hour or so looking through forums and tutorials and this solved my issue in about 5 minutes. Thank you yet again for your expertise. 5/5

[@jingyuchang1885]

I just realized whenever I have a question about python, as long as I come to your channel, I can find the answer! Thanks very much!

[@melissamejianisonger3860]

I've spent a week trying to figure this out. I watched your video and it took me 10 minutes! THANK YOU. THANK YOU.

[@CuriousAnonDev]

Thank You sir, this lectures are still, in 2022, faaarrr more better than other so called tutorials It is difficult to believe someone gave such free high quality content years ago, you helped millions!!!! Thank You so so much

[@Alex-ht1oq]

You are so good at teaching man. I appreciate every video that you produce.

[@ryaxn_a7495]

nitty? oh, are you wondering why you have no friends? because when someone produces something absolutely amazing you don't notice it???

[@shermanmerman4944]

it's a compliment. get over yourself.

[@MyTube4Utoo]

+JDI2002 Seriously, the guy pays Corey a much deserved compliment and you manage to find fault with it?

[@al-farabinagashbayev5403]

if you have new csv file with blank lines this is for you # Python 2 with open('new_names.csv', 'wb') as outfile: writer = csv.writer(outfile) # Python 3 with open('new_names.csv', 'w', newline='') as outfile: writer = csv.writer(outfile)

[@MilanRihaMilan]

I had the same problem :P ...newline='' works just fine. Thank you. Great lectures, I really like the way you teach it. ;) not too fast, not too slow, good examples, easy to understand, really brilliant teaching skills ;)

[@jamesgu9223]

thank you, your way works fine.

[@kitayuan9842]

cheers brother

[@sergiomedina5520]

I was spending 15 minutes to resolve it until you saved me with your comment. Thanks a lot!

[@granberyacademia]

I wish I had read the comments... I couldn't understand why my code was f-ing me up

[@mediumshrimp9696]

I have never seen a negative comment on your videos. You are helping me get through this coding boot camp like you'll never believe. Thanks, Mr. Corey.

[@okayest_pianist]

how'd the bootcamp go bruh

[@mediumshrimp9696]

@okayest_pianist For me it was worth it. My class size was 17 or 19 and only two didn't get jobs right before/after graduation. Several of my classmates are going to college either while online/in person to get degrees. It is hard, our starting class size was 28. In my opinion, it's the way to go.

[@okayest_pianist]

@@mediumshrimp9696 love to hear it brother. glhf

[@atienograce2520]

I’ll be joining a data analytics bootcamp this September and this comment gave me hope.Yes,it won’t be all rosy but it will be worth it!Thank you!

[@ourcore]

I hadn't touched Python in years and I've learnt so much from your videos about requests/requests-html, reading APIs, and CSV files. Thanks so much!

[@hamidurrahman3183]

Brother Corey Schafer, your parents should be proud of you. You are a genius. Great at explaining. I have watched almost all videos of this python series. They are blessing to every python beginner. Thanks for all those videos.

[@coreyms]

Thanks! I appreciate the kind words

[@brunesi]

1:25 fun fact, when they're not comma separated, it's used dsv instead of csv. D for delimiter. In this sense, all csv files are also dsv ones. Just a tiny sidenote to another awesome video of this series.

[@satpatel9133]

Thanks a neat trick!

[@praveen0227]

I am a beginner in Python but whenever i watch your tutorials i feel its easy to write programs in python.The examples are very good. I wish if you can give some exercises based on the videos you show which will help beginners like me to write more programs.

[@devslaven]

Any time I'm hunting for information on Python, my searches always lead to you and I'm never disappointed. Keep up the great work!

[@ronitchawla4937]

I am taking Harvard University's online CS50 course and I could understand JACK about CSV file till I saw this vid 😂 .... Thanks a lot man 👍

[@mohammedadnan4976]

SAME

[@andrewpratt3861]

Me too!

[@codingwithlucy]

Me too :) just 5 months later

[@jpdeveer]

I am taking the same course and have found the instruction to be quite lacking. I would be completely lost without Corey

[@melancolique9835]

me toooo

[@Phii33]

Saved my life when doing my higher computing science coursework. Thanks so much!

[@elementalneil7967]

I was doing this Data Science course on Coursera, and the lesson on the csv module covered a load of content in a very short time. Of course, not understanding a thing, I had to revert back to KZbin. This video clears it up really well. Thanks.

[@NazachatGames]

Corey, you make me have two interviews and real oportunities for a job, here in Argentina. Thanks you a lot. I'm now a member of your channel, hope u the best.

[@QuarktaschemitSenf]

Thank you very much Corey. I switched job and now work with python. your videos helped a lot not to lose it in the beginning :-)

[@auditocanarsie7355]

You are a natural professor. I appreciate the clarity & completeness. The text is easy to read on a desktop but was a little hard for me to read on a cell phone. If there was a way to zoom in on the text so it could be easier to read on a cell phone that is the only thing that could possible improve this video. Either that or I just need to visit my Optometrist and your videos are flawless.😀

[@Vegito_Blue2]

Hi Corey, thanks for this video. For my interview tomorrow this is what I was looking for.

[@superliang2887]

This video is the best, I watched many videos on KZbin, only this one really help

[@goldenogregames]

For anyone getting spaces between lines using writerow method ( using python 3 ), you need to add newline=' ' inside open like this, open('file.csv', 'w',newline=' ') as ... : (the second with open iteration)

[@abbasali9730]

thanks man

[@jakubb2066]

thx

[@AndriHidayatParincahan]

I already searching for this tutorial for some years, but finally I found it here. I don't know if I didn't found your video maybe my life is more difficult. Hope you continue in making very good quality video like this. I must subscribe your channel . Thank you so much.

[@lmsnews7581]

years?? cmon

[@GiovanniGirelli1104]

Hello Corey, I just discovered your channel today and it is awesome. Funny that you cover all the topics I am interested in (Python, SQL, Pandas, MatPlotlib etc). For people like me who never even came close to going to college/university this is awesome. One topic I would really like to see would be a tutorial on (if at all possible) automating the process of extracting tabular data from PDF's using Python and convert them into useful Excel files (something I need to do on a daily basis at work). Awesome channel, keep it up!

[@vergilfrans1447]

Coding after long time...Feeling excited! Thank you for your tutorial. Easy to follow.

[@x0gucx]

Thank you SOOOO Much, even after 6 years this tutorial is so useful. my college professor just told use to do this with an article attachment and it's an intro class so I couldn't understand a single thing on there. THANK YOU FOR THE VIDEO TUTORIAL❣

[@raybilton6995]

Excellent series and I'm learning a lot from them. Your tutorials are my goto when I have a question. I really wish you had extended this video to include writing the two individual fields instead of just using delete. It would have helped with my needs more. I am working on a project with 20 fields in my input, but needing to write only 15 fields from the original file, and add two new fields to my 17 field output file.

[@miquelr2353]

Thanks for being so clear. Learning by yourself can be like decyphering hierogrypics

[@connorpayne7324]

very good, not only do you explain it very well, you explain each part of what you are doing and why. all in all a very good tutorial.

[@Lnmk_]

I would sell my soul to have you as a teacher for a day.

[@ziyauddin_mirzapuri]

be practical dear........

[@JV-jc7ci]

You have a very, very simple teaching style that makes it easy for newbies to understand. You're a great teacher! Thank you for the awesome FREE tutorial! This was so much more useful than online courses I am paying for!

[@madyrebecca]

you're videos are magic !! i love watching them , thank you so much !!!!!!!

[@MyTube4Utoo]

+madyrebecca Corey's videos are 'magic.' I've started on Python books that just bored me. I've used Udemy, CodeCademy, other KZbin videos, as well as countless other tutorials, but *nothing* has helped me nearly as much as Cory's tutorials. So yeah, "magic" applies here. I bet he's a warlock! lol

[@李永胜-g2w]

best python tutorial I ever watched

[@chaitanyayeturi1312]

First of all, your teaching style is good, and anyone grabs ur teachings easily, and thanks for teaching us. you are the best tutor I have ever come up with in python language. can u suggest any python language book, which is best to go through other than your channel? Moreover, I am a beginner to python language I thoroughly enjoyed ur videos, if u can suggest me best python book to ur sensibility and I guess it suits me and it helps me to learn further (I like physical like books). In case if u written any books related to this language can u suggest one (or) your favorite book, please......................................

[@muralidhar40]

I can not quite put the finger around it, but your teaching is magical!

[@MexicanPickleTamarindo]

Better than my professor! Thank you.

[@fet3595]

1:06 csv = 'comma separated valued' "And what separates the values is called a delimiter. So the 'comma' is a common delimiter. But you can use just about anything. Sometimes you will see files with tab-delimited values or dashes or things like that but they are called csv files."

[@jykw1717]

YOU ARE GOD OF PYTHON

[@luminamoon504]

Total life saver, I needed this for a project due today, thank you so much!

[@valeriewang6244]

OMG Corey you are soooooo helpfullllllllllll. I love you!

[@soumyazyx]

Thank you Corey for your time and effort. Keep spreading the knowledge.

[@Nkraka]

First of all Corey, I will like to say that you're an amazing teaching. You've inspired lots of people especially someone like me that is pretty new to Python. Your videos are awesome. Just keep up the good work we really do appreciate you. Thank you! With that been said, Corey, I have been searching and googling almost everywhere like stack overflow and many other python communities to see if I can at least find maybe an examples on how to work on or handle large files in python -- files ranging from 100 GB and up. Unfortunately, I haven't seen anything that actually explains the concept clear enough. So, I was wondering maybe if possible if you will consider making a video just for that purpose. Basically, the program should be able to read, chunk and write the file(s) or segments into a folder based on numbers of lines or size specified by the user. Please I will really appreciate it if you can help. Thanks in advance!

[@coreyms]

I don't have a video specifically on large files, but if you watch my video on File Objects, I do go over reading a file in chunks. If you search my channel or Python playlist for "File Objects" then you should find that.

[@MelanieCrypto]

refreshingly thorough and helpful ! thanks for posting this

[@aldrinmagnoa9874]

You make everything so simple to understand. thank you so much!

[@shivrankrishen]

Short and down to the point.You Sir you're a God Sent.

[@TheFrazerboy]

excellent stuff definitly helping with my masters project

[@muhammadnaveedkhan6739]

Excellent work Sir, Your teaching style is awesome.

[@mrmahonrie]

I just found your channel! Come on man, come back to KZbin: Your tutorials are great!

[@mjordan1117]

Im just happy he seems ok, at least he quite active on twitter

[@Imran20091990]

Before watching Corey video.. i always hit like..

[@emilyncozzens8309]

This is the best tutorial the I never found! Thanks so much!

[@shaunakalshi4547]

Thank you for the tutorial.Helped me a lot in my miniproject.

[@FisVii77]

man you are a very good python presenter, keep up the great work and vids.

[@michaelpadovani9566]

Hey thanks for posting this, I'm very new to Python (and watched a lot of your other tutorials). I'm a meteorologist that works with instrumentation datasets so i live and breathe HUGE csv files lol Hoping to use this method tutoring a local HS student for his project. Thx again and cheers from Maryland!

[@ozodbekulashov2325]

Hello Mr Corey ! Thanks for this incredible content!

[@Ninja-iq2xt]

I think and i hope you are on a path on start tutorials on pandas, and i guarantee that it could be the blockbuster series, people will love your quality videos and teachings. Their are no quality videos on pandas on youtube.

[@SandyGirousse]

I like yours video. My english is poor but i learn a lot of things with your channel. Thanks ...

[@CatBlack01]

15:17 This works too: # use extrasaction='ignore' to ignore any fields not specified in fieldnames with open('names.csv', 'r') as csv_file: csv_reader = csv.DictReader(csv_file) # newline="" prevents double spacing with open('new_names.csv', 'w', newline="") as new_file: fieldnames = ['first_name', 'last_name'] csv_writer = csv.DictWriter(new_file, fieldnames=fieldnames, delimiter = '\t',extrasaction='ignore') csv_writer.writeheader() for line in csv_reader: csv_writer.writerow(line)

[@AK-kj8cc]

You are very thorough in your explanations. I've subbed and I hope you keep this up!

[@akram42]

to be honest you're the best instructor I've even seen on youtube, can you please make tutorial on simple website that when the user submits a form python code will run to get for example google result . I've been trying to do this for a while now still no luck. I just what to figure out how to run python code from html whenever the visitor searches or interacts with the website.

[@coreyms]

I would really like to put together some web framework tutorials. I have some scripts in the making, but it will likely take a while longer to get everything recorded and edited. Hopefully in the near future.

[@trying2understand870]

I really enjoyed this tutorial as well as all of your other tutorials that I have seen. I was wondering if you had shown a method for updating csv files?

[@husseinabukar7081]

Absolutely, fantastic video and simple to understand it. Many thanks for your time and efforts

[@impact_k]

This is fantastic, no lies. Thank you very much

[@asifahussain899]

U are great Corey Sir ... waiting for Ur 1 million subscribers ❤️

[@sameerk12982]

Thank you very much Sir for creating such an easy to understand tutorial about reading writing csv file.

[@kirupv]

You covered very well through explaining simple way. Thank you very much

[@kevinflanigan8653]

For Windows Python, to eliminate the blank rows between entries when writing, add the newline=''' parameter when opening the new_file for writing. "with open('new_names.csv', 'w', newline='') as new_file:"

[@johnpitic1124]

Thank you man i will pass my gcse

[@converti76]

Super useful! Thanks dude!

[@ricardolazaro1766]

Awesome video, I very easy to understand! Thank you for the awesome video!

[@alanshackelford6450]

Why this wasn't part of my introductory Python class, I will never know. But, thanks to you, it really doesn't matter.

[@letshev]

Corey, you are the best. Thank you.

[@kgsanjuana]

You are amazing! Thank you so much!!!! I have a better understanding of csv and can apply it to my school assignment.

[@assasin101011]

don't go to school just code in your house and you can get a job in no time I promise you that. I'm 100% sure i swear this to our generation and mankind

[@mahodaadikari4116]

Thanks for the wonderful explanation ❤💫💪🏼

[@allasrinivasulu1464]

Superb sir you make me to learn a lot

[@organizedchaos4559]

Great video, very informative and helpful. You make it really easy to follow and understand

[@cyperdevelopment]

Your introduction voice is amazing!

[@nonalcoho]

I hope someday I could teach people as you do to us!

[@zorojuro5106]

thanks brother

[@nikluz3807]

if you don't use the newline parameter, writing the data to a new file will result in every other line being skipped. to alleviate this, use the newline parameter newline='' that is newline with two single quotes with open('new_names.csv','w', newline='') as new_file:

[@superdude292]

That was super helpful thanks, and to be more clear for anyone else those are two single quotes next to each other, not one double quote

[@nikluz3807]

Charlie Skinner no problem!

[@tinnick]

Hi Nikki, I haven't really tried this yet so I don't clearly understand but, I wanted to know why this happens when writing the data. In the video the newline parameter was not passed but did not skip any lines. In what situation would it be skipped and what is the reasoning?

[@nikluz3807]

tinnick great question. I am actually not 100% sure to be perfectly honest as I am not an expert. The only logical explanation I can come up with is that the csv module has been updated since the video and the newline parameter was introduced in one of the updates. Modules are constantly being updated, as well as their default behavior. It’s just part of programming. Sometimes this can even break your already perfect application, leaving you to read through updated documentation to see what has changed. I hope this helps you.

[@lightninginmyhands4878]

Just what I was looking for!

[@egonz7194]

just what i needed for my problom set thanks bro .

[@klatie256]

Bless you sir you just saved my computer science mark T_T

[@danmuniz1354]

Thanks Corey. Very Helpful! Cheers!

[@tobbysorama]

You are an awesome tutor!

[@marcello4258]

lovely back in college when I learned this with java I had to code all by myself incl logic for escaping ;)

[@mjprescotti]

This video was worth the viewing I wish I had found this days ago:)

[@hadishaaben3665]

You are Awesome i used thes codes as a mad man .. I loved it

[@Pur3Tzhaar]

Thank you AJ Styles :)

[@pushpajitbiswas3752]

You got some real talent man, I'm really appreciate with your video.

[@albertbatfinder5240]

Corey, the only tricky thing about csv is when you have to deal with special characters within data fields. I don’t think you demonstrated how to handle quotes within strings, or other escape characters such as newlines. Also, it is really bad in an instructive piece of code to use variable names that too closely mimic language keywords. Fieldnames=fieldnames, for example. Or csv_reader = csv.reader(...).

[@diggable]

awesome, my first CSV read\write tutorial! thank you sir! -------------------------

[@amanuelsiyum4537]

Very helpful videos, keep up the good work!!!!!

[@MachineLearning-mv8zb]

Master... teach me more... need more, more, more. Thanks

[@madhavinaidup6095]

Simple and clear Explanation Corey. Thank you.

[@brutuswallus]

Thanks for share your knowledge with Spanish subtitles!

[@coreyms]

You're welcome. It is actually people in the community who occasionally submit translation subtitles, so I have them to thank for that!

[@datag1199]

Great tutorial - thank you! Subscribed

[@timo_b3]

Awesome, thank you corey!

[@peterfconley]

Thank you so much.