Working with CSV files | Day 15 | 100 Days of Machine Learning

The CSV file format is a popular format supported by many machine learning frameworks. The format is variously referred to "comma-separated values" or "character-separated values."
A CSV file stores tabular data (numbers and text) in plain text form. A CSV file consists of any number of records, separated by line breaks of some kind. Each record consists of fields, separated by a literal comma. In some regions, the separator might be a semi-colon.
Typically, all records have an identical number of fields, and missing values are represented as nulls or empty strings. There are a number of ways to load a CSV file in Python.
============================
Do you want to learn from me?
Check my affordable mentorship program at : learnwith.campusx.in/s/store
============================
📱 Grow with us:
CampusX' LinkedIn: / campusx-official
CampusX on Instagram for daily tips: / campusx.official
My LinkedIn: / nitish-singh-03412789
Discord: / discord
Instagram: / campusx.official
E-mail us at [e-mail]
⌚Time Stamps⌚
00:00 - Intro
00:54 - Process of Gathering Data
04:45 - Different types of file formats
05:45 - Code Demo with Jupyter Notebook
06:35 - Methods to handle CSV files

[@749srobin]

bhai dil jeet liya tune , kash march mein hi mil jata tera channel

[@VishalGupta-ji7yo]

izzat kar le bhai thoda

[@yahyakhan3626]

@@VishalGupta-ji7yo me bhi aj dekh rha

[@harneksingh960]

Literally Speaking. the way of teaching by u Sir is appreciable, I have learned ML from ZTM but your course is enormously so much useful and understandable.....Warmed Respect for u Sir

[@jinks3669]

Best channel on youtube. It's channel's like yours that make social media worthwhile. Dhanyavaad dost

[@AbdulHannan-dg6dl]

Bhai ap great ho !! khush rho.. bht kch seekhne ko milta hai ap sy hats off to you Love and lots of respect from a student from Pakistan 😍

[@nishitaverma8805]

Amazing! I was in search of such detailed explanation video and I found this playlist. Thank you for your effort.

[@Cha_Nu6]

metoo

[@yandeshubham8657]

One of the best channel for learning ML Thank u so much sir for improve my knowledge. God bless u

[@viditvaish7317]

amazing sir ,bahut zayda baareek cheeze explain kari hai aapne thanqu sir

[@user-ni4qi9gf6c]

sir your explanation is very clear and in right pace, clear understandable content and warmed respect from me waiting for deep learning and nlp complete playlist thankyou very much.

[@ashutoshkanojiya7380]

31:10 If you want to shorten all the team names, you can use the following code: def rename(name): list1 = name.split(" ") temp = '' for i in range(len(list1)): temp += list1[i][0] return temp

[@tanveerbashir8393]

interesting, informative and amazing lecture

[@sanskaripatrick7191]

For anyone confused, Skiprows is a parameter which is 1-indexed, if you pass in 0 then it will actually remove the column names since the parameter treats the column names as the 0th row. So in a sense, while it technically is 0-indexed, it considers the column names as the 0th index and so we have no use of using that. This makes it 1-indexed in use.

[@abdulaziz-vm7yh]

yeah even i did noticed that, i dont know why they consider column name as 0th index

[@user-bm2fi5wm8m]

Thanks a lot for making this playlist. really appreciated.

[@narendraparmar1631]

Very Easy Explanation. Thanks sir ji😀

[@DataScience111]

Amazing sir. Hats off to you

[@shariqmeyraan2373]

You are a gem.. Kudos for such amazing content!!

[@shariqmeyraan2373]

How can I contact you? I want to be your student!!

[@shamaila3]

You are doing a great job brother, respect and appreciation from Pakistan👍✊

[@swethasree5684]

Very useful video. Thank you sir

[@zkhan2023]

sir, you put all your effort to produce good content keep it up sir

[@PyMLHub]

Learning with great understanding with you Sir, I hope this will help me in my next Course of Generative AI.

[@vishnujatav6329]

Sir, you are a real hero

[@jawadchaudhry2648]

Kamaal ho Sir g ap ... God Bless u

[@sidindian1982]

one of the best content for ML platform ,.... Sir you are GOD 🙂

[@user-bt3hy4ny2w]

Very helpful video

[@RajatKumarhey_sparkerr]

Love your contents ❣️

[@niteshbutola8753]

awesome explanation bro keep it up

[@prathmeshfutane1247]

Awesome Explanation Javascript Object Notation

[@shubhamchoudhary5461]

luckily i got your channel..thanks !!

[@preetisrivastava1624]

Sir aap best ho

[@user-tx2rk9uu5b]

i was looking for UTF-8 error .thank you boss🙏🙏🙏🙏🙏

[@tahimakhatun3208]

It was very usefull. thanks a lot...

[@akashgawande4118]

sir you are the best......

[@paragvachhani4643]

Maja aagya sir...🥰

[@sahibnoorsingh2432]

Loved your videos, Please make videos on advanced robotics as well

[@Naman_Bansal102]

Very Intereseting Video

[@ArunKumar_237]

Thank you so much sir 🙏🙏

[@vivekyadav-zx1kw]

U just doing great..

[@nihalwaseem7106]

Bahut badiya content tha, as a beginner bahut kuch seekhne ko mila. Thank you sir , aise hee ML videos aur b chahiye 💜

[@ilggaming321]

bhai 4 hajaar ka course ma dought aaya fir link milla saare dougt solve ho gaye

[@MuhammadJunaid-yr8jd]

thank you so much

[@JustPython]

very good videos

[@sandipansarkar9211]

finished watching

[@sameerabanu3115]

superb

[@avinashglpaccountancy999]

thank you for showing direction, #ML, #Machine learning,#MACHINE LEARNING, # csv, #HOW TO OPEN CSV IN PANDAS...... --- following the path

[@noorelahi4792]

Why people are spending lakhs of rupees in the institute? I have been going through various institute videos but now here i got the real thing within a month I'll be the data scientist.

[@duitakarbhat]

Did you become one?

[@yogeshkhanna5173]

Did you become data scientist or data analyst

[@monoarul_islam_3]

19.01. If you use 0 then it will refer to the row which incorporates the column names. So actual rows start from 1 onwards. And this will resolve the issue.

[@monoarul_islam_3]

35.26 you need to use chunks instead of chunk.

[@umangsinghal5403]

Maza aa gya

[@mahfuzraihan8690]

love it

[@atharvkazarid2-354]

in skiprow part the main rows of data are starting from index 1 not 0 , when u was doing 'skiprow[0,5]' u was deleting the header row and the 4th row sir...

[@stevegabrial1106]

How to filter csv file in which words with mixing of aplha and numbers. Can we see GNN in upcoming videos with lot of examples. Thax

[@UnpluggedSalman]

sir can you please share the ipynb file probably with all the dataset link.

[@manujkumarjoshi9342]

Lovely

[@parikhgaurav2111]

create a video on data warehouse , no sql data bases and big queary . [ explain data marts , data lakes, pipelines and etc in details ] [data engineering in depth]

[@balkrushnaparkale7094]

Thank you so much for beautiful content. But how to handle txt file?

[@x2diaries506]

I have some questions regarding the header. It is associated with the OS and browser. How can we use the same header from different OS and browsers?

[@sachin2725]

Hello Sir, XGBoost is not included in playlist, could you please make a video on XGBoost ?

[@subhanjalpant8824]

where do i get the dataset used in this video

[@user-lw6ng1vd7v]

Where i find my headers and how to get the header??

[@rishavchaba3565]

At 35:20 how the hell is this not throwing an error ? i mean "chunks" in dfs and inside loop there is variable "chunk"

[@drawing8780]

How to take User input for CSV file and process it

[@aviralasthana3672]

Where to get the jupyter notebook

[@NickMaverick4]

Sir can we also do that we can paste that CSV file in notepad and then, open that text file in Excel and save it as CSV. By this we don't have to write code for opening a CSV file from the url.... Please reply is the right way to do.. or writing code is necessary..

[@aayushisolanki2935]

greattttttt

[@parthpatel473]

HI, SIR HEADER IS SAME WHEN WE OPENING A CSV FILES FROM AN URL.

[@shubhamdhole5160]

where is link of codes and datasets? plz help

[@shahmdnazmulalam9620]

Sir, How do I load the dataset from the github. please ....

[@saumyashah6622]

sir can you please share google drive link which contains google colab of examples of all the parameters which we discussed today along with the datasets

[@campusx-official]

Check description

[@anshukumaria4-115]

can you please share github link of this notebook?

[@suhaibdata]

amazing.....superb

[@user-zc3pg2fj4o]

can you provide the csv files

[@whatdidilearntoday6369]

Bro , if i just run pd.read_csv(url). Then also it works. isnt it?

[@campusx-official]

Yes

[@shiwamkumar5979]

Notebook kha hai?

[@madankhatri7727]

encoding='ISO-8859-1' works for all file

[@Garrick645]

Where can we find the jupyter code for this video

[@mango-strawberry]

were you able to find it?

[@mango-strawberry]

@@Garrick645 which link?

[@Garrick645]

I'm pasting the link but KZbin is not letting me post the comment

[@Garrick645]

@@mango-strawberry just see his next video in the series, the link to his GitHub is given in the description box. You'll find all the days files over there.

[@mango-strawberry]

@@Garrick645 thanks I was able to find it.

[@Headstrongyt]

Sir, please provide notebook. Thank u.

[@SATYAMSINHA-qi5vj]

inn sab ke github codes kaha available honge sir ?

[@mathics2869]

If u got the link pls share with me

[@shubhankarsharma2221]

erorr bad line deprecated to on_"bad_line

[@satyazigyansu6873]

ir url se csv read nehin ho pa raha hai

[@23MMA002_IQRAKHAN]

kahan hai github ka nb link?

[@shreyasur1534]

sir dataset share kar dijiye pls

[@mathics2869]

If u got the link pls share with me

[@sigma5391]

sir aug_train.csv file khul ni rahi hai

[@SauravSharma-c9o]

where is the link of notebook ?

[@mohammadrizabul]

have you got it ?

[@kushagra4401]

23:00

[@krishnakanthmacherla4431]

Done

[@prithvigupta8215]

25:00

[@rajchoure03]

sir please share the source code for this tutorial

[@harshshukla980]

github link bhul gaye kya daalna?

[@vinodbarti9237]

import pandas as pd import numpy as np pd.read_csv('placement.csv', na_values=['cgpa']) sir this isnt working

[@iamsachinnegi]

What thinking u performing here u should give name to file then run ..

[@prithvigupta8215]

29:38

[@user-iv5fr9mr2n]

11:00

[@alokdhiman755]

Javascript object notation

[@quancume]

who noticed ' hyd trip ' 🤚🤣

[@deeptisharma90]

at 17:32 squeeze is no longer supported that way. updated version is like this - pd.read_csv('aug_train.csv',usecols = ['gender']).squeeze()

[@sasta-koder]

Hi, here is a code snippet which can also be used to get encoding info : code: import chardet with open('spam.csv', 'rb') as rawdata: result = chardet.detect(rawdata.read(100000)) result O/p: {'encoding': 'Windows-1252', 'confidence': 0.7272080023536335, 'language': ''} here this is encoding: Windows-1252

[@DataScience111]

Amazing sir. Hats off to you