Project - 8 | Data Analysis with Python |

[@data_science_lovers]

Download Source Code of this project (Rs.29) - rzp.io/l/project8sourcecode Download - Python Data Analytics Course Notes and Projects Source Codes ( Rs.250 ) - datasciencelovers.graphy.com/products/Python---Data-Analytics-Study-Material-64d7b0bdfd6efd7c4587e233?dgps_s=dsh&dgps_u=c&dgps_uid=64cb5694e4b000cf748a30c2&dgps_t=cp_m Get our "Self Study Material", which includes all the Projects Source Codes and Notes of the complete Data Analytics course, which contain all commands of Core Python, Numpy, Pandas, Matplotlib, SQL that we use for Big-Data Analytics ( cost @ Rs.250 or $20 or €20 ) Contact Mail Id : [e-mail]

[@293...]

Can I upload this project on GitHub?

[@Therealumerhayat]

19:07 write this code to avoid error df['Date_N'] = pd.to_datetime(df['Release_Date'], errors='coerce')

[@komalrawat-ss1pw]

Thanks buddy❤

[@abhishekchintamani9005]

doing this I am getting different counts for this code................ df['N_Date'].dt.year.value_counts()

[@Neeraj_999]

Thanks bro

[@38_c_shivanikesarwani70]

Thank you now this command work properly 😊

[@timohubsch4281]

This tutorial is awesome! Just one annotation for Question 10): After using str.split(), the new columns "Minutes" and "Unit" are formatted as a string, like you mentioned in the video. To get the correct answer of the max() and min() function, you have to convert the values of the column "Minutes" into integers. Otherwise the min() and max() functions will not work properly. data[["Minutes", "Unit"]] = data["Duration"].str.split(" ", expand = True) data["Minutes"] = data["Minutes"].astype(int) data["Minutes"].max() data["Minutes"].min()

[@ruchikakhandelwal7671]

59:32 max value are wrong because our dataset are in object as you told in video. so we have to change dataset into int. code-- df['Minutes'] = pd.to_numericdf(['Minutes']) you can check df.dtypes (its convert object to int) aferthat run df.['Minutes'].max() result is 312 . I commented because if someone finding how to change object to int . this comment help them . thank you @datasciencelover how wonderful series .

[@sairajmarshetty7152]

its giving error pd is not defined

[@sairajmarshetty7152]

where to initialize exactly that to clear pls

[@data_science_lovers]

First, import pandas as pd

[@bidip3765]

@Ruchika. I agree. converting into time format will be more specific, I think!!!

[@UMESurajKumar-lz9vd]

thank u Ruchika

[@cococnk388]

Hello Sir, thanks for the great job. For question 10.. We are missing two important facts : Duration column has values with two types of units : seasons and mins We cannont just find the max of the column after applying the split function. More to that after we do the split it is good to change the column with number values to int We have to find the max by filtering on each Category type ( movie and TV show) Here is my query : netflix[['Number', 'Unit']] = netflix["Duration"].apply(lambda x: pd.Series(str(x).split(" "))) netflix["Number"]= netflix["Number"].astype(int) netflix_TV_Show = netflix[(netflix["Category"]== "TV Show")] netflix_TV_Show[(netflix_TV_Show["Number"] == netflix_TV_Show["Number"].max())] netflix_Movie = netflix[(netflix["Category"]== "Movie")] netflix_Movie[(netflix_Movie["Number"] == netflix_Movie["Number"].max())] Thanks.

[@dwaipayansaha4443]

We need to change it to numeric to get the maximum duration:- The code is:- df[['Minutes','Unit']]=df['Duration'].str.split(' ',expand=True) df['Minutes']=df.Minutes.astype('int64') df.Minutes.max() 312 will be the answer. But I have a question here. What will be the duration of shows consisting of seasons? We didn't take that into account.

[@jumokeakinyemi1992]

Still not getting it. TypeError: not supported between instances of 'str' and 'float'

[@datatech4644]

but its data type is 'object' brother

[@uzi110]

data.groupby('Category')[['Mints','Cat_Duration']].max().reset_index() Category Mints Cat_Duration 0 Movie 312 min 1 TV Show 16 Seasons

[@nverma2002]

All these projects helped me build the most important part of data analysis/science which is to 'think questions' in data and finding the solutions using tools like pandas and python language. Thanks for providing the content DSL.

[@riteshpardeshi9866]

This page is very underrated. Others don't provide such great content. I have done all the projects of this channel related to Data analysis. Looking forward to a more advanced project that will help me to enhance my Python skills in Visualization. Data Science Lover Please provide more content related to seaborn, plotly, matplotlib, numpy.

[@hera-12]

How long does it take to finish the projects

[@bhawnachauhan4237]

Can i add this project in my resume?

[@samuel_muly]

One of the best channels I have ever come across. Q.10, add this line of code to get accurate results>> data['Minutes'] = data['Minutes'].astype(float)

[@muzammilgoraya]

got error

[@durantuserfa1674]

@@muzammilgoraya data['Minutes'] = data['Minutes'].astype(''float')

[@muzammilgoraya]

Good

[@Mwalimu-wa-Math]

very useful peace of work it helped a lot but i have different idea when it comes maximum duration for a movie or a tv show i think its better we separate the column duration into minutes and seasons by using simple code from chat 😂😂 # Step 1: Create 'minutes' and 'seasons' columns df['minutes'] = df['duration'].apply(lambda x: int(x.split()[0]) if 'min' in str(x) else np.nan) df['seasons'] = df['duration'].apply(lambda x: int(x.split()[0]) if 'Season' in str(x) else np.nan) and then find minimum and maximum duration for a tv show or a movie as well as for season. why am i suggesting because where you find minimum duration you got one that one is for a season not for one minutes otherwise i thank you a lot for discharge this knowledge carelessly on youtube 🤣🤣🤣

[@badmice1]

I really like that you highlight the functions and methods you cover in the tutorial. This helps provide technical learning objectives many other videos do not cover. Great job.

[@adhytiamps622]

Q. 2) In which year the highest number of the TV Shows & Movies were released ? Show with Bar Graph. i have problem with this code : data['Date_N'] = pd.to_datetime(data['Release_Date']) how to fix it?

[@juliacosta9308]

I solved this problem by adding a format="mixed". data['Date_N'] = pd.to_datetime(data['Release_Date'], format='mixed')

[@ricktikra9579]

@@juliacosta9308 thank you for sharing this insight, I was facing the same problem.

[@paulaji]

for question 8, we can convert the datatype of Cast column from object datatype to String and then use the following syntax to search for Tom Cruise: dataframe['Cast'] = dataframe['Cast'].astype(str) after that, dataframe[dataframe['Cast'].str.contains('Tom Cruise')]

[@rohitsinha1092]

thanks for mentioning i was thinking about this as well because the cast is in the form of a list converted into a string same goes with type as well and when you do this you get 2 movies with Tom Cruise in them while in the video we get none

[@shahnooralam7257]

Worth watching but instead of imputation you went for data drop which is not ideal. During data cleaning ideally should go for imputation like mean, mode etc. Data drop will cause loss of data. Just a thought 🙂🙂

[@aflyingtoaster6096]

If the portion of missing data is small enough , it can be safely dropped!

[@38_c_shivanikesarwani70]

Great video sir, Thank you for sharing this Project 😊

[@DeepakSah3.0]

Thanks it was very useful. I binged watched along with hands on Jupyter notebook.

[@prajjwaljaiswal3419]

Appreciate video but there are few Mistakes like in Q.10 maximum duration movie df.loc[df['Category'] == 'Movie'].groupby('Category')['Numeric_duration'].max().reset_index() Category Numeric_duration 0 Movie 312 Similarly , there are other mistakes Q.13 , either question is not framed properly, or Solution. There is mismatch .

[@uzi110]

data.groupby('Category')[['Mints','Cat_Duration']].max().reset_index()

[@panther_.gaming]

we cant directly apply .max() to a string column becoz we know 90'120' . we need to change it to integer first to apply max

[@sahilansarivlogs9788]

Q1. Answer. df[df['Title']== 'House of Cards'] , can we also use this

[@arykurniawan7944]

thank you for your information. I have trouble with this command. --------------------------------------------------------------------------- NameError Traceback (most recent call last) Cell In[1], line 1 ----> 1 data NameError: name 'data' is not defined

[@vinay_bhagat9075]

great efforts taken in making of this video thank you sir

[@NISHANTKUMAR-hm1pz]

Correction Sir, 58:33 Q10 me jo duration of Movies/TV Show find krna hai na, who jo 99 aaya hai woh galat hai. Dataset me 312min max value hai, ye jo aap ne units and values split kiye hai na us ke baad Object data type ko int data type me convert krne ke baad max value correct aayega.

[@manmitapatnaik2513]

19:26 why am I getting error here ? It's showing wrong regarding the format. Can anyone help ?

[@jjr7303]

Hi, I had the same problem, the solution is the following code: data['Date_N']= pd.to_datetime(data['Release_Date'], format='mixed')

[@mamondhar1823]

Really so nicely explain, thanks for your learning process.

[@data_science_lovers]

Thanks You can enroll in our udemy course to get certificate - www.udemy.com/course/bigdata-analysis-python/?referralCode=F75B5F25D61BD4E5F161

[@pranitaz9055]

Thankyou for making this detailed video, it helped practice python and pandas skills.

[@AkmalMirza_29]

bro after finding the null values how to handle we can't remove that much records from the data set right , so how to overcome up with this

[@abhishekchintamani9005]

In Q3. Addtion of movies and tv shows gives 7787 , while after cleaning the available rows are 4809. Can som1 explain this?

[@vaibhavpatharkar6794]

Sir you teach fantastic, pl take sql in hindi. I request u on the behalf all students

[@aishwaryapadmanabhan5352]

facing error with sns.countplot(data['Category']) with ValueError: could not convert string to float: 'TV Show', can anyone guide me here?

[@mahetsiedahi6530]

add X in the code...sns.countplot(x=data['Category'])

[@nguyenthikieuoanh8966]

@@mahetsiedahi6530 thank you so much. It's so much helpful for me

[@kazkaz9744]

This is the best tutorial video, I watched and practice all 8 of your youtube. could you start showing us how to use matplotlib or numPy in the tutorial video also. Thank you so much!!!!!

[@data_science_lovers]

Sure Thanks

[@imanbanerjee8276]

@data_science_lovers. the records those the duplicated function returns are not duplicates, values on most of the columns are different. Could you please check and explain what is going on here?

[@vijaymulimath6519]

10:03 can u explain me how these 2 rows are duplicate??

[@sandeepjangid4012]

For first question we can directly use this data[data['Title'] == 'House of Cards']

[@vishalbisht5343]

For 11th Question, you have to segregate the data by split method and then use set_index,stack, reset_index function in it.

[@system1013]

hey bro, can you help me with the code if we wish to do 'cluster analysis' in this project

[@ossimisylvestre7484]

Very pratical and great content, thank you !

[@voiceofmind33]

Just now completed all project and practiced on the dataset given. Thanks a lot for creating this playlist. I hope you can make the series on visualization libraries. Also How can I raise different types of question by looking at dataset . as you have posted various question in description i felt very easy to solve it. But raising good question by looking at dataset which can generate insights. any Recommendation ? please reply..Thank you!

[@partabparmar5537]

thank you so much sir, for such a amazing content. God bless you

[@drdeepurahulful]

Can you do a video on Transport Optimization using the Pulp library. Using DHL or any other data set. I would love to learn it .

[@aryansfunzone]

Great video,Thanks

[@deepdeeps90]

Df[['Minutes',' Unit ']] = Df['Duration'].str.split(' ',expand= True) I am not getting this it throws valueerror: column must be same length as key)

[@aayushgautam4324]

@16:59 what if we dont know the spelling of the house of cards ? then if we use isin It shows no record which is logically not correct. What to do in that case?

[@ajinkyasalunkhe4081]

df[df['title'].str.lower().isin(['house of cards','blood & water'])]. Hope this helps

[@narendra742]

Thanks , very much use full.

[@abdulwahab-mf2cm]

Amazing Video

[@data_science_lovers]

Thanks You can enroll in our udemy course to get certificate - www.udemy.com/course/bigdata-analysis-python/?referralCode=F75B5F25D61BD4E5F161

[@panther_.gaming]

sir i have a doubt....inorder to show the top 10m directors shouldnt we need to split the multi-directors??

[@nimratkaur6153]

Hey could you pls make a proj that can be put in resume..really looking fwd to it.. Love your channel :)

[@sunilkumarjadala]

Q.10.What is the maximum duration of a Movie/TV Show on Netflix. Given answer '99' seems to be incorrect as if is fetching from a object dtype use below line to convert object data type to float and fetch max value of it max(data.Minutes.astype('float')) Will give result of '312.00' DSL team is doing good job and i would like to watch more informative videos on Data science

[@samuel_muly]

correct💯

[@deepeshsharma2718]

in which type of analysis will you classify this one into? Descriptive Analysis. Exploratory Analysis. Inferential Analysis. Predictive Analysis. Causal Analysis. Mechanistic Analysis.???

[@varunpatil7226]

descriptive analysis. cuz we are not interpreting anything or drawing conclusion from it. we are just describing it.

[@system1013]

@@varunpatil7226 hey bro, how can we do 'cluster analysis' in this project

[@dilipy6676]

@@varunpatil7226 bro can I add this project to a resume? and can u suggest the best description to this project

[@data_science_lovers]

For resume project, kindly send a mail to [e-mail]. We will reply back once we get an appropriate project.

[@shrutisharma4171]

@@dilipy6676 have you added this inyour resume? do let me know the description

[@yashrajsinghrawat]

Have you framed these questions yourself only or it is given in the dataset? Because on Kaggle I barely found datasets with tasks. Do we have to create tasks by ourselves?

[@sakibimtiaz2776]

For every datasets, you must have to ask primary research questions that you want to find out throughout the data analysis process using statistical procedures, coefficients and correlation, regression etc. Your questions should be relevant according to the given variables.

[@mohseenmohammed46]

sir thank you so much , learnt a lot

[@Tstudy22]

Thank you

[@atulanand4824]

Its a request please make a playlist for ML and Deep Learning projects❤️

[@AshishJaimini]

great content

[@chetansrao]

Hi. Thanks for the informative video on DF with filtering and other concepts with tasks. Can you tell me HOW to filter UNIQUE countries from COUNTRY column and plot them as pie chart or other suitable chart... Am unable to do it.

[@minalgupta7456]

I like your videos

[@vishwashah8318]

Good Video

[@bhuvan2998]

In my entire life to watch a video continue the series in you tube your tutorial video only. It was very help full for my skills thank you💥💥💥💥💥💥💥💥💥💥💥❤‍🔥❤‍🔥❤‍🔥❤‍🔥❤‍🔥❤‍🔥❤‍🔥❤‍🔥❤‍🔥❤‍🔥❤‍🔥❤‍🔥❤‍🔥❤‍🔥❤‍🔥❤‍🔥❤‍🔥❤‍🔥❤‍🔥❤‍🔥❤‍🔥❤‍🔥❤‍🔥

[@asp4628]

Do more real world project end to end

[@Vved345]

What is the best suited title for this project?

[@akshanshbhardwaj60]

Thank you very much sir

[@SohailKhan-wt4ic]

Is It Good To Keep This Project In My Resume ?

[@Manojkumar-vh4tc]

Yes for sure , if you're a fresher

[@Somnath-je9nd]

@@Manojkumar-vh4tc hi manoj can I get job using these projects Iam fresher currently finding difficulty to land a job .please guide me bhai , dont know what to do tried everything to get job as data analyst .can these projects help me .i dont know what actual work in real life data analyst do .please help and guide me thank you

[@MBA_DREAMER]

Have u got the job

[@MBA_DREAMER]

And whats helped u to get it

[@aruji-sama]

​@@Somnath-je9nd you will never get a job by copying youtube tutorials as most data analyst will know a tutorial from a original project. Work on your own project where you actually solve a problem. In real life various different type of businesses hire data analysts firms to make business strategy and forecasts. For eg: A pharma company would like to know how many people in india can use their medicines, etc

[@CoachPegasus]

Thank you for great support and teaching. Could you share your word file -Core Python ' please?

[@kryurr]

There is a correction at 59:00 where we were finding max duration of a movie. -- Your answer for df.Minutes.max() = 99 is incorrect as 'Minutes ' was still Object . -- To sort this , we can convert Minutes from Obj to int using --->. df['Minutes'] = df['Minutes'].astype('int') -- After this , df.Minutes.max() Output will be 312

[@ffgaming-fe3cx]

This is so cool

[@radyoalmikyel6881]

Insteat of : data.groupby('Category')['Category'].count() can we use data.('Category').value_counts() also??

[@tshepomaila184]

Hi when I read or load the dataset it does not appear the way it appears in your videos.what can I do please help

[@vivekshah8905]

What skills do i need to get an internship for data analysis

[@data_science_lovers]

Good to have skills on Tableau, SQL, Python, Advanced Excel.. But not all are required

[@beshosamir8978]

@@data_science_lovers should i know Excel if i do well in programming by python ?

[@data_science_lovers]

Yes. Atleast basic Excel required to get answers for basic queries from data

[@debojitmandal8670]

@@data_science_lovers sir dint follow the Q10 bcs when you used split comnad and separated with spaces the split commoand should create a list. And even if it doesn't don't you think converting 4 seasons into 4 minutes is wrong.

[@debojitmandal8670]

@@data_science_lovers sir shouldn't we frame the question . Here your giving us the question which need to framed and we are just writing the syntax for that. Please can you make a tutorial on how to interpret the data and ask the right questions please

[@abidmolka1122]

what is our target value please ?

[@passionhdshorts_11]

hello I facing an error issue continuously, what can i do plz help

[@MohamedGamal-pj6wd]

great effort i want to write code which show the most actor or actress in the tv shows or movies

[@beshosamir8978]

first thanks for those videos but what should i know first to see this tutorial ? like prerequisites and is that Machine learning included ?

[@data_science_lovers]

You should only learn basic python to solve these projects. Machine Learning is not included in this video.

[@beshosamir8978]

@@data_science_lovers thanks for your help

[@DeepakSah3.0]

For Q8. df[ ( (df['Category']=='Movie') & (df['Type'].str.contains('Comedy')) ) | ( df['Country']=='United Kingdom' ) ]

[@mrlossantos]

Please make the Netflix Data Set Available!

[@data_science_lovers]

Yes it is available to download. Link is given in the video description.

[@bhawnachauhan4237]

Can i add this project in my resume?

[@data_science_lovers]

Not sure...but for resume we have another project, you can check here - kzbin.info/www/bejne/aXq5goisiZ2fg8k

[@MOHDRIZWAN-ff6qc]

Sir 7th question main sirf United States hi dikha rha h, can you please check

[@ramshiromani3725]

Brother Follow the syntax mentioned in video its show the results for both conditions

[@spred9ledge272]

Sir make video data visualisation or web scrapping project

[@DeepakSah3.0]

Use this to avoid error df['Date_N']= pd.to_datetime(df['Release_Date'],format='mixed')

[@rsfactworld1522]

Sir can you please help me in how to deal with os error ?

[@Manishyadav-ei2so]

I love this project. How can i upload it as a project in my resume.

[@anchaltyagi9062]

Hello sir , Sir, can you help me to complete a project ? I have send some details about my project .Project name -Customer service requests analysis. If you search that project on Google you get the whole details. Sir please help me .your explanation way is very good .

[@data_science_lovers]

Can u pls send details to [e-mail].

[@eslamahmed8936]

Done

[@pratyushatatireddy6825]

how can we remove null values

[@pankajingale4347]

df.dropna() will remove all the rows that contains null values

[@kassiarrami3256]

please how we can download the data ? Thank you

[@niteshprajapat7918]

you can download the dataset from kaggle

[@data_science_lovers]

The link to download the dataset file is available now in the video description. Kindly download.

[@vivekshah8905]

Sir can i do the same analysis to put in my resume

[@amanrauthan1222]

Hi are u preparing for data analysis

[@vivekshah8905]

@@amanrauthan1222 yes bro... Totally into it

[@vivekshah8905]

@@amanrauthan1222 what about u

[@amanrauthan1222]

@@vivekshah8905 can we catch each other at Instagram my insta id is. hey.luckyyy

[@vivekshah8905]

@@amanrauthan1222 i'll send u request soon

[@komaldumbre583]

Hey can i add this to my resume? Or its not a resume add on project?

[@data_science_lovers]

It's up to you. But, you should also be prepared for some other types of questions that may be asked from it. We will upload a proper project video for resume later.

[@proudIndian._1947]

Can we add this to our resume?as our project

[@data_science_lovers]

As your wish. But you should also be prepared for some other types of questions that may be asked. We will upload a proper project video for resume later.

[@story_teller_Is]

null values ka heat map kon bnata h bhai. woh to wahi isnull se hi pata lagrha tha.

[@arvarc7028]

3 mb ka file big dataset hota h kya 😂😂

[@ramakrishnann7933]

can i use this project for bigdata analytics

[@data_science_lovers]

For school level

[@divyamsaxena295]

How can I mention this project in my resume? I mean what to write in the resume?

[@data_science_lovers]

It's up to you. But, you should also be prepared for some other types of questions that may be asked from it. We will upload a proper project video for resume later.

[@divyamsaxena295]

@@data_science_lovers Please do a project that we can mention in the resume..

[@data_science_lovers]

Yes later

[@vachanaa1690]

data set?

[@data_science_lovers]

Download link available in video description

[@vachanaa1690]

​@@data_science_loversit says site can't be reached

[@data_science_lovers]

It is working for me....share your email id

[@sriramch3128]

Can i get that dataset

[@data_science_lovers]

Yes , the link to download dataset is given in the description of each video

[@rajatchauhan4410]

It's very sad to see Tom cruise working only in 2 movies.

[@gaddeshamena6781]

where to get python code

[@data_science_lovers]

The cost of all projects source codes & complete courses notes is Rs.750 only.

[@gaddeshamena6781]

@@data_science_lovers can i get a data anlyst project sir

[@data_science_lovers]

Ok. Please send a mail..i will send the source code

[@gaddeshamena6781]

@@data_science_lovers I SENT ALREADY SENT IT SIR

[@gaddeshamena6781]

ONCEAGAIN I WILL SEND U SIR

[@vidipjain7013]

15:20

[@ayeshairfan9058]

I have sent you email, actually I want source code of this project

[@data_science_lovers]

Reply done

[@vandansavla1319]

Q10 is wrong in this video better way is this i think.. df[['minutes','unit']] = df['Duration'].str.split(' ',expand=True) df df['minutes']=df['minutes'].astype('int') s = df.groupby(['Category']).get_group('TV Show') m = df.groupby(['Category']).get_group('Movie') #for tv shows res = s[['minutes','unit']].max() #for movies res1 = m[['minutes','unit']].max() print(res," ",res1) because two categories are there so two different max values should be calculated also 99 is wrong 312 is ryt convert the column to int for ryt ans hope this helps thankyou!!!

[@ayeshairfan9058]

live in pakistan

[@data_science_lovers]

Paypal Id is [e-mail]

[@system1013]

@@data_science_lovers Paypal and phonepe both don't function in Pakistan. What to do then?

[@data_science_lovers]

Kindly use Super Thanks option given below the video

[@mirateequrrahman4209]

Thank you so much sir