Customer churn prediction using ANN | Deep Learning Tutorial 18 (Tensorflow2.0, Keras & Python)

[@codebasics]

Check out our premium machine learning course with 2 Industry projects: codebasics.io/courses/machine-learning-for-data-science-beginners-to-advanced

[@MrMadmaggot]

Dude I ran a similar churn model with three outcomes. When I run the dataset without oversample the NN gives me a nice accuracy. When I run the dataset WITH oversample, somehow the NN gives me a very bad accuracy. WHY?

[@humanandlifefacts9217]

the dataset has already column if a customer churned or not. Then what are we really predicting ?

[@amitmishra5474]

Hi Sir! at 29:04 why are you calling first layer as ''Hidden layer"? I think first layer should be Input layer. I am confused.

[@codebasics]

Clarification: This video was just to demonstrate how to build neural network for structured dataset like customer churn. However there is an imbalance in this dataset (number of samples with churn=Yes are much less than churn=No), I will add a new video in this series showing how to handle this imbalance. That will improve the f1 score.

[@darullshifa4870]

sir i want to do my MS thesis on Churn prediction. is it possible to use this code and make it???

[@omkarg01]

At 11:54 you said green mean customer staying and red means customer leaving, and at 13:15 you said opposite of that, plz clear the statement. BTW your videos are helping so much!

[@symmercool7672]

Hello May be I missed it, but what's your name please? I had to run all your videos at 2x speed else I would have slept or got distracted...hahaha I have been following all your videos and they are all extremely helpful. Thanks for your efforts :)

[@AlonAvramson]

You have such an amazing talent to simplify complex issues and explain them so they look simple. It comes with a lot of hard work and it is very very much appreciated .

[@fadilyassin4597]

cleaning the data is very very essential i any project what you did in this project is very good hope you do more advanced video on preparing the data excellent work

[@programmingwithraahim]

23:34 for those people who are getting dummy variables to be True or False, just supply (dtype=int) in the get_dummies function.

[@bhumeshpanchal4904]

thank you so much. It took my whole day to understand.

[@programmingwithraahim]

No problem bro@@bhumeshpanchal4904

[@tarangrathod255]

thank you so much

[@Piyush-yp2po]

82% accuracy for exercise dataset, first remove unnecessary cols, replace col values, scale col values then train test split, then building neural network, atlast classification report, heat map and histogram plotting, thanks sir!

[@manishakanojia9191]

I really needed ANN model building video on classification model for structured dataset. Thank you for the help :)

[@mrminus8590]

You have a good sense of humour I like it

[@imranh2774]

Churn=Yes should be red and Churn=No should be green, however it is shown the other way around

[@muditmathur465]

Correct, proper EDA shall be done for Stakeholders to be able to understand the problem better

[@tylerpoore1487]

Glad I wasn't the only one who noticed this.

[@parthverma7089]

@@tylerpoore1487 nice flex

[@lanreuzamere4994]

@Imran H Well I think colors are compared with "Traffic Lights": Green=Go/Leave and Red=Waiting/Stay! So if you are leaving/moving(Churn=Yes) it's Green-Lights/Go and if you are Staying(Churn=No) it's Red-Lights/Wait/Stay!

[@mrIndia500]

@@lanreuzamere4994 idea is good, but it would be so dumb to show customers being loyal in red flag. haha

[@stevenlevittt]

Learnt a lot on this video. My focus mainly was on cleaning, and the part from 27:58

[@ajaythapar6169]

Excellent order of contents delivery in a possible simple way. Made each session interesting and linked with the previous sessions. Thank you so much for your efforts.

[@sauravthakur2915]

Instead of using threshold value for making yp 0 and 1 we can use : yp = model.predict_classes(X_test) it will give up as 0 and 1 value.

[@panther_.gaming]

wow thats some new info to me. Thanks bud. i was using round(yp,0) as it will convert all

[@pei2273]

Thank you ! I had a hard time struggling with the coding things, but you make learning ML or DL so easy and fun！

[@fahadreda3060]

Your videos are getting better and better, Thanks man , love your videos

[@devanshsrivastava5589]

Thanks for teaching such extensively all the projects and ML methods

[@066-pritamjena3]

14:11 sir can you explain about that blood_sugar_men and blood_sugar_women

[@lanreuzamere4994]

@Imran H : Well I think colors are compared with "Traffic Lights": Green=Go/Leave and Red=Waiting/Stay! So if you are leaving/moving(Churn=Yes) it's Green-Lights/Go and if you are Staying(Churn=No) it's Red-Lights/Wait/Stay!

[@shubhamsahoo331]

Thank you so much for this great tutorial, and your endless effort to share your knowledge.

[@codebasics]

☺️🙏

[@Breaking_Bold]

Excellent video on business use case hands-on lab !!!!

[@bratsummer1980]

Sir you are great Your humor is also good for refresher .

[@codebasics]

ahh thank you :)

[@ahmedosman1020]

This was so good! Keep it coming!

[@rishavbhattacharjee7182]

Thanks for giving the dataset sir. Really helpful for practise.😁

[@codebasics]

Yup, practice is very important

[@shrutidas3407]

Thanks a lot sir fo making this topic sooo easy to understand🤗

[@ChPradeepKumar]

you have good sense of humor😂

[@yashvardhan.singh3009]

precision recall f1-score support 0 0.96 0.87 0.91 1745 1 0.46 0.73 0.56 255 accuracy 0.85 2000 macro avg 0.71 0.80 0.74 2000 weighted avg 0.89 0.85 0.87 2000 exercise answers, 40 epochs did the work,

[@zakryashakeel1883]

I need help related project

[@MCAAlexKumar]

Do a project to predict what type or what subject video will give you more views and engagement .

[@vivekbansal1977]

Yes Its Informative, Explained each and everything, Thanks Bro!

[@codebasics]

Glad it was helpful!

[@simplydesigncad6777]

awsome tutorial . thank you for taching useful methods

[@mirkhalil-c4t]

Exercise done with 86.2 testing accuracy

[@Blessing-o4c]

i am forever grateful to you and I continuous which you success, I love that for a every questions I want to ask you provide answer like why use replace instead of one hot encode? thanx

[@khanaftab3852]

You are a great teacher thanku

[@codebasics]

I am happy this was helpful to you.

[@piyushpathak1996]

Hello sir, First of all, love your content and teaching style. Thank you. Just wanted to clear a small doubt. Do we need to worry about the " Dummy Variable Trap" in deep learning models too? I noticed, we have not dropped any of the generated dummies after OneHot Encoding.

[@bigdatamanagemententerpris8503]

It is always good to avoid dummy variable trap.

[@snehduggal3087]

I have a question. I remember in one of the machine learning we dropped one column for the dummy variable trap. Why didn't we do it here?

[@ajaykushwaha4233]

After long search I found ANN for classification problem. Thank you for such awesome video. Sir I have a question: in ML classification we have 5-6 also for solving classification problem. Do we also have similar algo in ANN for solving multi class or binary classification problem ?

[@annabiju7112]

This was very helpful. Thanks a lot!

[@KanaparthiLakshmikanth]

Hi @25:51 i think we need to scale the features after train test split to avoid data leakage.

[@letsexplorewithzak3614]

Your the best, when it comes to an explanation. Do you have any community where all AI, ML or deep learning talk happen?

[@codebasics]

Yes I am going to launch a discord community. I will announce soon, stay tuned. I will be doing a live session with some big announcements

[@jaysoni7812]

Sir please make a video on hyper parameter tuning using keras tuner. i hardly missing your video bcz i didn't find perfect each and every component explanation at anywhere.

[@adityahpatel]

what is keras tuner?

[@sandiproy330]

Thank you, sir. This was a fantastic video tutorial. Very clearly explained.

[@minakshisontake3585]

very good knowledge

[@thecomputerpilot]

GREAT video

[@adhyanmaji2672]

Sir please make a video on advanced house price regression from kaggle .

[@dheerajsoni9501]

Great Video.. So easy to understand Thanks alot Sir. Also I would like to learn after the model is ready, how do I run this model on other dataset. Please share your knowlegde on who to use the model on other datasets of same type.

[@mehrdad_analyst]

That's a fantastic video. But, was there any specific reason you didn't remove one dummy variable when you used the hot-encoding method? (for preventing multicollinearity).

[@Yash8147]

I got below results: precision recall f1-score support 0 0.88 0.95 0.91 1595 1 0.71 0.48 0.57 405 accuracy 0.85 2000 macro avg 0.79 0.72 0.74 2000 weighted avg 0.84 0.85 0.84 2000

[@kmnm9463]

Hi Sir, Can you please do a series on ML solutions for Anti-Money Laundering, Anomaly Detection , Market Manipulation etc. in Banking and Financial Services. I guess these are in much demand now and openings are also many. This would help a lot?. from Krish

[@Sachin-xj1oq]

Hi, Wonderful lecture. If I want to use Genetic Algorithm for feature selection. How can i implement in this analysis?

[@englishprimiereleague1677]

Thanks for this wonderful video.How can I build an interface for this model

[@advertisemedia1509]

in my case i needed to do this change (y_predicted>0.5) from sklearn.metrics import confusion_matrix , classification_report print(classification_report(y_test,y_predicted>0.5))

[@work-dw2hl]

wonderful explanation

[@codebasics]

Glad it was helpful!

[@nonsnona532]

sir, thank you for this video. I have a question, how can we predict the customer churn. I mean, I want to see a way that I can give the model some information about a specific customer, then the model should give its prediction about this specific customer either yes or no churn. I asked you this question because I see you that you stopped in your video after you get the recall results. I was waiting to see you insert customer's data and get the result from the model. Thanks

[@jongcheulkim7284]

Thank you.

[@rajatlingwal48]

Thank you for making the video. Sir, I have one doubt regarding one hot encoding. When you made dummy variables and you got 3 new columns, you used all 3 new dummy colums in your model. In such scenario there would be chances of dummy variables trap or multicolliniarity. So to avoid that we always remove one colums from our dummy variables. Could you please make a separate video on it. Thank you.

[@codebasics]

Hey yes. You can remove that column. In one of my videos in ML playlist I have discussed this

[@rafibasha4145]

14:23,Churn=No for 120 so they are not leaving actually and from the graph its clear people are not churning due to high monthly charges

[@encibimohamedhamza7182]

Exactly, I think it was a misinterpretation

[@jishanahmed225]

Nice video! By the way, scaling before the train-test split caused data leakage. How can we trust the predictions then?

[@jishanahmed225]

@@HyperLinguist-AI U need to rely on explainable machine learning tools to get what you want.

[@PP-tc1zp]

Hi, thank you for your courses Something different: I am tired recently I take moringa Do you know moringa and is it really healthy and safe?

[@ubannadan-ekeh7781]

very good tutorial, thank you. please I am getting ValueError: Must pass 2-d input, when I try to run the confusion matrix heatmap

[@Sarvesh.757]

use an additional bracket [ ] it will work nor

[@AjinkyaBhushan]

18:30 the df1.replace('No internet service', 'No', inplace=True) is not working Can anyone suggest any help?

[@AjinkyaBhushan]

I solved it here is the code: def print_unique_col_values(df1): for col in df1.columns: if df1[col].dtype == 'object': df1.loc[:, col].replace({'No internet service': 'No', 'No phone service' : 'No'}, inplace=True) print(f'{col} : {df1[col].unique()}')

[@r21061991]

Thankyou sir

[@bratsummer1980]

Sir do you have any video regarding svm for various inputs?? Or Ann for more than 3 inputs?? Actually I have both classification and non classification problem

[@reemaljaber]

thanks

[@sankalapajena4625]

In monthly charge histogram,with a high monthly charge histogram shows that churn=no that means customers are not leaving right?but it's not true ..

[@manikumar-vr3kp]

there is a problem with churn visualization colour

[@raunak3406]

Hey you are using an ANN but what kind of ANN is it, like is it backpropagation, Delta, Kohonen. Which model is used here?

[@techspoc7442]

Sir , Can you make one video on keras tuner ???

[@gauravakotkar3222]

Do we just build model in Random forest and ANN or we can predict value of target label by putting values of observation for which we do not know the target label. Like in Linear regression we get equation where can put value of Xs for corresponding coefficient????????

[@shelidatta4885]

My yp values are very low as compared to your values and getting errors while creating confusion matrix.Please suggest changes.

[@emmanuelsamutumwa968]

How can I use this model in my react web application that’s has a dashboard?

[@abhinavsingh-wl4yz]

What is the use of blood_sugar_men and blood_sugar_women

[@dasgupts10]

Is feature engineering a precursor to ANN unlike other deep learning techniques.Here we are doing feature engineering first then applying ANN

[@itsmeatrin]

27:23 O_O dude forgot it's not time for his evil mastermind to come out LMAO

[@MohamedAli-hh3qm]

does this one model/dataset will suit for any type of company. I mean, This one dataset will help to predict churn for companies like bank, Telecom, Wireless Services, Food delivering services so on.

[@hiteshsahoo9283]

At 18.32 The replace method is not working... Even printing the unique values there was no replacement What should be the approach to make that work??

[@aaryamansingla9459]

Quick doubt: When should the scaling be done? After train_test_split or before? In this video you did it before but I heard it can lead to data leakage problem. Thank you for the content

[@aliffnabil5542]

yes you should scale the data after the train test split to avoid data leakage from our test split into our training split

[@theyk3817]

That's your choice, but it'd be better if you scale the data set before splitting as you won't need to scale the test and validation dataset separately .

[@313yogesh]

Great tutorial!, can you make a video on stock price prediction using lstm?

[@codebasics]

Yes I can

[@cikguhasnah1418]

sir, i have train ann on my dataset and the done the preprocess stage. however, the accuracy of my ann model does not change during the epochs running. does i have problem with my dataset? tq

[@dollysowmya7893]

I want to work on customer churn prediction but how to find the dataset for this project

[@tchintchie]

thank you for the great tutorial. however there´s one question (sorry if asked before): don´t we have to take into account the obvious class imbalance of the target variable?

[@codebasics]

You are absolutely right that we didn't account for imbalance in the dataset. I will add a new video on how to tackle that.

[@flaviobrienza6081]

I have a doubt: he performed the preprocessing on the entire dataset and split it into X_train and X_test. Isn't it incorrect? Shouldn't he call the X_test X_validation, since the test set must not be pre-processed with the training set.

[@hardikvegad3508]

8.42 how did you removed that warning message??

[@shaikansarbasha4169]

use this code you will not get any warnings import warnings warnings.filterwarnings('ignore')

[@imranuddin2153]

Thank you for making such wonderful step by step tutorials. I have learned more from your tutorials than from my classes. I was wondering if you'd clarify a little confusion I have. We initially saw the data had more than 7000 instances. But the confusion matrix shows lot less than that number. Shouldn't the matrix show the result for all numbers?

[@LamNguyen-jp5vh]

This is because he did the test split for training and testing

[@RaunakKumar-yr3zv]

confusion matrix shows only for X_test

[@stevekim1357]

I am new to ML, how do you create 'Churn'? I only know variable values.

[@techsavy5669]

Using balanced dataset and some permutations on layers/neurons , i got ~91.3% accuracy. Is this optimal or do we have more scope here! Thanks.

[@rajuvarma-zk2zw]

I didn't get the point, why separately calculating precision and recall for class 0 and class1 , what is macro AVG and what is weighted average?I know generally precision and recall calculating for entire dataset . Why accuracy not considered?

[@foxbat296]

Thanks for the wonderful clip..can you make a tutorial on optimizing NN using GA.. Since you explain things so nicely this will really help

[@codebasics]

Point noted.

[@ajaykushwaha4233]

How to know the number of hidden layers need to be built and the number of neurons in each hidden layer ?

[@pyclassy]

can you upload any regression problem using ANN on skewed data without removing skewness.how we will train ANN in such case?

[@humanandlifefacts9217]

the dataset has already column if a customer churned or not. Then what are we really predicting ?

[@amitsaxena9122]

Plz explain about NLP ,can we make a model from scratch in python .plz make a video on NLP ...thank you sir

[@codebasics]

yes NLP videos will be coming soon

[@Codingiisgreat]

at 29:35 the input_shape is (26,) that is 26 columns but what about 5625 rows ??? I'm finding input shape for this dataset quite different than the Handwriiten Digits Classification

[@otsogileonalepelo9610]

This is the same observation I made as well, do you understand why?

[@vicentemantero3007]

Hello ! What is a good approach for a database that has questions in the columns and in the rows the answers to those questions (multiple selection where the clients chose 1 answer from 4 options).

[@JoEl-jx7dm]

Hey sir, can i use this model to predict the Hw dataset?

[@shubhamvashishth8289]

i have done exactly like you did but my total charges values are still the object type what should i do?

[@Piyush-yp2po]

Instead of churn yes and no, it would be easy if we would have used customers staying and leaving

[@amanrohilla6659]

what is the end result of this prediction like kya fayda hora hai??

[@muhammadkhubaib5666]

sir i have problem with tensorflow not working in my laptop i try my best to install.. but still face problem regarding module error not found

[@digitalnomad2196]

Is there a video where we can build a simple UI and deploy this project. It would good practice and making this end to end. A simple flask .api with a seirlized model. Does your channel have a video on this, thanks in advance

[@codebasics]

yes I have done few end to end projects. In youtube search "codebasics data science projects" you will find few playlists where I covered building UI, deployment using both fastap and flask.

[@digitalnomad2196]

@@codebasics Thank you, I'll check those out. What do you think a good simple deployment for this project would consist of ?

[@NguyenNhan-yg4cb]

In 31:35, class y have 2 labels 1 and 0 ( mean Yes or No ), then why your final dense 1, that must be 2 right ?

[@solowolf5304]

how can we build a decision boundry for this problem

[@mkacgrerg]

all values in y_pred is 0. what to do?