Machine Learning Tutorial Python - 14: Naive Bayes Classifier Algorithm Part 1

This is part 1 of naive bayes classifier algorithm machine learning tutorial. Naive bayes theorm uses bayes theorm for conditional probability with a naive assumption that the features are not correlated to each other and tries to find conditional probability of target variable given the probabilities of features. We will use titanic survival dataset here and using naive bayes classifier find out the survival probability of titanic travellers. We use sklearn library and python for this beginners machine learning tutorial. GaussianNB is the classifier we use to train our model. There are other classifiers such as MultinomialNB but we will use that in part 2 of the tutorial.
#MachineLearning #PythonMachineLearning #MachineLearningTutorial #Python #PythonTutorial #PythonTraining #MachineLearningCource #NaiveBayes #sklearntutorials #scikitlearntutorials
Code: github.com/codebasics/py/blob...
Naive bayes theory video: • Naive Bayes classifier...
Do you want to learn technology from me? Check codebasics.io/?... for my affordable video courses.
Exercise solution: github.com/codebasics/py/blob...
Topics that are covered in this Video:
00:00 introduction
00:19 Basics of probability
00:52 Conditional probability
01:52 Bayes theorm
04:37 Coding: titanic crash survival
10:00 GaussianNB classifier
Next Video:
Machine Learning Tutorial Python - 15: Naive Bayes Part 2: • Machine Learning Tutor...
Populor Playlist:
Data Science Full Course: • Data Science Full Cour...
Data Science Project: • Machine Learning & Dat...
Machine learning tutorials: • Machine Learning Tutor...
Pandas: • Python Pandas Tutorial...
matplotlib: • Matplotlib Tutorial 1 ...
Python: • Why Should You Learn P...
Jupyter Notebook: • What is Jupyter Notebo...
Tools and Libraries:
Scikit learn tutorials
Sklearn tutorials
Machine learning with scikit learn tutorials
Machine learning with sklearn tutorials
🌎 My Website For Video Courses: codebasics.io/?...
Need help building software or data analytics and AI solutions? My company www.atliq.com/ can help. Click on the Contact button on that website.
#️⃣ Social Media #️⃣
🔗 Discord: / discord
📸 Dhaval's Personal Instagram: / dhavalsays
📸 Codebasics Instagram: / codebasicshub
🔊 Facebook: / codebasicshub
📱 Twitter: / codebasicshub
📝 Linkedin (Personal): / dhavalsays
📝 Linkedin (Codebasics): / codebasics
🔗 Patreon: www.patreon.com/codebasics?fa...

[@codebasics]

Do you want to learn technology from me? Check codebasics.io/ for my affordable video courses

[@agvlogs5773]

Great things is that - you recommend other people's channel as well. It seems u r just trying to make people learn something no matter whose channel. Respect🙏🙏

[@Marshall_Mohammed]

This is the first time I am exploring machine learning and Python, I have never tried to learn Python. But your tutorials are just awesome, it is much easier to learn and understand the concepts. Great Work!❤👏

[@flamboyantperson5936]

Great to see you back with a new tutorial. Your idea of first explaining theory then going to practical is awesome. That's awesome.

[@codebasics]

hey flaboyant person. I was expecting to see your comment. How are you ?

[@flamboyantperson5936]

@@codebasics It's impossible I won't like and reply to your video. I am great fantastic. How are you and how is your health now?

[@ashish-blessings]

Simplicity is the ultimate sophistication. You are amazing!

[@aryanverma7506]

Your Playlists worked as Revision before my interview. Thank You for your support

[@sreesai4729]

That was the best ever tutorial I watched about naive bayes.... Thank you so much ❤

[@geeksfornongeeks4546]

You really know how to explain jargons in simple language. Thanks a lot

[@midhunskani]

We need more tutorials on deep learning and start a new AI tutorials. Your machine learning tutorials are really good

[@prakharmishra2977]

thanks a lot sir,for your great support,I started my data science path through your videos really great mentor,altruistic human being i am proud of you sir!!

[@codebasics]

hey Prakhar, thanks for your kind words and I wish you all the best. I am sure you will become a successful data scientist one day. good luck :)

[@vibestouchessoul2602]

@@codebasics sir we waant full play list of deep lerning and real world data science and machine learning projects

[@LS15QD]

You are fantastic! If you were a lecturer you would be the one everyone likes!

[@milindprakash8855]

You are doing wonderful job ...really learnt a lot from your videos

[@aniketjha5919]

Sir these are the best videos with best explanation,Thanks alot for these sources. Please try to upload more projects and please help and explain more detail about when to use which classifiers. Thankyou

[@AmanSingh-bk1um]

Good keep doing these AI videos, i liked it good to see the flow of functions in single video.

[@spicytuna08]

what a gift of explanation!!!

[@GlobalDee_]

Great, thanks for this series...Pls can u do series on evaluation metrics,I will love to see explicit explanation on it.

[@supersql8406]

Great video, great teaching, great speed, great other misc stuff like fillna, drop, concat. Please make more of these types of videos! Subscribed!

[@codebasics]

I am happy this was helpful to you.

[@ayushibansal7947]

This is the best tutorial on you tube. I understand concepts easily.

[@codebasics]

I am happy this was helpful to you.

[@sidharthkumthekar3179]

Very well explained sir! Thanks :-)

[@deepanshuaggarwal7042]

Your teaching skills are best. Please continue this series and covers all topics of ML. If not possible, then plz provide link so that we can study. There is no channel which teaches ML the way you are. Hope, you will come to INDIA and do your dream job "Organic farming "

[@codebasics]

Oh deepanshu.. I want to do that and spread awareness of eating right. Anyways but yea I have plan to cover many more topics in ML, stay tuned.

[@zananpech1522]

I found that RandomForest classifier performs slightly better than Naive bayes model. anw, love your tutorials, thank u for your hard works :)

[@yes_i_am8378]

Hey @codebasic you are teaching way is awesome. i hv question here. why is there a target variable in unsupervised learning?

[@levyax1964]

Great intro. For the last line of code in notebook, I think we shall use X, y instead bc now it's time for full model evaluation: np.mean(cross_val_score(GaussianNB(), X, y, cv = 5))

[@codebasics]

Part 2 of this naive bayes tutorial. Email spam detection: kzbin.info/www/bejne/pHmshoytg5JoqK8

[@jepsmyt]

Hello, Thanks for the explanation. I was wondering dont we need to normalize the data? Let me know your thoughts on this.

[@mohannads2757]

Naive can deal without any Feature Scaling

[@user-wr4yl7tx3w]

this is a really good example explanation

[@msctube45]

Thank you for this very well explained Tutorial.

[@codebasics]

Glad it was helpful mario!

[@Spiray]

Wonderful video, thank you. Simple but well-explained! It has helped me a lot. =)

[@codebasics]

Glad it helped!

[@flamboyantperson5936]

I have a request if you could make one video on it that would be very helpful. I want to know when we make a UDF in python how can I check it at each and every step function is working or not before completing the whole UDF

[@pranjalgupta9427]

Very nice video sir can I used logistics regression also because I think it also give same result as naive bayes

[@shaiksuleman3191]

Super B SIr Cyrstal clear Explanation.There are some many videos on machine learning but no one cann't explain as you.

[@codebasics]

Thanks and welcome

[@ravikumarrai7325]

Sir, I got one doubt here that, since you have created dummies in this project, you should drop the first dummy column, in order to avoid Multi-colinearity. Please revert back with your comments if I am wrong

[@r0cketRacoon]

I agree, have u figured out the answer?

[@mohammadkassir3545]

Please complete tutorials for deep learning

[@sukantithakur4225]

hi,the titanic data we used earlier in DecisionTreeClassifier model. i campared the score is higher in DTC than Naive Bayes and we get probability in DTC also,so just wanted to ask how to know which model is the best to use in realtime?please suggest.

[@MohamedAshraf-zs6nv]

how you decide which feature to keep and use in the model and which to drop? I mean is there any strategy to handle this situation?

[@channel-lz5og]

Always love the u teach. ..u are amazing

[@codebasics]

Glad it was helpful!

[@codingmadesimplified]

Awsome!But I Have A doubt why we have not normalize out dataset certain columns?

[@nastaran1010]

Hi. Thanks so much.

[@devanshgoel9070]

thank you bhai for the explanation

[@pythonenthusiast9292]

sir , how did you come to know that the data is a bell curve (gaussian distribution).

[@MDNAZMUNHASANNAFEES-yz7vq]

you are the best man. I am being not Naive.

[@jyrust1713]

hey u know parameters prior_fit in naive bayes for what? i dont understand in documentation thx

[@sulimanallahgabo1080]

just i was looking for , thanks sir oh u re great great .....

[@codebasics]

Thanks man. I really appreciate love from all of you :)

[@sulimanallahgabo1080]

@@codebasicsas usual many thank to u pls if u have material for data science of don't mind send to me ,[e-mail]

[@aaditstudent]

I have a small query here. Why did we not drop the either female/male column after one hot encoding to avoid dummy variable trap?

[@rahmaaja6600]

thanks a lot.. can i ask to you, what if i want to show xtest result after tf-idf sir? I have tried only with the xtest code but the results are not as desired

[@Aniquekhan]

thanks

[@Gauravkr0071]

Hii , the lectures are just amazing , cn u plz make a tutorial on how to write custom layers in keras like we make in variational autoencoder . Plz man therre is almost no resource in internet explaining it properly

[@codebasics]

Thanks gaurav for appreciation. I have noted down the topic you suggested and will get to it in future 👍

[@ramandeepbains862]

Sir plz explain when to take the mean median mode for null values .....

[@tagoreji2143]

thanks a lot SIR

[@ashishzine14]

Great job sir thank u

[@codebasics]

Glad it was helpful!

[@debatradas9268]

thank you so much

[@codebasics]

Glad it was helpful!

[@cedricvumisa7416]

thank you

[@sayantandas7054]

Sir, why there is a target variable????? like it's a clustering algorithm i.e unsupervised...and target variable is used in supervised

[@nitishkeshri2378]

"target" is a variable, you can take anything as a variable

[@jaiprathapgv2273]

Should I use mean method or median method for Nan because in one video you told us to use median method in this video it is mean method. Which one is the best right to use?

[@zutubee]

Median is more robust to outlier so generally a better idea. Features like age are normally distributed hence mean can also be safely used

[@anasahmed4682]

shouldn't we split the data first and then perform preprocessing or does it not matter?

[@laxmandesai573]

Afaik, the order dosen't really matter. If you split first, you'd need to preprocess all the parts individually.

[@mohammedmunavarbsa573]

super video

[@maresh_vlsi]

could not convert string to float: 'Birnbaum, Mr Jakob' how to eliminate this error

[@manavgora1758]

can we also do "One Hot Encoding" instead of dummy variables.

[@karannchew2534]

Hi, A couple of questions, hope someone could help please: 1) I thought Gaussian NB only take continuous features value. But here, there are continouse (e.g. Age) and discrete (e.g. Gender) value. Can I use Gaussian NB if all features are discrete value? 2) One hot encoding split the Gender data into two data: Male and Female. These features are related i.e. mutually exclusive. Does Gaussian NB algorithm jointly 'process' these two data as one feature or two separate feature? Hope someone could enlighten. Thanks.

[@thebrainfeed402]

hey i have the same doubts regarding Gaussian NB. Did you figure it out? Would be really helpful for me:)

[@cnuvadali]

super

[@OnlineGreg]

thanks for this video! one thing i dont understand: at 2:33 P(queen) should be 1/4 or? and P(diamond) 1/13. as there are 4 queens and 13 diamonds in the deck

[@ivanherrera10]

You are right, I think there is an error in the presentation.

[@kamilazim5498]

sir make tutorials on Natural language processing(NLP)

[@user-tx3mo1ez2n]

From where you have learned NLP???? ( I assume that you have done something for learning NLP)

[@mvs69]

why we use train_test _split, we can use cross_validation fro better results, cant we?

[@ayazahmed9611]

Sir can u upload more videos on ML ALgorithms like this??

[@codebasics]

yes Ayaz. sure. I have the plan to upload more videos on this topic.

[@onatmufasa0522]

I have question, why you did not drop either fenale or male column? In your previous tutorials, you said one column should be dropped if converting using dummy. Thanks...

[@r0cketRacoon]

I agree, have u figured out the answer?

[@nikhilgaikwad9954]

In a categorical dataset , how can we decide whether the problem can be solved by using Naive Bayes algorithm or no? Or which algorithm will give high accuracy?

[@codebasics]

Based on type of problem you might end up using one or the other algorithm. You can use gridsearchCV to evaluate performance of different alogs with different parameters. Please watch my video in this same series "it is called hypertunning parameters using gridsearchcv"

[@Yang11235]

Does we don't need to drop one dummy column? Dose the dummy variable trap only for linead_mode?

[@r0cketRacoon]

I agree, have u figured out the answer?

[@SaiChand4492]

Good explanation but the problem is, in the dataset I'm not able to find jack and rose :/

[@tanyabhalla5083]

Input contains NaN, infinity or a value too large for dtype('float64'). - Can you help with the errror?

[@nitishkeshri2378]

use fillna() method to fill that "NAN" value as shown in video

[@akshaybanaye]

Hi, I am getting following error: ValueError: Input contains NaN, infinity or a value too large for dtype('float64'). But I checked and there is no NA value in my dataframe. inputs.info() Gives me this output: RangeIndex: 891 entries, 0 to 890 Data columns (total 5 columns): # Column Non-Null Count Dtype --- ------ -------------- ----- 0 Pclass 891 non-null int64 1 Age 891 non-null float64 2 Fare 891 non-null float64 3 female 891 non-null uint8 4 male 891 non-null uint8 dtypes: float64(2), int64(1), uint8(2) memory usage: 22.7 KB

[@dhainik.suthar]

why my predict_proba return >1 and

[@azus9819]

same issue

[@JainmiahSk]

Sir how is your health? I'm waiting for your videos. Sir, how to encode multiple variables at once?

[@codebasics]

hey Jainmiah, my health is improving. The full recovery might still take one complete year but at least I am in a position to upload videos now.

[@JainmiahSk]

@@codebasics I Pray God to recover you fast to your GOOD Health. #LoveCodeBasics and #LoveYouSir.

[@michaelrall3916]

Just for the ones who might be as stupid as me and were missing the "survived" column: On kaggle there are two files. One test and one train file. Take the train file instead :)

[@nilanjanbanik7509]

@6:20 Why can't we use LabelEncoder instead of panda's dummy variables?

[@abhinavkale4632]

both can be used, it is just that he is more used to one hot encoder.. that is the same pd.get_dummies(" " ). Otherwise, the results will be the same for both.

[@sougandhhm]

hello sir, Please do some videos on Natural Language processing, I am waiting for this badly

[@codebasics]

wow....actually thats the topic I am going to cover next. You read my mind almost. I will start that series soon.

[@245uday]

@@codebasics yes...i am also waiting...I started studying data science a few days back...your way of teaching are simply awesome...

[@HerlonCosta]

Waw, i am a first! 😃😃 #LovePython

[@codebasics]

oh yup. Hanzo.. you got the "first commenter" award :) ha ha...

[@user-jg8rp2mt8m]

isn't it female and male column 'highly related'?

[@asheeshyadav5519]

Sir Is it necessary to learn behind mathematics of machine learning algorithm or some overview of mathematics of machine learning algorithm Sir please tell me please Because I am very confused

[@codebasics]

You need to know some math. Not very much in depth. So don't worry too much about it. If you want to become machine learning engineer or data scientist who solves complex problem than of course advanced math knowledge is always useful

[@asheeshyadav5519]

@@codebasics Sir if I want machine learning Engineer than if I have some knowledge of math Please reply I wait

[@tagoreji2143]

SIR ,HOW TO IMPROVE ITS ACCURACY?

[@rudrarajput4764]

Boss, can you please make a lecture on reinforcement learning and also one lecture on Q learning??

[@worldcomingtoanend]

by saying male as a feature are u sure u did not confuse it with sex. I thought sex would be the feature with values such as male, female. Unless you meant male as a feature taking on values yes or no?

[@isaakimaliev5584]

y should be a 1d array, got an array of shape (179, 5) instead.

[@RishabhSingh-bh7fu]

I am getting file not found error as I import data set using the same code

[@nmana9759]

if you're using IDE you should import the file to the workspace you're working in

[@fahadabdullah510]

How P(diamond/queen) is 1/4 Can somebody explain to me?

[@JatinSharma-tu2zg]

Sir Hindi main bhi bana dijiye pls aap bohut acha samjha rahe hain

[@codebasics]

sure jatin. KZbin me codebasics hindi search karo, maine already those ML ke video hindi me upload kiye hai.

[@rinsyarifuddin8696]

Please help me, i got this error message "could not convert string to float : 'male' " someone can explain me why it's happen to me?

[@vatsal_gamit]

Use sklearn encoding

[@urfather7595]

can't the sex column be simplified by LabelEncoding??

[@Lifebw9to5]

sir why you have used GaussianNB model instead of using Logistic model or any other

[@codebasics]

Because this tutorial is on naive Bayes 😊

[@Lifebw9to5]

@@codebasics so can be use any other model to perform this task of mail classification or this model is best suited for this task

[@ashutoshpurohit8603]

Where to get the dataset?

[@akshaybanaye]

github.com/codebasics/py/tree/master/ML/14_naive_bayes

[@muhammadsaqibsangi1495]

where is code of this tutorial??

[@codebasics]

check video description for github link

[@mariav1234]

Do you not need to remove one of the dummies "male" or "female"? It does not make sense to have both of them, since in that dataset, who is not male is female. To my knowledge that is an essential step.

[@zutubee]

Yes your right, these are negatively correlated. Including both of the features would make gender have higher influence on inference

[@harmainiwilliam5539]

We can't able to download ur code... It's coming invalid

[@codebasics]

I have checked all URL's working perfectly. Please check URL in description.

[@aryanverma7506]

Better than Andrew NG

[@codebasics]

Exercise solution: github.com/codebasics/py/blob/master/ML/14_naive_bayes/Exercise/14_naive_bayes_exercise.ipynb Step by step guide on how to learn data science for free: kzbin.info/www/bejne/jJ_CnqCFqraeiaM Machine learning tutorials with exercises: kzbin.info/www/bejne/nZ7Zp5Sll9Jqm7M

[@abhinavkale4632]

pd.get_dummies(df,columns=['sex']) could have just done this.. no need to perform concati. @6:45

[@priyamprakash1209]

How the fuck can I get the dataset

[@LocNguyen-lb7ii]

I think your math symbol is wrong & not /

[@varunsingh545]

EXPLAIN IN SIMPLE TERMS ......?? I DONT UNDERSTAND YOUR VIDEOS