K Nearest Neighbor classification with Intuition and practical solution

[@programmingpurpose1329]

This explaination is one of the most precise explanation that I have seen on Internet.

[@nelsondelarosa5490]

This is in fact well explained, defining every term, and assuming no previous knowledge. Thanks so much!

[@sivareddynagireddy56]

No words about u r explanation sir,simple lucid way explanation !!!!!

[@sandipansarkar9211]

Cool. Also finished my practice in Jupyter notebook. Thanks

[@vaibhavchaudhary1569]

Feature scaling (StandardScalar) should be applied after train test split. As it will not lead to information leak.

[@datascience3046]

TRUE

[@kiruthigan2014]

Loved Ur videos and Ur taste in music..kadhal vanthale in the bookmark 😂❤️🔥

[@surendar3543]

Neenga tamilah

[@Tapsthequant]

Thank you, you asked a question I had in my head, looking forward to applying the suggested solution, about imbalanced dataset...

[@TechnoSparkBigData]

Sir you are great inspiration to me. Thanks a lot for making every complex problem simpler.

[@appiahdennis2725]

Respect Krish Naik

[@ijeffking]

Very well explained again. Thank you so much.

[@shubhamsongire6712]

Thank you so much Krish for this great playlist. You are gem

[@903vishnu]

really its good... but you mentioned K=150, as per my knowledge we are not supposed to take even number. there might be chance of equal number of classes got selected nearest neighbor... algorithm may not be able to estimate the class for new record...

[@deshduniya360scan7]

Explain like a pro,thank you

[@sazeebulbashar5686]

Thank You Naik...... This is a very helpful video

[@MaanVihaan]

Very nice sir ur explanation and coding technique is very nice.... I am new learner of data science please keep uploading such video and new techniques of different kinds of algorithms which help us make easy to understand to deal with different kinds of datasets.

[@padduchennamsetti6516]

congratulations krish on 1million subscribers🥳

[@DeepakSharma-od5ym]

error_rate = [] for i in (1,40): knn = KNeighborsClassifier(n_neighbors=i) knn.fit(X_train,y_train) pred_i = knn.predict(X_test) error_rate.append(np.mean(pred_i != y_test)) plt.figure(figsize = (10,6)) plt.plot(range(1,40), error_rate, color = 'blue', linstyle = 'dashed', marker = 'o' ) plt.xlabel('k') plt.ylabel('error rate') My above code giving error "x and y must have same first dimension, but have shapes (39,) and (2,)" Please suggest

[@shreeyajoshi9771]

Thank you very much for this video. Helped a lot!

[@Kishor-ai]

Thanks for this video krish naik sir🤩

[@codyphillippi8831]

This is awesome! Thank you so much. I am working on a project at work for lead segmentation to help us find our "ideal lead" for our sales reps with a lot of very messy data. This is a great starting point. Quick question (might be a loaded question ha) - after we find these clusters, how do we go about seeing the "cluster profiles"? Or what all data points make up these clusters (in categorical form)

[@joeljoseph26]

use any visualization library to see the clustering.

[@shyam15287]

All the best Superb Explanation you are a superb resource u will reach great heights continue ur good work

[@scifimoviesinparts3837]

At 18:52, you said larger value of K will lead to overfitting, which is not true. Smaller value of K leads to overfitting. I think, if there are 2 K-values giving same error, we choose the one that is bigger because it is less impacted by outliers.

[@mahikhan5716]

how can we choose optimal value of k by KNN ?

[@joeljoseph26]

Minkowski distance = (Manhattan) and (Euclidean)

[@ManashreeKorgaonkar]

Thank you so much for sharing this information. I'd just one doubt sir if we will scale before train_test_split wont it be lead to data leakage? as during scaling process during fit when it consider average of all the data points it also take the value of test data set so my model will already have some hint regarding it??

[@rambaldotra2221]

Grateful Sir ✨✨Thanks A lot.

[@indrajitbanerjee5131]

Nicely explained.

[@asawanted]

What if we choose a K value and hit a local optima? How would we know if I should stop at that K value or proceed to a higher value in search of global optima?

[@sandipansarkar9211]

great explanation Krish.

[@abdelrhmandameen2215]

Great work, thank you

[@louerleseigneur4532]

Thanks Krish

[@adhvaithstudio6412]

can you exlplain how hyper parameters will helps in what scenarious

[@krish3486]

Sir why there we check only 1 to 40 neighbours only in the for loop

[@vignesh7687]

Sooper Explanation Krish. I have a doubt here.. When do we need to use MinMaxScaler() and when do we use StandardScaler()? Is there any difference? or we have to try using both and see which gives better results? Please clarify

[@ankurkaiser]

Hope this answer finds you well, MinMaxScaler() an StandardScaler() are basically the same standard process except for Normalization data does't follow Gaussian Distribution and for Standardization it should. Normalization is used with models like KNN and Neutral Networks. It rescales the data between 0 to 1, so if your data doesnt't follow GD and you data ppoints are basically closer to 0/1 or if your business requirements are to normalize the data you go with MinMaxScaler(), else in general we use StandardScaler(), and its fast and easier to implement.

[@chaithanyar9961]

Hello sir , will this code work in tensor flow?? any changes to be made if I want excecute it in tf

[@laxmiagarwal3285]

This is very nice video.. But I'm having one doubt..what value u are taking for calculating the mean of error rate as prediceted values are in terms of 0 and 1

[@mdmynuddin1888]

if both category same neighbor point , than which category belongs to new data point?

[@yathishl9973]

Hi Krish, you are really amazing. I learn many things from you. I have a doubt, what measures should I take if the error rate increases with K-Value, please advice

[@KnowledgeAmplifier1]

Then you should decrease that k value, too small k value leads to overfitting, too large k value leads to underfitting , you have to wisely choose some middle value ☺️so that both bias and variance become as less as possible

[@adipurnomo5683]

If K too small that Will sensitive to outlier, if K too large that other class Will be included

[@aditisrivastava7079]

Very well explained

[@princessazula99]

for my assignment i am not allowed to use import packages for knn but I have to write it myself. do you have a code without the imported knn method?

[@ramu7762]

spot on. thank you.

[@colabwork1910]

Awesome

[@shaz-z506]

Hi Krish, Just wanna verify since you've said at 5:10 that model is ready, but KNN is instance-based learning with no parameter assumption then I don't think so that it creates any model out of the algorithm. Please let me know I'm wrong as I need some clarity.

[@devinpython5555]

Could you please explain to me why fit and transform is done for the x values (in the above example leaving target column rest data is x values)

[@vishalrai2859]

yes i also want to know

[@adipurnomo5683]

Because transform it for scale input data.

[@shaz-z506]

Hi Krish, In what scenario we'll use manhattan over euclidean.

[@madeye1258]

5.03 , if we are classifying the points based on the number of points next to it, then why we need to calculate the distance in step 2

[@adipurnomo5683]

Because calculate distance purpose is to sort value training data point before voting based K value.

[@manusharma8527]

i am not getting any any Classified Data csv file on Keggal.Please can you tell me the real name of that csv file

[@birendrasingh7133]

Awesome 😁

[@makrandrastogi5588]

can anybody tell why in most of the cases we use euclidian distance and not manhattan distance ?

[@parammehta3559]

Sir is it normal that sometimes as the value of n_neighbors is increasing the error rate is also increasing?

[@vishalaaa1]

Thank you

[@Anubhav_Rajput07007]

#Hi Krish, hope you are doing well. i trying to find the best value for K. but the code is not execute.. its running last 20 mint.

[@techtalki]

It will check all the cases of 'K'. If you want to speed up choose the less value of K or a smaller dataset.

[@vibhutigoyal769]

Is knn non- linear algorithm???

[@sunilkumarkatta9062]

How we will get error value to calculate accurate k value😅

[@uchuynguyen9927]

where you taking np.mean(pred_i != y_test), i think it should be pred_i = knn.predict(y_test) so then we will compare the predict y_test to actual y_test, then we''ll find the errors. If i wrong can somebody explain, thank you!

[@manikaransingh3234]

No, I'm sorry but you're not right! actually, pred_i is already predicted values with knn model (what you say it should be, its already done in the line above) There is nothing like finding error because it is a classification problem, not a regression one. suppose, pred_i=[1,1,1,1,0,1,0,0,0,1] test_i= [1,1,1,1,1,1,0,1,0,1] pred_i != test_i will result in [f,f,f,f,t,f,f,t,f,f] f= False, t=True thenn np.mean will take mean of true values which in this case will be 0.2(The error). I hope you get it

[@SportsKiCharcha]

@@manikaransingh3234 mean of true values mean??

[@SportsKiCharcha]

how is it 0.2 ??

[@manikaransingh3234]

@@SportsKiCharcha mean of true values is the number of True values divided by the sample. The result has 2 True values out of 10. 2/10 = 0.2

[@SportsKiCharcha]

Ok got it..thanks

[@shayanshafiqahmad]

What is the reason for taking pred_i !=y_test?

[@shivaprakashranga8688]

Pred_i value contains all the prediction values (like 1,0,1,0,0,1...) upon y_test(1,0,0,1,1,...) when K=1, pred_i !=y_test takes the value which is not predicted correctly(error) . No need to take correct predicted values. ex: out of 100 data points 60 not predicted correctly wrt y_test so these 60 data points we calculate mean. This will be continue for K=2,3.. upto 40. which ever having low mean value that we consider for K (elbow method)

[@im_joshila_aj]

So this pred_i! =y_test will return a true /false value right? In the form of 0 and 1 and then mean will be calculated?

[@weekendresearcher]

So, shud K always be an Odd number?

[@KnowledgeAmplifier1]

If you choose k value odd ,then there is more probability that tie will not occur, but still there are tie breaker available , so that we can have flexibility in choosing the k value☺️like sometime we consider weighted Nearest Neighbours or use the class with the nearest neighbor among tied groups, sometime we use a random tiebreaker among tied groups etc☺️✌️

[@sriramswar]

Hi Krish, unable to open ipynb file in Jupiter noteboox. Getting the below error: Error loading notebook Unreadable Notebook: C:\Users\Srira\01_K_Nearest_Neighbors.ipynb NotJSONError('Notebook does not appear to be JSON: \'\ \

[@krishnaik06]

Dear Sriram I am able to open the ipynb file. Please use the jupyter notebook to open the file

[@sriramswar]

@@krishnaik06 Hi Krish, I used Jupyter Notebook only. Not sure, if there is a problem at my end. Also, a suggestion! It would be better if random_state parameter is used in the code/tutorial so that everyone gets consistent results. I got different results when I tried the same code and I was confused for a moment and then understood the reason. Others may get confused, so just giving a suggestion!

[@krishnaik06]

Then probably there may be a problem with jupyter notebook file

[@tagheuer001]

Why do repeat phrases so many times?

[@sensei-guide]

As my k value increase my error rate also increasing bro

[@ahmedjyad]

It's a normal outcome and common example of overfitting. Basically, if you k value is too high, you risk the chance of having an algorithm that just outputs the class with the highest occurrence.

[@yathishl9973]

@@ahmedjyad Hi, thanks for your input, please advice how to correct it

[@ahmedjyad]

@@yathishl9973 Changing your k value is an example of hyperparamter tuning, which is a process to find the best parameter that produces the best classification model. You shouldn't really have a very high k value because that would result in over-fitting. So basically you getting higher error as u increase the k value is basically correct itself as it is expected. I hope you understand what I am trying to say. If not feel free to reach out to me.

[@dragolov]

These are 2 musical (jazz) solos generated using K Nearest Neighbor classifier: kzbin.info/www/bejne/sKWWoI1nipp0etE kzbin.info/www/bejne/iZnIpa2VaLCKodU

[@ArunKumar-yb2jn]

Krish - This seems to be a repeat of over a thousand similar videos on the internet, barring a few. What new insight have you brought here? You didn't define what that Y and X were and simply jumped into drawing X marks on the chart. Why do we need intuition of KNN? Why can't we really understand what it IS? This sort of explanation 'appears' to be clear, but in fact it really doesn't add to a student's understanding. Please take some actual data points and run the algorithm.