7.6.2. Entropy, Information Gain & Gini Impurity - Decision Tree

Hi! I will be conducting one-on-one discussion with all channel members. Checkout the perks and Join membership if interested: / @siddhardhan Check membership Perks: / @siddhardhan
. In this video, I explained what is meant by Entropy, Information Gain, and Gini Impurity. You will also understand how Entropy, Information Gain & Gini Impurity are important for Decision Tree.
All presentation files for the Machine Learning course as PDF for as low as ₹200 (INR): Drop a mail to [e-mail]
Building Machine Learning models from scratch : • Module 7: Building Mac...
Machine Learning Course with Python Playlist: • Machine Learning Cours...
Machine Learning Projects Playlist: • Machine Learning Projects
Hello everyone! I am setting up a donation campaign for my KZbin Channel. If you like my videos and wish to support me financially, you can donate through the following means:
From India 👉 UPI ID : siddhardhselvam2317@oksbi
Outside of India? 👉 Paypal id: [e-mail]
(No donation is small. Every penny counts)
Thanks in advance!
Let's build a Community of Machine Learning experts! Kindly Subscribe here👉 tinyurl.com/md0gjbis
I am making a "Hands-on Machine Learning Course with Python" in KZbin. I'll be posting 3 videos per week: Monday Evening; Wednesday Evening; Friday Evening.
Download the Course Curriculum File from here: drive.google.com/file/d/17i0c...
Enroll at One Neuron to learn from 100 courses in one subscription with 5% discount: courses.ineuron.ai/neurons/Te...
LinkedIn: / siddhardhan-s-741652207
Telegram Group: t.me/siddhardhan
Facebook group: groups/49085...
Getting error in any of the codes that I have explained? Mail the details of the error to: [e-mail] Instagram: / siddhardhan23

[@Dickylong55966]

Indian tutors are the best! thank you sir

[@balarajukoyilapu1506]

Sir, this video covered from the fundamentals with good examples. Thank you for the knowledge sharing.

[@bosszz1282]

Can you make a video about the difference between regression decision trees and linear regression?

[@shamikgupta2018]

Can you please explain when to use entropy and when to use gini impurity. Excellent video as usual!

[@_a_r_un_]

Thnx ,For clear Explanation 👍🏻

[@sandipansarkar9211]

finished watching

[@AbrarAli-gj5ep]

please make a video on the decision tree from scratch as i really liked your logistic regression from scratch video

[@salehmusa1079]

Sir please complete this playlist as soon as possible

[@debasmitadash9974]

Please do some model training using decision tree. My teachers taught this for 10hrs I couldn't get it. But i got it in you 20mins video. 💕💕💕

[@HariPrasad-ox5ri]

Thanks a lot Siddhardhan!

[@nithyaganesh3163]

finally, whether we have to choose features which has high gini impurity or low gini impurity value?

[@bosszz1282]

Can you make a video to introduce grid search and make a case analysis?

[@swastikmohanty7370]

this video is awesome.... plzzzzzzz sir make a video on random forest with scratch of python...

[@ohm_chiluka]

BEst video for conceptual understanding of this concept everyone else is just solving examples good video

[@mohammadsalikmulla6773]

👽👍🏼

[@ohm_chiluka]

@@mohammadsalikmulla6773random gc?

[@shaiksadhiya6088]

Osm Explanation Sir

[@Srv_Sngh]

Any project on Decision Tree in your playlist??

[@bosszz1282]

Can you give some examples when explaining the mathematical formulas to make it easier to understand?

[@bosszz1282]

Can you do a video introduction to regression decision trees？

[@piyushpathak7311]

Sir your all videos are awesome I am following all but sir can you plz upload videos as PCA, ridge regression , detection and removing of anomaly detection,and plz do sklearn implementation too with hyperparameter tuning Plz 🙏

[@Siddhardhan]

Yeah. But i can't make those videos anytime soon as I am following the curriculum. I'll definitely cover all these topics as well.

[@bosszz1282]

can you make a video introducing cart pruning？

[@sanika6916]

Thankyou

[@neekhilsingh2114]

Sir i am confused… When i calculate entropy then we also calculate information gain. When we use gini impurity then we also calculate information gain or not ???

[@sakshibhadoriya1911]

building and implementation?

[@shaneebkottakkal3491]

in information gain what do you mean by information, Can you please tell

[@sharifzaman2972]

When will you be posting more vedios according to your curriculum?

[@Siddhardhan]

The curriculum is tentative. I assure you that all topics will be covered. But the order may change.

[@ujwalaghodake8971]

Hello sir your videos are really osm I follow you.i send you mail hope u get that