7.6.2. Entropy, Information Gain & Gini Impurity - Decision Tree

Поділитися
Вставка
  • Опубліковано 14 січ 2022
  • Hi! I will be conducting one-on-one discussion with all channel members. Checkout the perks and Join membership if interested: / @siddhardhan Check membership Perks: / @siddhardhan
    . In this video, I explained what is meant by Entropy, Information Gain, and Gini Impurity. You will also understand how Entropy, Information Gain & Gini Impurity are important for Decision Tree.
    All presentation files for the Machine Learning course as PDF for as low as ₹200 (INR): Drop a mail to siddhardhans2317@gmail.com
    Building Machine Learning models from scratch : • Module 7: Building Mac...
    Machine Learning Course with Python Playlist: • Machine Learning Cours...
    Machine Learning Projects Playlist: • Machine Learning Projects
    Hello everyone! I am setting up a donation campaign for my UA-cam Channel. If you like my videos and wish to support me financially, you can donate through the following means:
    From India 👉 UPI ID : siddhardhselvam2317@oksbi
    Outside of India? 👉 Paypal id: siddhardhselvam2317@gmail.com
    (No donation is small. Every penny counts)
    Thanks in advance!
    Let's build a Community of Machine Learning experts! Kindly Subscribe here👉 tinyurl.com/md0gjbis
    I am making a "Hands-on Machine Learning Course with Python" in UA-cam. I'll be posting 3 videos per week: Monday Evening; Wednesday Evening; Friday Evening.
    Download the Course Curriculum File from here: drive.google.com/file/d/17i0c...
    Enroll at One Neuron to learn from 100 courses in one subscription with 5% discount: courses.ineuron.ai/neurons/Te...
    LinkedIn: / siddhardhan-s-741652207
    Telegram Group: t.me/siddhardhan
    Facebook group: groups/49085...
    Getting error in any of the codes that I have explained? Mail the details of the error to: datascience2323@gmail.com Instagram: / siddhardhan23

КОМЕНТАРІ • 28

  • @Dickylong55966
    @Dickylong55966 29 днів тому +1

    Indian tutors are the best! thank you sir

  • @balarajukoyilapu1506
    @balarajukoyilapu1506 2 роки тому +1

    Sir, this video covered from the fundamentals with good examples. Thank you for the knowledge sharing.

  • @ohm_chiluka
    @ohm_chiluka 7 місяців тому +1

    BEst video for conceptual understanding of this concept everyone else is just solving examples good video

  • @shamikgupta2018
    @shamikgupta2018 Рік тому

    Can you please explain when to use entropy and when to use gini impurity.
    Excellent video as usual!

  • @HariPrasad-ox5ri
    @HariPrasad-ox5ri 2 роки тому

    Thanks a lot Siddhardhan!

  • @bosszz1282
    @bosszz1282 2 роки тому +1

    Can you make a video about the difference between regression decision trees and linear regression?

  • @debasmitadash9974
    @debasmitadash9974 2 роки тому

    Please do some model training using decision tree. My teachers taught this for 10hrs I couldn't get it. But i got it in you 20mins video. 💕💕💕

  • @AbrarAli-gj5ep
    @AbrarAli-gj5ep Рік тому

    please make a video on the decision tree from scratch as i really liked your logistic regression from scratch video

  • @_a_r_un_
    @_a_r_un_ 6 місяців тому

    Thnx ,For clear Explanation 👍🏻

  • @salehmusa1079
    @salehmusa1079 2 роки тому +1

    Sir please complete this playlist as soon as possible

  • @sandipansarkar9211
    @sandipansarkar9211 2 роки тому +1

    finished watching

  • @swastikmohanty7370
    @swastikmohanty7370 2 роки тому

    this video is awesome.... plzzzzzzz sir make a video on random forest with scratch of python...

  • @nithyaganesh3163
    @nithyaganesh3163 2 роки тому

    finally, whether we have to choose features which has high gini impurity or low gini impurity value?

  • @bosszz1282
    @bosszz1282 2 роки тому

    Can you make a video to introduce grid search and make a case analysis?

  • @shaiksadhiya6088
    @shaiksadhiya6088 4 місяці тому

    Osm Explanation Sir

  • @bosszz1282
    @bosszz1282 2 роки тому

    Can you give some examples when explaining the mathematical formulas to make it easier to understand?

  • @bosszz1282
    @bosszz1282 2 роки тому

    Can you do a video introduction to regression decision trees?

  • @sanika6916
    @sanika6916 7 місяців тому

    Thankyou

  • @bosszz1282
    @bosszz1282 2 роки тому

    can you make a video introducing cart pruning?

  • @neekhilsingh2114
    @neekhilsingh2114 Рік тому

    Sir i am confused… When i calculate entropy then we also calculate information gain.
    When we use gini impurity then we also calculate information gain or not ???

  • @piyushpathak7311
    @piyushpathak7311 2 роки тому

    Sir your all videos are awesome I am following all but sir can you plz upload videos as PCA, ridge regression , detection and removing of anomaly detection,and plz do sklearn implementation too with hyperparameter tuning Plz 🙏

    • @Siddhardhan
      @Siddhardhan  2 роки тому +1

      Yeah. But i can't make those videos anytime soon as I am following the curriculum. I'll definitely cover all these topics as well.

  • @shaneebkottakkal3491
    @shaneebkottakkal3491 Рік тому

    in information gain what do you mean by information, Can you please tell

  • @sharifzaman2972
    @sharifzaman2972 2 роки тому

    When will you be posting more vedios according to your curriculum?

    • @Siddhardhan
      @Siddhardhan  2 роки тому +1

      The curriculum is tentative. I assure you that all topics will be covered. But the order may change.

  • @ujwalaghodake8971
    @ujwalaghodake8971 2 роки тому

    Hello sir your videos are really osm I follow you.i send you mail hope u get that