The Gini Impurity Index explained in 8 minutes!

Поділитися
Вставка
  • Опубліковано 27 чер 2024
  • The Gini Impurity Index is a measure of the diversity in a dataset. In this short video you'll learn a very simple way to calculate it using probabilities.
    Announcement: Book by Luis Serrano! Grokking Machine Learning. bit.ly/grokkingML
    40% discount code: serranoyt
  • Наука та технологія

КОМЕНТАРІ • 97

  • @Leonardo-jv1ls
    @Leonardo-jv1ls 3 роки тому +57

    This is the exact meaning of "The simplest and best explanation".

  • @hansenmarc
    @hansenmarc 2 роки тому +19

    Best explanation of Gini impurity I’ve ever seen. Thank you!

  • @RogerVandervort
    @RogerVandervort 2 роки тому +13

    This explanation is, by far, one of the most simple and direct. It drives an intuitive understanding of the calculation.

  • @celismaroliveira6081
    @celismaroliveira6081 Місяць тому

    That is the best explanation of Gini impurity I’ve ever seen!
    Even 8-year-old children can get it. Amazing!
    Congrats Luis Serrano/Serrano Academy!!

  • @supersql8406
    @supersql8406 3 роки тому +3

    The best gini index explanation!!

  • @reverse_engineered
    @reverse_engineered 3 роки тому +5

    What a great and simple way to explain it! I love these visual demonstrations.

  • @ssshukla26
    @ssshukla26 3 роки тому +17

    Wow... It was this simple... Certainly I didn't learn this simply enough to understand at my uni... Not my prof's fault btw...

  • @marcinstrzesak346
    @marcinstrzesak346 Рік тому +2

    Very good explanation. Thank you

  • @JaviOrman
    @JaviOrman 3 роки тому +4

    What an intuitive explanation!

  • @srisrinivas9873
    @srisrinivas9873 3 роки тому +2

    Very intuitive and easy to grasp. Thanks for your effort Luis Serrano.

  • @wanderbeautyE
    @wanderbeautyE Рік тому

    Thank you for your explanation!!! I finally understood what GINI impurity index means!! :D

  • @shubha07m
    @shubha07m Рік тому

    THE Best explanation of Gini index ever, YOU are awesome!

  • @zukofire6424
    @zukofire6424 Рік тому

    Thanks Pr. Serrano for this! It helps prepare for my exam! :)

  • @skamal4u
    @skamal4u Рік тому +1

    one of the best explanation ever . so simple and easy to follow 👏👏👏

  • @xxelurraxx232
    @xxelurraxx232 Рік тому

    This was a fantastic explanation of the formula! The visuals helped a ton. Thank you so much!

  • @joragondafacultyeeedept309
    @joragondafacultyeeedept309 Рік тому

    Great Serrano. Best of the presentations I have come across. You are a great teacher. Kudos

  • @user-ph1ze2st4s
    @user-ph1ze2st4s 7 місяців тому

    Great explanation, able to understand in one go!!

  • @alexbuchko323
    @alexbuchko323 Рік тому

    This is an amazing explanation, I didn't know it was that simple!

  • @Q793148210
    @Q793148210 2 роки тому

    This is the best gini index video by far ! thankyou

  • @VidyaBhandary
    @VidyaBhandary 3 роки тому +1

    Awesome explanation ! Thank you for this.

  • @bryanbischof4351
    @bryanbischof4351 3 роки тому +4

    Great visualizations and explanations.

  • @flaviospadavecchia5126
    @flaviospadavecchia5126 3 роки тому

    Thank you, Luis! I'm enjoying your book very much :)

  • @abeferszt2408
    @abeferszt2408 5 місяців тому

    One of the best explanations I've seen

  • @kirtichandrakomarraju5164
    @kirtichandrakomarraju5164 2 роки тому

    Explained like a King !!

  • @abail7010
    @abail7010 4 місяці тому

    This is such a good and intuitive explanation. Well done and thank you!!

  • @developerboy8341
    @developerboy8341 3 роки тому

    Probably best I got the best intuition of Gini index from it, can't thank you enough Man.

  • @tooniatoonia2830
    @tooniatoonia2830 2 роки тому

    This man called Luis is a genius, I take Udacity course because of you!

  • @736939
    @736939 7 місяців тому

    The real scientist can explain everything by the simple terms. You're the real scientist and thank you very much, unfortunately there are not so many scientist (especially physicians) who are able to use simple language.

  • @alioraqsa
    @alioraqsa Рік тому

    best explanation i've seen so far

  • @abdulkarim.jamal.kanaan
    @abdulkarim.jamal.kanaan 3 роки тому

    this is the best explanation; I hope the book is as easy to understand as this one :)

  • @TheSoonAnn
    @TheSoonAnn Рік тому

    thanks for explanation, concise and clear

  • @TheDavidlloydjones
    @TheDavidlloydjones 3 роки тому +4

    Bug Report: Audio vs. video glitch at 0:57~1:01.
    Spoken "on the right it's gonna be 0.47."
    Video shows 0.7.

  • @alokranjancs
    @alokranjancs 2 роки тому

    I rarely put comments on youtube but this is such a nice explanation of the concept. Thank you

  • @murilopalomosebilla2999
    @murilopalomosebilla2999 3 роки тому

    Really well explained! Thanks!!

  • @arshadkazi4559
    @arshadkazi4559 2 роки тому

    Amazing, just what I wanted!

  • @johannahultgren2887
    @johannahultgren2887 Рік тому

    Wow this was so good explained!😍 i'm an AI and neuroscience student and your videos are helping me out a lot!🙏

  • @shaporovanatalia6805
    @shaporovanatalia6805 Рік тому

    Best explanation ! Thank you!

  • @srinivasachary7392
    @srinivasachary7392 3 роки тому

    Wow... Great. Superb Explanation

  • @apristen
    @apristen 2 роки тому

    thanks for great easy to understand explanation!!!

  • @fabio336ful
    @fabio336ful Рік тому

    Th explanation I was looking for!

  • @zaidkidwai7831
    @zaidkidwai7831 Рік тому

    Very well explained, thank you

  • @shashanktripathi3034
    @shashanktripathi3034 3 роки тому

    This Really helped Great Work
    Thanks

  • @scooby95219
    @scooby95219 2 роки тому

    very good explanation. thank you!

  • @alphonseinbaraj7602
    @alphonseinbaraj7602 3 роки тому

    Wonderful... Great explanation

  • @MariaFlorenciay
    @MariaFlorenciay 2 роки тому

    Very well explained!

  • @marekglowacki2607
    @marekglowacki2607 3 роки тому +1

    Great explanation! Could you make an video on Gini Impurity Index vs Gini Coefficient?

  • @siddarthbali12
    @siddarthbali12 3 роки тому

    Great explanation

  • @vaibhavmishra232
    @vaibhavmishra232 Рік тому

    very geniously explained

  • @forpublicstuff728
    @forpublicstuff728 2 роки тому

    Awesome! Thank you.

  • @emrahyener402
    @emrahyener402 3 роки тому

    You are great! keep going please!

  • @thanhtung24
    @thanhtung24 Рік тому

    Best explanation

  • @mattcobras
    @mattcobras 2 роки тому

    that's awesome, I like your lesson.

  • @mshirazbaig6055
    @mshirazbaig6055 2 роки тому

    Good explanation

  • @user-yu6fs4gj6r
    @user-yu6fs4gj6r 2 роки тому

    Thank you very much.

  • @shubhamtalks9718
    @shubhamtalks9718 2 роки тому

    Amazing!!!

  • @chanduiit42
    @chanduiit42 3 роки тому

    The best..the best one

  • @denisr5250
    @denisr5250 Місяць тому

    This was an awesome explanation! One small question (maybe correction?) - at around 7:20 shouldn't the Gini index of the diverse set be 1 - (0 + 0 + ... +0) since the probability of getting the same element twice is 0 - there are 10 unique elements i.e. no duplicates, so it's impossible to pick two of the same item.

  • @stephennjuki4206
    @stephennjuki4206 8 місяців тому

    thanks. very succinct.

  • @ian-haggerty
    @ian-haggerty 29 днів тому

    Awesome! You've sold another book :)

    • @SerranoAcademy
      @SerranoAcademy  29 днів тому

      Yay thanks! Enjoy, and lemme know what you think!

  • @abdelrhmanrhyaseen6194
    @abdelrhmanrhyaseen6194 2 роки тому

    Amazing

  • @MritunjayKumar-ck4hx
    @MritunjayKumar-ck4hx 2 роки тому

    amazing

  • @kishorab
    @kishorab 2 роки тому +1

    Is Gini index being calculated with replacement. Blue,red,green,yellow squares consist of items being paired with themselves. If an item is picked it can only be paired with itself by replacing it back.

  • @jerrerock
    @jerrerock Рік тому

    Thanks.

  • @thegreatdream8427
    @thegreatdream8427 2 роки тому

    This is basically a measure of average distance between pairs of points in a space. In this case all the points are vertices of a regular unit simplex, so if two elements are the same they're the same point, and if different their distance is 1. If instead you have degrees of difference - distances in type-of-thing-space - the simple formula using squares would stop working, but it would fit the real world better. :)

  • @bhaveshvoswal
    @bhaveshvoswal 3 роки тому

    Nice

  • @michelcusteau3184
    @michelcusteau3184 Рік тому +1

    You mention that Gini Impurity is going to give values between the range of 0 - 1, However from other sources it says that the Gini Impurity only going to output values between the range of 0 - 0.5 . Is this a mistake in the video?

  • @vaggelisntaloukas2016
    @vaggelisntaloukas2016 Рік тому

    Thanks!

    • @SerranoAcademy
      @SerranoAcademy  Рік тому

      Thank you so much for your kind contribution Vaggelis! 😊

  • @ritikchopra4429
    @ritikchopra4429 2 роки тому +1

    Hey, great explanation but I have a doubt, why are we allowed to pick the same element twice?

  • @laviusdev3763
    @laviusdev3763 2 роки тому

  • @alexvass
    @alexvass 6 місяців тому

    Thanks

    • @SerranoAcademy
      @SerranoAcademy  6 місяців тому

      @alexvass thank you so much for your kindness!!

  • @samyakjain7674
    @samyakjain7674 2 роки тому

    Awesome explanation. This is part of Decision Tree algorithm but you are not making any video on Decision Tree. How Decision tree algo makes nodes and condition itself without applying our own if else statement? Clear explanation on internal working of Decision Tree is not available on youtube that how it works from scratch only using python without using any library like sklearn.

  • @oatmilk9545
    @oatmilk9545 8 місяців тому

    I don't get the last example with 10 different classes. in this case, we're never going to have a pair of equal elements (which you started your video with); and in the square where we seek for intersections of two classes, we'll have just an empty cell for each pair of elements from the same class because, again, their pairing isn't possible

  • @milenkoobradovic2896
    @milenkoobradovic2896 2 роки тому

    👏👏👏

  • @eric_bonucci_data
    @eric_bonucci_data Рік тому

    This definition of the Gini index is different from the one in Introduction to Statistical Learning with R (Equation 8.6 p.335), could you please elaborate on that ? Thank you

    • @eric_bonucci_data
      @eric_bonucci_data Рік тому +1

      I just figured it out : the sum of the proportion of training observations over all classes is equal to 1, so sum(pk(1-pk)) = 1 - sum(pk^2)

    • @eric_bonucci_data
      @eric_bonucci_data Рік тому +1

      Knowing that other definition from ISLR also helps to understand why the Gini index can be seen as the probability of sampling two observations of different class in the dataset.

  • @camzbeats6993
    @camzbeats6993 5 годин тому

    Top

  • @usmanriaz94
    @usmanriaz94 2 роки тому +1

    I thought maximum value of gini index is .5. i am confused. can somebody help ?

  • @ahmadawad4782
    @ahmadawad4782 3 роки тому +1

    It seems that the link is wrong. Gives error 404, page not found.

    • @SerranoAcademy
      @SerranoAcademy  3 роки тому +1

      Thank you Ahmad! Fixed

    • @ahmadawad4782
      @ahmadawad4782 3 роки тому +1

      @@SerranoAcademy Thanks. Just purchased an ebook copy. Can't wait to read through.

    • @SerranoAcademy
      @SerranoAcademy  3 роки тому +2

      @@ahmadawad4782 so glad to hear, thank you! I hope you like it! :)

  • @angjelinhila927
    @angjelinhila927 Рік тому

    Je suis confus. Isn't max gini standardized to 0.5? In other words 1 - (0.5^2 + 0.5^2) = 0.5?

  • @noelthomasbejoy3089
    @noelthomasbejoy3089 3 роки тому

    if theres only oneof them ,how can 1/10 ^2 exist.Since it cant be selected twice?

  • @ger9551
    @ger9551 2 роки тому

    what happens if all gini index is 0?

  • @prackertracker7189
    @prackertracker7189 2 роки тому

    2:33 here you say gini is the propability of picking two distinct data points of a data set. At the end you present a totally diverse data set and say the gini index is 0.9. How is that possible since the propability of picking two totally different data points i 100% because we only have distinct and none data points that are the same?

    • @loftyTHEOWNER
      @loftyTHEOWNER 2 роки тому +1

      I understood there is no sampling. Just a matrix of all the observations. So for 10 different objects, we have a matrix 10x10 and the elements on the diagonals are equal of course, so you d0 (100 - 10) / 100 = 0.9

  • @nijat6704
    @nijat6704 Рік тому

    As I know the Gini index ranges between 0 and 0.5. So the answer that you found seems wrong

  • @kabilakamal8269
    @kabilakamal8269 3 роки тому

    Well explained 👍
    Another precise detailed video like that of “Matrix Factorization” 😂
    Please can I have your contact email. I’d like to reach you personally. Thank you

    • @SerranoAcademy
      @SerranoAcademy  3 роки тому

      Thank you Kabila! Absolutely, the best way to get in touch is through here serrano.academy/contact/

  • @mohamedgaal5340
    @mohamedgaal5340 2 роки тому

    Thanks for this concise explanation!