ROC (Receiver Operating Characteristic) Curve in 10 minutes!

Поділитися
Вставка
  • Опубліковано 27 чер 2024
  • The ROC curve is a very effective way to make decisions on your machine learning model based on how important is it to not allow false positives or false negatives. In this video we introduce the ROC curve with a simple example.
    Grokking Machine Learning Book: www.manning.com/books/grokkin...
    40% discount promo code: serranoyt
    Machine Learning Testing and Error Metrics
    • Machine Learning: Test...
  • Наука та технологія

КОМЕНТАРІ • 51

  • @reverse_engineered
    @reverse_engineered 3 роки тому +21

    I have a great story about "a model that predicts worse than random". Many years ago when I first became involved in developing ML tools at work, one of my seniors noticed that the tool my team was working on was predicting things worse than random, which we found very surprising, because we had tested it before and it worked well. In fact, he scolded us for making such a terrible model, saying, "You would be better off if you guess the opposite of what your model was guessing!" Sure enough, we discovered that some refactoring had led to an extra negative sign being introduced that had flipped the direction of our model. Removing the negative got us back to a very accurate prediction!

  • @haimattias3423
    @haimattias3423 3 роки тому +15

    probably the best explanation- simple and effective illustrations, thank you very much!

  • @blesucation4417
    @blesucation4417 7 місяців тому +1

    Just want to leave a comment so that more people could learn from your amazing videos! Many thanks for the wonderful and fun creation!!!

  • @youtubecommenter5122
    @youtubecommenter5122 3 роки тому +6

    Absolutely brilliant! You're the one guy I dont mind spending a lot of money on your courses for

  • @zcjsword
    @zcjsword 3 роки тому +3

    The final prediction rotation on RoC curve is really inspiring

  • @srinivasanbalan2469
    @srinivasanbalan2469 4 роки тому +3

    Amazed with your teaching style! Kudos Dr. Serrano

  • @miskinanacademy7583
    @miskinanacademy7583 2 роки тому +2

    Very clear explanation!

  • @johanaluna7385
    @johanaluna7385 3 роки тому +2

    Your explanations are the best!!🔥🔥🔥

  • @phumlanimbabela-thesocialc3285
    @phumlanimbabela-thesocialc3285 2 роки тому +2

    Great lecture. Thanks.

  • @drishtisharma6843
    @drishtisharma6843 3 роки тому +2

    Wish you were my teacher when I was in school/college :/ Nevertheless, I'm grateful that I am getting to learn from u via youtube... Big thank you... Stay blessed

  • @MohamedMahmoud-ul4ip
    @MohamedMahmoud-ul4ip 4 роки тому +1

    Great and Amazing explanation like usual Serrano

  • @tknam3278
    @tknam3278 2 роки тому

    by far the best video on ROC curve.

  • @matthewcohen194
    @matthewcohen194 3 роки тому +2

    Thanks, you helped me clear my mind up.

  • @rishisingh6111
    @rishisingh6111 2 роки тому +1

    Awesome! This video is simply a gift; thanks for sharing this.

  • @houyao2147
    @houyao2147 3 роки тому

    Very clear. I come to realize the different curve is due to different threshold.And some threshold doesn't hurt FPR in some cases as you mentioned.

  • @yingqu6932
    @yingqu6932 3 роки тому +2

    Insightful, thanks a lot!

  • @tonakkie635
    @tonakkie635 4 роки тому +4

    Nicely explained. Would have been great if I had your video 30 years ago😅

  • @ninjanape
    @ninjanape Рік тому +1

    fantastic, thank you very much!

  • @rezakakavand4970
    @rezakakavand4970 3 роки тому

    thanks for the appropriate illustrations!

  • @kishorenagarajan344
    @kishorenagarajan344 2 роки тому

    best intution given on this topic ever !!

  • @himanshuaggarwal2445
    @himanshuaggarwal2445 Рік тому +1

    Amazing video ❤

  • @abd_sam
    @abd_sam 8 місяців тому

    Great explanation. Brilliant.

  • @te_b_52_siddeshpatankar14
    @te_b_52_siddeshpatankar14 2 роки тому

    Best on the globe 💯💯💯🙏🏻🙏🏻🙏🏻

  • @niharikadeokar3187
    @niharikadeokar3187 Рік тому

    Great video! Thank you so much

  • @MohamedMahmoud-ul4ip
    @MohamedMahmoud-ul4ip 4 роки тому

    Thank you so much

  • @cyrussalehi6206
    @cyrussalehi6206 3 роки тому

    Great video thanks

  • @crackjack7402
    @crackjack7402 3 роки тому

    This is brilliant

  • @naifalkhunaizi4372
    @naifalkhunaizi4372 2 роки тому

    You're amazing!

  • @terryadams2652
    @terryadams2652 Рік тому

    wow, thank you

  • @brikenaliko9914
    @brikenaliko9914 3 роки тому

    Perfect!

  • @alanmichaelthayil967
    @alanmichaelthayil967 2 роки тому

    Thank you :)

  • @jorgemartinezsantiago9345
    @jorgemartinezsantiago9345 3 роки тому +1

    Thanks Luis. This is the simplest and best ever tutorial in ML I have come across. do you have more courses? udemy? or other platform?

    • @SerranoAcademy
      @SerranoAcademy  2 роки тому

      Gracias Jorge! Yes, this one! www.udacity.com/course/deep-learning-pytorch--ud188
      And more to come soon, I'll announce them in the channel!
      (also I'm sorry for the very late reply) :)

    • @user-sb5rj6mi4y
      @user-sb5rj6mi4y 4 місяці тому

      ⁠​⁠@@SerranoAcademy I didn't know your deep learning course was free! 😮 Every course I found in Udacity through search was around $1,000. While I can't afford that price point, I still want to support your work. Besides buying your book and subscribing, are there any other ways?

  • @its_me7363
    @its_me7363 3 роки тому

    Very informative video, just one question can this be used as metric for multilabel classification (considering using machine learning algorithms not neural-nets)? I mean what can we get from roc-auc curve about multilabels and if not what will good metric to look for?

  • @pypypy4228
    @pypypy4228 3 місяці тому

    I am confused about what is referred to as "model". When we say that "the greater AUC the better the model" it seems to me like it's a bit of a misnomer since AUC characterises the whole set of the models (which we can obtain by translating the line from one extreme to another) but not a distinct one. A point on the curve, from the other hand, seems like a legitimate representation of "a model". It seems like these two terms are used interchangebly in the video and this is a root of my confusion. Other then that, it's a great visual!

  • @nikosips
    @nikosips 3 роки тому +1

    Did you mean "so that it won't have any false negatives at all" @2:19? By the way , great video and explanation style!

  • @ehsankhorasani_
    @ehsankhorasani_ 3 роки тому

    awesome

  • @user-sb5rj6mi4y
    @user-sb5rj6mi4y 4 місяці тому

    I am disappointed in all the professors at my university who proudly overcomplicate things. After watching your videos, all the math and advanced topics make sense and become very obvious. This channel and your videos deserve to be called "must-watch," just like Jeremy Howard's and Andrew Ng's courses. I wish your full courses were available on a platform more affordable than Udacity😅

  • @domingosdrigo
    @domingosdrigo 3 роки тому +4

    How can you make it so simple to learn?! when I need to revisit some concept I always search for: "Something that I need to learn Luis Serrano" :)

    • @SerranoAcademy
      @SerranoAcademy  3 роки тому

      Thank you Rodrigo, that's such a nice thing to hear! :)

    • @omarayman6187
      @omarayman6187 3 роки тому

      I come to say exactly the same thing! We need a video from Luis to tell us how he understands everything in simple terms like that!

  • @TheFelthat
    @TheFelthat Рік тому

    Mmmm the temptation to draw a curvy overfit line through the data

  • @varunahlawat9013
    @varunahlawat9013 Рік тому

    Hey, I wonder how could we decide in a similar situation when the number of features is not just x & y but say for example 3 features or even more?

  • @ashaytelang
    @ashaytelang 3 роки тому

    Hi, the manning website does not work. I am unable to buy the book :(

    • @SerranoAcademy
      @SerranoAcademy  3 роки тому

      Hi Ashay, sorry about that. Did you try this one?
      www.manning.com/books/grokking-machine-learning
      Let me know if that still doesn’t work. Thank you!

  • @box40able
    @box40able 3 роки тому

    ¿hay este vídeo en español?

    • @SerranoAcademy
      @SerranoAcademy  2 роки тому +1

      Hola Jairo! Este todavia no, pero pronto lo pongo. Por ahora en este canal hay algunos en espanol, pero mi plan es ponerlos en un canal separado. Por aca hare los anuncios!

  • @maj46978
    @maj46978 2 роки тому

    You are god

    • @maj46978
      @maj46978 2 роки тому +1

      Luis...its my request to make series of videos of quantum computing bay sian learning and reinforcement learning..I am ready to pay for it..it is much needed to society ...the godly person like you can make the life of people better
      Trust me you are here for giving like god ...please think of my request ..

    • @user-sb5rj6mi4y
      @user-sb5rj6mi4y 4 місяці тому

      @@maj46978 Yesssssss 💯