Regression Trees, Clearly Explained!!!

Поділитися
Вставка
  • Опубліковано 27 вер 2024

КОМЕНТАРІ • 1,2 тис.

  • @statquest
    @statquest  2 роки тому +16

    Support StatQuest by buying my book The StatQuest Illustrated Guide to Machine Learning or a Study Guide or Merch!!! statquest.org/statquest-store/

  • @pralhadkulkarni7520
    @pralhadkulkarni7520 4 роки тому +555

    Who came here after paying for ML courses on Udemy???? This explanation is far far better than those paid courses.

    • @statquest
      @statquest  4 роки тому +52

      Thank you! :)

    • @Apurvsankhyadhar
      @Apurvsankhyadhar 4 роки тому +14

      Me lol. That tutorial instructor is a real jackass

    • @claudiusandika5366
      @claudiusandika5366 4 роки тому +12

      shhyitt you got me bro lololol.. since i can't just move on on some technical aspect without clear understanding

    • @as4end
      @as4end 4 роки тому +4

      true story here

    • @sumanthreddy8829
      @sumanthreddy8829 4 роки тому +6

      Absolutely u r correct

  • @altus3278
    @altus3278 4 роки тому +560

    Screw Udemy, this guy explains better than my Machine Learning professor. You are the Bob Ross of statistics.

    • @statquest
      @statquest  4 роки тому +72

      BAM! :)

    • @Kaelovision
      @Kaelovision 3 роки тому +7

      whos is Rob Boss, the painter?

    • @user-sb5rj6mi4y
      @user-sb5rj6mi4y 3 роки тому +3

      Couldn't agree more, Love you Josh

    • @MarkLambertz
      @MarkLambertz 2 роки тому +2

      That’s the most beautiful I have read today.

    • @rdebnath
      @rdebnath 2 роки тому +2

      This comment should be taken very seriously! Please don't spend money on Udemy - they sell crap! I am a victim of Udemy myself. Josh rocks!

  • @LMessii10
    @LMessii10 8 місяців тому +22

    Added more value than a fricking Harvard or Standford course in less than 15 minutes. Great job, I am forever greatful Josh !

  • @carlossouza5151
    @carlossouza5151 5 років тому +202

    Dude, you are a gifted teacher... well done, keep it up!

  • @jcatlantis
    @jcatlantis 5 років тому +157

    This is the best channel ever! I am a postdoc enjoying every single video ;)

  • @dvirginz4001
    @dvirginz4001 4 роки тому +26

    You are just something else, I just can't believe how every time I return here, things that I used for years become suddenly clear.

    • @statquest
      @statquest  4 роки тому

      Thank you very much. :)

  • @aggelosdidachos3073
    @aggelosdidachos3073 4 роки тому +15

    Honestly, after every video I watch, I feel like I want to express gratitude. Clearly, you know how to explain clearly.

  • @dtn6000
    @dtn6000 4 роки тому +10

    A picture (or video) is worth a thousand words. After scratching my head from looking at written formulas of how regression trees are created, this instantly cleared things up. Thank you!

  • @siddharth2438
    @siddharth2438 4 роки тому +67

    I have completed the whole series on Trees till XGBoost! These are real treasure in teaching ML and trust me I have read a lot of books, ESL, Gilbert Strang, Larry Wasserman to name a few. I truly appreciate what you are doing and I will join your patreon!

    • @statquest
      @statquest  4 роки тому +6

      Thank you very much!!!! I really appreciate your support and encouragement.

    • @kobeyang8828
      @kobeyang8828 9 місяців тому

      Are there any books recommended for an ML beginner? Thank you!

  • @BrunoGarofalo-s3c
    @BrunoGarofalo-s3c 6 місяців тому +3

    John, I just bought your book. Not because I need it, but because you deserve it. God bless you, you are godsent. you explain ML 10 times better than my professor

  • @breopardo6691
    @breopardo6691 3 роки тому +25

    In Josh we trust!
    What an awesome video Josh, you make ML understanding a pleasure...you are a gifted person and I am so happy you actually share.

    • @statquest
      @statquest  3 роки тому

      Thank you very much! :)

  • @jeternity1656
    @jeternity1656 4 роки тому +20

    This was a better explanation by like 100 folds compared to explanation in my data science course for which I paid money.

    • @statquest
      @statquest  4 роки тому +1

      I'm glad you like the video! :)

    • @joejekpenyong
      @joejekpenyong 4 роки тому

      name your course please.

  • @asdkazmi
    @asdkazmi 2 роки тому +4

    OMG, I don't have words to appreciate this lecture. This is an impressive lecture I found for the Decision Trees algorithm. Thank you dear for your effort. I'm pretty sure you would come to need a lot of work to prepare for this lecture.

  • @Sripooja.Mahavadi
    @Sripooja.Mahavadi 5 років тому +141

    Statquest! Statquest!
    Can you note that you are the best!
    I have always hated statistics
    But now I love it coz of your tricks
    standard deviation and standard error
    After you taught it's no brainer
    I know these lines are cheesy
    But somehow you have made life easy :)

    • @statquest
      @statquest  5 років тому +44

      This is the best poem ever!!!!! Triple BAM!!!

    • @vikranttyagiRN
      @vikranttyagiRN 4 роки тому +1

      Absolutely Amazingg

    • @jamesang7861
      @jamesang7861 4 роки тому +1

      BAM!

    • @klam77
      @klam77 4 роки тому +2

      @@statquest Hey cut back a bit guys.....I'm diabetic.

  • @tanuj05
    @tanuj05 5 років тому +26

    This has got to be one of the most entertaining educational videos ever made! You're just fabulous!

    • @statquest
      @statquest  5 років тому +1

      Thank you very much! :)

  • @jamesang7861
    @jamesang7861 4 роки тому +2

    The search ends here. THere is no need to watch multiple videos to understand regression trees. this is the perfect video. Thank you JOsh!

    • @statquest
      @statquest  4 роки тому

      Thank you very much! :)

  • @FelipeSagan
    @FelipeSagan 3 роки тому +5

    How can anybody give dislike for this series of videos? 1) Other teachers from paid courses or from another channel 2) Egocentric people- "That´s too simple, you are insulting the statistics" 3) Naturally born haters 4) The ones that accidentally press the thumbs down instead of thumbs up QUADRUPLE BAM!

  • @ruslanjabrayilov7363
    @ruslanjabrayilov7363 4 роки тому +10

    Immaculate teaching style. I love how you give a detailed intuition behind these otherwise complex topics!

    • @statquest
      @statquest  4 роки тому

      Thank you very much! :)

  • @jjlian1670
    @jjlian1670 4 роки тому +5

    Oh My God, Josh! Your channel is pure gold. I can not express how I like ur channel about all the explanations on complex ML concepts!

  • @abhiashu1
    @abhiashu1 Рік тому +1

    Omg I can't believe the teaching has been done by real human. It feels like Robot is teaching. I will recommend this channel to all my friends, Thanks you so much!!

  • @innocentlord7985
    @innocentlord7985 4 роки тому +4

    Josh, you are a blessing. I am filling all my gaps that my uni education thus far failed to do so and in that regard thank you for filling it in with something concrete that hopefully will stand for long and might grow strong by time. Stay happy man and the songs they kinda grew upon you, they are catchy.

    • @statquest
      @statquest  4 роки тому +1

      Thank you very so much! :)

  • @VishalVerma-gc7pr
    @VishalVerma-gc7pr 3 роки тому +1

    I have almost never commented or liked any videos on youtube but you are the one who made me proud to like your videos. you have beaten up all those paid and much-marketed course on machine learning and statistics A very thank you josh Starmer and tbh those bams do stick into people's head no lie.

    • @statquest
      @statquest  3 роки тому

      Wow! Thank you very much! :)

  • @COMREdesign
    @COMREdesign 4 роки тому +6

    Today only I got to know "why decision trees". Your teaching is the best. blessings!

  • @RS-fe1hk
    @RS-fe1hk 3 роки тому +2

    The best video ever i have seen.. Trust me I was searching for random forest as regression concept all over internet and couldn't find as best as this one.... ❤️❤️

  • @thehoangnguyen9985
    @thehoangnguyen9985 5 років тому +5

    Just found this channel recently, your explanation is better than any videos on youtube, it helps me a lot on my Data Science journey. Keep it up bro!

  • @siddharthmodi5908
    @siddharthmodi5908 3 роки тому +2

    God level of explaination. This guy is doing marvolous job. You are a treasure for us, your channel is a one stop shop for us. Hats off for your efforts.

  • @samerrkhann
    @samerrkhann 3 роки тому +7

    I just can't believe someone can teach me ML in this greater depth for free!
    you really are super awesome Josh!
    Thank you for all the hard work you put

    • @statquest
      @statquest  3 роки тому +1

      Thank you very much!

  • @thankhashem
    @thankhashem Рік тому +1

    you have saved me so much time in life, i could cry

  • @6471917
    @6471917 4 роки тому +7

    You've a talent for explaining things nice and clear. Wonderful. Thank you so very much!

  • @chillpillgamer4980
    @chillpillgamer4980 3 роки тому +1

    I'm the type of person who want to know true meaning behind all concept and if the statquest was not here I don't how much time would I waste to find all these. I can't thank u enough sir

  • @kalebnegussie8140
    @kalebnegussie8140 2 роки тому +4

    This is extremely well explained. I feel like I can explain clearly now too. Well done!!!

  • @karthiks1157
    @karthiks1157 3 роки тому +1

    Honestly josh , After completing Machine learning in Coursera and Udemy , never got as much satisfaction after watching your videos , Iam redoing entire Machine learning from your videos.

  • @paperpaper7812
    @paperpaper7812 5 років тому +28

    Nice man, really nice. Unfortunately, I live in a hostile country and I could not pay for joining.

    • @statquest
      @statquest  5 років тому +33

      Just thinking about supporting me means that you are awesome! BAM! :)

  • @ManojKumar-qd2mx
    @ManojKumar-qd2mx 3 роки тому +1

    No one explained regression trees more clearer than him. Thank you 😊😊😊

  • @mrunmayeejog5413
    @mrunmayeejog5413 4 роки тому +3

    I tried reading so many examples but your explanation is so good!! Keep teaching awesome concepts so that beginners like me can keep learning :D

  • @casualpasser-by5954
    @casualpasser-by5954 Рік тому +2

    The most clear explanation imaginable! Thank you, professor!

  • @prashant4814
    @prashant4814 4 роки тому +6

    i feel luck that i found this channel .god bless you

  • @alienmathology6251
    @alienmathology6251 8 місяців тому +1

    Treasure for anybody , interested to learn statistics and statistical learning.... thanks a lot josh the effort you put behind the lucid explanation ...

    • @statquest
      @statquest  8 місяців тому

      Glad you enjoyed it!

  • @glowish1993
    @glowish1993 5 років тому +3

    my lucky day because I was searching for regression tree and was wondering if statquest made a video on it already :)

    • @statquest
      @statquest  5 років тому +1

      YES! I'm glad you found my latest video. Support Vector Machines is next...

  • @ragabmousa8794
    @ragabmousa8794 4 роки тому +1

    Excellent video for understanding all Regression Tree details. Did not believe it when I read "Clearly Explained", but it turned out very clear. Thank you

    • @statquest
      @statquest  4 роки тому

      Thank you very much! :)

  • @Kenny-bk5rf
    @Kenny-bk5rf 3 роки тому +5

    Thank you for your great explanation! I have a question: In your example of "building a regression tree with one variable" (i.e. dosage), the tree had several layers of branches split by different thresholds of dosage. Then moving on to your example of "building a regression tree with multiple variables", only one threshold of dosage was used (

    • @statquest
      @statquest  3 роки тому +6

      Regardless of how many variables we have in our data, when we try to decide how to split the data at a branch in the tree, we always check every single one, and every single relevant threshold, and select the one that results in the lowest SSR. So, at any branch in the tree we check dosage, sex and age with a bunch of different threshold and use the one that gives us the lowest SSR.

    • @kofsphere
      @kofsphere 2 роки тому

      @@statquest I think he meant "So, at any branch in the tree we check dosage, sex and age with a bunch of different threshold and use" MORE THAN ONE that gives us the lowest SSR, just like those you used in the example with single variable dosage.

  • @troy_neilson
    @troy_neilson 2 роки тому +1

    Some of the best descriptions online...!

  • @rishabhjain1418
    @rishabhjain1418 2 місяці тому +3

    I feel like, why can't I cite this in my dissertation!!! Instead of citing those non-sensical papers and textbooks!!!

  • @MingChen0919
    @MingChen0919 2 роки тому +1

    BAM!!! I am addicted to these videos! Thank you so much, sir!

  • @raghavkhemka14
    @raghavkhemka14 4 роки тому +7

    BAM!! Now I know Regression Trees without having to watch any other video.

  • @edwinwang5594
    @edwinwang5594 Рік тому +1

    I just want to say that your 20 bucks ebook is more useful than the college course I pay thousands of dollars for.

  • @cesarp1940
    @cesarp1940 10 місяців тому +1

    Wow…This is by far the best explanation about this topic. Thanks Josh

  • @amazing_human_slash_genius1492
    @amazing_human_slash_genius1492 4 роки тому +1

    I usually don't comment youtube vídeos, but I gotta say: this was very helpful for my data science study. Thanks for sharing your knowledge in a way that everyone can understand. Keep the good work!

    • @statquest
      @statquest  4 роки тому

      Thank you very much! :)

    • @shivamsehgal9120
      @shivamsehgal9120 4 роки тому

      why is he taking 14.5 as the root node???

    • @statquest
      @statquest  4 роки тому

      @@shivamsehgal9120 Can you tell me what timepoint (minutes and seconds) in the video where you are getting confused?

  • @kamranabbas2438
    @kamranabbas2438 4 роки тому +1

    I am currently trying to implement some regression ml methods to the data and these videos by Statquest are so simple and at the same time so informative, that if I don’t understand something, I come to find an explanation on Statquest. Thank you very much!

  • @DrMario-ot3ff
    @DrMario-ot3ff 2 роки тому +1

    I would be willing to pay if this course charges. Love it.

  • @daissyherrera8613
    @daissyherrera8613 4 роки тому +1

    This is the best channel for machine learning beginners. This help me so much, thank you alot! i will recommend your channel with my friends!

    • @statquest
      @statquest  4 роки тому

      Thank you very much! :)

  • @taochen746
    @taochen746 4 роки тому +2

    Best channel ever for the stats and machine learning concepts!

  • @akshaymahale6521
    @akshaymahale6521 3 роки тому +1

    Loved it ! Read several blogs, but no one can explain it like JOSH !!!

  • @tamarapetrova8440
    @tamarapetrova8440 Рік тому +1

    Thank you so much! Very well explained! And the pace is just right, not too slow and not too fast :)

  • @sanjayb6173
    @sanjayb6173 3 роки тому +1

    BAMMM!!!!..This is so perfect and Precise. Thanks a lot Josh

  • @SuperShogee
    @SuperShogee Рік тому +1

    Great video, love it, finally understand sum of square residuals and that it's not just a random number from a stat output. Keep up the good work!!

  • @aounhaider8335
    @aounhaider8335 Рік тому

    Please upload lectures on deep learning subjects especially computer vision. You have visualized all the concepts very effectively and deserves more than a typical university instructor.

    • @statquest
      @statquest  Рік тому

      See: ua-cam.com/video/CqOfi41LfDw/v-deo.html

  • @Targearean
    @Targearean 4 місяці тому +2

    Wonderful lecture! I liked the way you taught.

  • @anhbui8822
    @anhbui8822 2 місяці тому +1

    I like how you BAM your explanation, it does help me feel smarter :D

  • @profmo
    @profmo 3 роки тому +1

    Best video ever. I am going to become Patreon supporter. We need people like you to continue making videos.

  • @eremastade6894
    @eremastade6894 2 роки тому +1

    this helped me with a major project of mine back in 2020

  • @fatemehamrollahi2706
    @fatemehamrollahi2706 3 роки тому +1

    Thanks for very clear and amazing explanation. your explanation for regression trees is far better than my ML course.

  • @sanathdas4071
    @sanathdas4071 4 роки тому +2

    You have really relieved me. Thank you so much. God bless you.

  • @bibiworm
    @bibiworm 3 роки тому +2

    Great content! I am reading ESL these days. And it can get really abstract and esoteric. Your videos make it much easier for me to understand the book. Thank you so much. And I bought your study guide too.

    • @statquest
      @statquest  3 роки тому +1

      Thank you very much!! :)

  • @tank821
    @tank821 3 роки тому +1

    A great explanation about the regression decision tree!!

  • @amitabhasingha2093
    @amitabhasingha2093 3 роки тому +1

    Awesome explanation! Kudos!! I would repeat what others have said. You are an expert at simplifying complex concepts!!! Triple Bam!!!

  • @HDelTrueno
    @HDelTrueno 3 роки тому

    BAMMM!!!! from Perú, tnks a lot!! I´m a candidate of a Master degree and your videos make my day

    • @statquest
      @statquest  3 роки тому

      Hola Perú. I'm glad my video was helpful. Good luck with your master degree! p.s. I have always wanted to go to Perú since I was a child and am trying to learn Spanish so I can go.

    • @HDelTrueno
      @HDelTrueno 3 роки тому

      ​@@statquest Hey, Thanks for your wish, It will be an honor to show you my country if sometimes you come; my family and I will be pleased to host you if you want. My girlfriend and I speak english, perhaps we can be helpful.

    • @statquest
      @statquest  3 роки тому

      @@HDelTrueno BAM! That would be awesome.

  • @nitinkhatri9966
    @nitinkhatri9966 5 років тому +2

    Best And Simplest Explanation ever.
    THANKS.

    • @statquest
      @statquest  5 років тому +1

      Hooray! Thank you! :)

  • @Thomas-wx1sh
    @Thomas-wx1sh 4 роки тому +1

    十分感谢,相对于书上的抽象理论 这给了我更加清晰和直观的理解。

  • @Saroa434
    @Saroa434 3 місяці тому +1

    I love it when you say BAM!❤

  • @yasarmehmood4055
    @yasarmehmood4055 2 роки тому +1

    Brilliant teacher. Impressed by the energy and passion

  • @prajaktai3292
    @prajaktai3292 3 роки тому +1

    Amazing explanation Dr.Starmer, and the sounds you create while calculating values...they are indeed funny .. thanks

  • @xhesil8848
    @xhesil8848 5 років тому +2

    The distribution of observations looks like two sigmoid functions connected to each other, like a Gompertz function (ae^-be^-cx) multiplied by a partner with negative c (ae^-be^cx). I know, there are countless distributions where this won't be the case, but, hey, I saw a fit, and I took it.

  • @tymothylim6550
    @tymothylim6550 3 роки тому +2

    Thank you very much for this video! It was fun to watch and I learnt a lot from the whole step-by-step process of building the simple regression tree :)

  • @ryuzakace
    @ryuzakace 4 роки тому +1

    BAM! Watched first video, subscribed, watched 4 more videos that were not relevant to my current quest ;) DOUBLE BAM! I think this is going to be my second home!

    • @statquest
      @statquest  4 роки тому +1

      Hooray!!! Thank you very much :)

  • @Bennilenny
    @Bennilenny 4 роки тому +1

    Man, your videos are really helping me through my econometrics classes! Thanks!

  • @aasiralikhan7205
    @aasiralikhan7205 2 роки тому +1

    Simply brilliant explanation Josh! You make this so easy! TQ

  • @АнастасияКошелева-з2х

    God I love this channel so much, it makes complicated things which I couldn't understand during university so simple

  • @jogeshnanda7704
    @jogeshnanda7704 4 роки тому +1

    How can these 10 people dislike this video. Kind of never satisfied soul.
    BTW, very well explained, thank you very much. I am becoming fan of your explanation... BAMMMMMM!!!!!!!!

  • @harikajayanthi8127
    @harikajayanthi8127 2 роки тому +1

    Best videos. Best Teacher. Thank you so much

  • @gracealexandragonzalez7022
    @gracealexandragonzalez7022 3 роки тому +2

    omg this is so gooood! can't believe I didn't find this earlier... thank you!!!

  • @dickyr4437
    @dickyr4437 4 роки тому +2

    Josh, great explanation! It would be nice if you give the data values also on one of the screens so those who want to try them out can do so. Thanks!

  • @killerstrike1208
    @killerstrike1208 3 місяці тому +1

    Finally ❤ you're a great teacher

  • @saurabhchand5211
    @saurabhchand5211 Рік тому +1

    OMG you just explain it so simple sir love you so much

  • @chandragupta2828
    @chandragupta2828 4 роки тому +1

    after each of your lecture, i listen to your music....specially Christmas night

  • @jagjyotsingh8456
    @jagjyotsingh8456 6 місяців тому +1

    Lots of love from the MBA cohort @ University of Maryland college park 🌹❤️

    • @statquest
      @statquest  6 місяців тому

      BAM! And good luck! :)

  • @marcoycaza1920
    @marcoycaza1920 3 роки тому +1

    This is the "ol' trustable" when it comes to understand difficult machine learning | stat stuff

  • @marknoyanzin6108
    @marknoyanzin6108 Рік тому +1

    BAMMM!!!! Это первое абсолютно понятное объяснение! Я потрясен!

  • @shivanshjayara6372
    @shivanshjayara6372 3 роки тому +1

    Don't know how do i thank you. U made this so do so easy

  • @ashilshah3376
    @ashilshah3376 Рік тому +1

    Your videos are still helping, thank you soo much :)

  • @hosseinaboutalebi9998
    @hosseinaboutalebi9998 5 років тому +2

    You are awesome man! I really like your videos and especially the way you make a complex concept very simple. The only thing I would like to see in the future is more videos on deep learning and machine learning.

  • @bhaumikmehta7718
    @bhaumikmehta7718 Рік тому +1

    Clear and effective presentation. Great job!

  • @lightspd714
    @lightspd714 2 роки тому +1

    You are an awesome teacher. Really appreciate the wonderful content. Also, the BAM’s never fail to make me laugh.

  • @hsl2916
    @hsl2916 4 роки тому +1

    the best machine learning youtube video I have watched. Thank you statquest~

  • @ankk98
    @ankk98 Рік тому +1

    What an awesome teacher!

  • @sujithsaikalakonda4863
    @sujithsaikalakonda4863 10 місяців тому +1

    Wonderful explanation sir. Appreciate the efforts.

    • @statquest
      @statquest  10 місяців тому

      Thanks and welcome!

  • @yuridialeyva8954
    @yuridialeyva8954 4 роки тому +1

    BAAAMMMM! This is such a great video! I'm so glad I encountered Stat Quest!

  • @sushilchauhan2586
    @sushilchauhan2586 4 роки тому +1

    Instead of taking "MSE" we can take "MAE" when we have small datasets ,BAM!... but i will take MSE AND FOLLOW YOUR TUTORIAL
    THANK YOU GUARDIAN!

    • @statquest
      @statquest  4 роки тому

      True. You can use a variety of metrics. Mean Squared Error is the one used with regression trees in The Introduction to Statistical Learning and is the default for many implementations, but you can easily use other metrics, like MAE.

    • @sushilchauhan2586
      @sushilchauhan2586 4 роки тому

      @@statquest josh i have a Question...
      if i want to apply decision tree on bag of words ..there i know my matrix will be sparse and my features will be words so how could i apply it ? can you pls reply

  • @christiandavidvalenzuelago7437
    @christiandavidvalenzuelago7437 3 роки тому +1

    AWESOME EXPLANATION! I UNDERSTAND ALL INFORMATION!