StatQuest: K-nearest neighbors, Clearly Explained

[@statquest]

Support StatQuest by buying my book The StatQuest Illustrated Guide to Machine Learning or a Study Guide or Merch!!! statquest.org/statquest-store/

[@thinkalinkle]

I'm taking a machine learning course at university, and I've been blessed with having found your channel. Keep up the great content!

[@statquest]

Hooray! I'm glad the videos are helpful. :)

[@alexanderpalm6407]

Whenever I search for a video tutorial, and you pop up in the search results, my heart fills with joy!!! ^^
Thank you once again!

[@statquest]

Hooray!!!!! :)

[@siddheshbalsaraf1776]

same here ..not started the video yet but only 1 video on knn .....dont know if i can understand very very well like linear regression

[@raytang1867]

Five minutes explains better than some teachers spent one hour. :)

[@statquest]

Thank you! :)

[@free_thinker4958]

Better than teacher spending semester for me

[@TeacherMarcus1010]

hahahahaha

[@spano1723]

@@free_thinker4958 wtf really? also my teacher took 5 minutes that's why I understood nothing

[@NerdByFate]

For real, this channel is a godsend.

[@rahulsadanandan5076]

Every time I see your videos I'm simply amazed how you manage to make things simple,it's like 1+1=2, respect

[@statquest]

Thank you! :)

[@칸츄리혜올희]

This channel is salt of the Earth

[@statquest]

Thanks!

[@spacemeter3001]

When a random UA-cam channel explains it better than your University Professor....
Keep it up!

[@statquest]

Wow, thanks!

[@mandarkulkarni4741]

INTRO IS LEGENDARY BRO : )

[@statquest]

Yup, that's a good one. :)

[@qicai3682]

This channel is GOD SENT. Period.

[@statquest]

Thanks!

[@laiscarraro9960]

Thank you josh and the FFGDUNCCH (the friendly folks from the genetics department at the university of north carolina at chapel hill)

[@statquest]

Triple bam! :)

[@Guinhulol]

I am brushing up on my ML terminology and StatQuest always comes to the rescue!! BAM!

[@statquest]

bam!

[@atifayaz3495]

When I search for something and find it on StatQuest channel. Super BAM!!

[@statquest]

YES!

[@ycao6]

it is good to listen to your music in your website after watching this clear-explained video. thanks a lot.

[@statquest]

Thank you so much! :)

[@ayush612]

This is by far the best video on KNN algo ! Thanks Josh

[@ayush612]

You are doing awesome work Sir..have watched your other videos as well..very intuitive and logically explained

[@pablo_brianese]

It is unfair that I can't give this video another like.

[@statquest]

:)

[@eltajbabazade1189]

Man, you are a legend, if I pass from the exam on Monday (which I am pretty hopeless), I will buy one of your shirts next month

[@statquest]

Hooray! Good luck with your exam! :)

[@eltajbabazade1189]

@@statquest Hey, I failed :D but still, I learnt a lot, thanks!

[@statquest]

@@eltajbabazade1189 Better luck next time! :)

[@MillerMoore-gq2pe]

@@eltajbabazade1189 I hope you graduated successfully 🙂.

[@lucarauchenberger628]

I can't believe how good you are at explaining this. wow!!!

[@statquest]

bam!

[@ShafniSide]

Thank you so much for saving our time sir❤ love from Srilanka 🇱🇰

[@statquest]

bam!

[@davidk7212]

That opening banjo solo is prettt sweet.

[@statquest]

Thanks!

[@suparnaroy2829]

Hey Josh! This is just a thank you note saying if I pass the upcoming exam, then it would be all because of you! ❤

[@statquest]

Good luck!!! Let me know how it goes!

[@suparnaroy2829]

@@statquest It went well, thank you! Hopefully I get good grades. I was thinking of suggesting that it would be great if you could cover Markov Chain Monte Carlo and related topics. Thank you again! Your channel has been incredibly helpful!

[@statquest]

@@suparnaroy2829 I'm glad it went well! And I'll keep those topics in mind.

[@jovinMendes]

Thank you so much. So useful honestly - i didnt get this from a 2 hour lecture

[@statquest]

Glad it was helpful!

[@arms1991]

you are the master of machine learning

[@statquest]

:)

[@DRmrTG]

Where would I be without StatQuest? Luckily, I now have the statistical tool to estimate this!

[@statquest]

bam!

[@chandananarayanan5498]

I am so glad I found this channel.

[@statquest]

Thanks!

[@hamedsharifian]

Easy to understand and straightforward. Thanks.

[@statquest]

Thanks!

[@mahipkhandelwal3072]

Summarised in a very short video....just perfect

[@statquest]

Thank you! :)

[@sabindawadi741]

Simple and Clear explanation. Thank you!

[@statquest]

Thanks!

[@thechesslobster2768]

You're a legend at explaining.

[@statquest]

:)

[@SuperBlackHurricane]

Another exciting episode of statquest!

[@statquest]

bam! :)

[@arshadshaik822]

Ohhh man this so simple
Thqqq for this type of explanation

[@statquest]

Most welcome 😊

[@il5083]

Very clear, I got the idea of this concept right away.
Well done, thanks!

[@statquest]

THanks!

[@THEMATT222]

Your videos are K-nearest perfection :)

[@statquest]

Ha! Very funny.

[@THEMATT222]

@@statquest Noice 👍 Thanks 👍

[@VH-yg8rx]

Dang. Simple and to the point! Thank you!

[@statquest]

Thanks!

[@NiceHirwa]

WOWW! This was super helpful!
Thanks Josh!

[@statquest]

Glad it was helpful!

[@stalindavid8208]

Thank you for your Clear explanation.

[@statquest]

You're welcome! :)

[@husamalsalek2333]

one video explained better than a whole semester

[@statquest]

Awesome! :)

[@coredump7827]

BAM!

[@statquest]

:)

[@NoMeVayasDePr0]

Very well explained and loved your uke intro by the way :)

[@statquest]

Thank you!

[@fafamnzm]

Your videos are sooo great, I can't stop watching 💖💖 thank you

[@statquest]

Hooray!!!!

[@fafamnzm]

StatQuest with Josh Starmer can you add an ICA as well?

[@statquest]

It's on the to-do list, but it might be a while before I get to it.

[@fafamnzm]

StatQuest with Josh Starmer 😔😕 that's sad, but i look forward to it. You explain beautifully sir! 💪🏼👊🏼

[@derpfaceonigiri4950]

Thank you! This helped me so much in understanding KNN faster :D

[@statquest]

Hooray!!! :)

[@grishmareddy7882]

These videos are just amazing and clearly are extremely successful in simplifying topics that are usually thought of as difficult. Can you please also make videos on its code in python/R..? and of naive bayes too maybe. That would be super useful. Thank you very much for this level of awesome content.

[@statquest]

I'll keep that in mind.

[@prekshyabasnet6854]

Clear and concise explanation. Thank you :)

[@statquest]

Thanks! :)

[@Oliver-nt8pw]

Thank you, very clear and to the point explanation !

[@user20517]

Many thanks for the clear explanation

[@statquest]

Thanks! :)

[@silvenlau7436]

I love you sir! Your video save my life!

[@statquest]

Happy to help!

[@JakeBSHere]

So much clearer than my lecturer fam

[@statquest]

Thanks!

[@JakeBSHere]

@@statquest no, thank you :)

[@MegaCliff1234]

THANK YOU JOSH!

[@statquest]

Anytime! :)

[@mastermike890]

awesome! You should do a quadratic discriminant analysis to go with your awesome one on LDA

[@henriquenonenmacher8701]

You are amazing! Thank u so much.
Cheers from BRAZIL

[@statquest]

Muito obrigado! :)

[@debatradas1597]

Thank you so much

[@statquest]

No problem!

[@bealynor]

awesome explanation ! thank you so much!

[@statquest]

Thank you! :)

[@ritwicverma]

BAM! Amazing explanation!

[@statquest]

Thanks!

[@zaneford9851]

I liked the video immediately after hearing the guitar intro

[@statquest]

bam! :)

[@igorristovski1309]

Thank you. Very good explanation in such a short time.

[@statquest]

Thanks! :)

[@abenadonkor2796]

thank you so much.This was well explained.

[@statquest]

Thanks!

[@oscargalovich1323]

Best explanation ever, thank you!!!

[@statquest]

Thanks!

[@hamzamhadhbi3060]

is considering this my favourite channel makes me a nerd ?

[@statquest]

It makes you awesome! :)

[@shawteex3]

thank you so much for this video! i have my midterm tomorrow and im so scared :(

[@statquest]

Good luck!!

[@omarbenazza]

Thank you!

[@statquest]

You bet!

[@maryamzirak6291]

That is awsom how you explain this topics. One suggestion, you could show how the 7 nearest ist red, 3 nearest ist orange and 1 nearest is green for the point in the middle. By my eyes, the 1 nearest neigbour ist still red! and it makes me confuse what does nearest means actually :)

[@statquest]

What time point, minutes and seconds, are you referring to?

[@lowqualitydude8460]

@@statquest 02:36, it confuses me too

[@statquest]

​@@lowqualitydude8460 Thanks! Unfortunately, since the original comment, UA-cam has discontinued the feature that let me make small changes to a video. However, if I ever update this one with something new, I'll be sure to make this more obvious.

[@daniekpo]

Great explanation! BAM! Great illustrations! Double BAM!!

[@statquest]

Thank you very much! :)

[@m0tivati0n71]

Wow! such a great explainer

[@statquest]

Glad you think so!

[@sanaali3069]

My 10 year old hums statquest song made me realise I my new obsession with this

[@statquest]

bam!

[@pouce902]

Bam! Smart and clear as usual.

[@taetaereporter]

lifesaver! thank you!

[@statquest]

Glad it helped!

[@csbanki]

Well explained, thank you good sir!

[@statquest]

Glad it was helpful!

[@omarmarie7802]

Thanks sir, great explanation!

[@statquest]

Glad you liked it!

[@amine1995athlete]

You're a legend ! Thank you :)

[@statquest]

Thanks!

[@shamanthrajreddy1230]

Great tutorial!

[@statquest]

Thank you!

[@prashantbisht2219]

BAM!!! That was great as usual.

[@statquest]

Hooray! Thank you! :)

[@pawel040408]

It was super simple indeed!

[@statquest]

:)

[@matthewerwine8333]

Great video man

[@statquest]

Thanks!

[@msb3559]

Hail Joshua!!

[@statquest]

BAM! :)

[@grovvy_essence.1070]

Loved it.... Thank you 😊

[@statquest]

Glad you enjoyed it!

[@TomYoungblood-cx7wm]

Thanks, you're great

[@statquest]

Thanks!

[@kuangliew]

Amazing explanation! Thank you!

[@AeNcB]

PCA is not a clustering tool. It's used for dimensionality reduction in the feature space.

[@statquest]

You are correct. I was a little sloppy with my terminology. What I meant was use something like PCA to reduce the dimensions so we can see that data in a 2-D graph. However, now that I'm older and wiser I know that we can skip the PCA step if we wanted to.

[@aminah363]

Please do a video on K-Medoid

[@statquest]

I'll keep that in mind.

[@clementchidozie4009]

BAM!!! You nailed it.

[@statquest]

Thank you! :)

[@EmapMe]

Maybe make a video on bayesian classification? Also, we should choose a k that isn't a multiple of the number of categories to avoid a tied vote.

[@statquest]

I should have a video on that topic by the end of February or early March.

[@hianjana]

Your video is amazing as always... It would be great if you can include how to choose the value for 'k' and evaluation metrics for kNN. Also, if I understand it right, there is no actual "training" happening in kNN. It is about arranging the points on the cartesian plane and when a new data point comes, it will again be placed on the same plane and depending on the value of "k", it will be classified. Correct me if I'm wrong.

[@startrek3779]

Hi. Yes, you are right. KNN is easy to implement and understand and has been widely used in academia and industry for decades. You may utilise the cross-validation technique and the validation datasets to select the value for k.

[@temsamaniyassine6071]

Excellent

[@statquest]

Thank you so much 😀

[@ja1211]

Omg thank you so much

[@statquest]

No problem!

[@shwetanksingh5208]

You are awesome man!!

[@statquest]

Thanks!

[@PradeepSharma-fl2uy]

This video is good as usual but I think there should be some more concepts explained. Like distance metrics, lazy algorithm property of KNN and elbow method.

[@statquest]

Thanks for the feedback.

[@TheSuperninja10]

I like your bandcamp!

[@statquest]

Hooray! Thank you! :)

[@learntry9074]

sad that finding this now. happy that I found it , rather not finding ever :)

[@statquest]

better late than never! :)

[@gooo1762]

thanks a lot bro

[@statquest]

Any time! :)

[@MB-vd6hc]

Thanks alot for this video.

[@statquest]

Hooray! :)

[@rockfordlines3547]

watch for the stats, stay for the intro songs

[@statquest]

bam! :)

[@danny89620]

Nice video well done

[@statquest]

Thanks!

[@Steve-3P0]

I love this guy's shtick. Corny, slightly annoying music, although I'm sure he is a great musician. Slightly condescending voice when he goes over the material... like "I'm making this so fucking easy for you... you can't possibly not understand this". It's actually quite calming. He speaks slowly too. You don't have to constantly pause his videos. I understand everyone of his videos. If I don't, it's because I didn't yet watch any prerequisite videos that he tells you at the beginning to watch.
He never takes for granted that you understand some detail. This is the BIGGEST freakin' mistake of educators. Some damn variable in a formula that they forget to explain. Also, he will use the simplest example possible so that you understand.
I am returning to school, grad school in the ML track for computer science. I don't remember much of the math that I took 20 years ago. This guy is a lifesaver. Wish I watched these when I started. I will be watching all of his videos.
After I graduate and make some money, I'm sending him some bucks thru Patreon.
Thanks man!

[@statquest]

BAM! Thank you very much! I think I must have "resting condescending voice" - because several people have made the comment that I sound a little condescending - but trust me this is not intentional! :)

[@Steve-3P0]

@@statquest It's actually reassuring. You know, when you are talking to someone who is freaking out? And you make it sound like "Dood, this not that hard."

[@statquest]

@@Steve-3P0 Nice! :)

[@stekim]

that was exciting indeed

[@statquest]

Hooray! :)

[@mohamedesmailelsalahaty6050]

You are Legend

[@statquest]

Thanks!

[@iftikhar3609]

we happy to see if the python implementation on the video. BTW thanks its was wonderful job

[@statquest]

noted

[@MrRynRules]

Omg, thank you so much!!!!!

[@statquest]

Happy to help!

[@JGbossify]

Amazing!

[@statquest]

Thanks!

[@josevaldes7493]

thanks you

[@statquest]

:)

[@asapworkout4678]

thanks nice tutorial

[@statquest]

Thank you! :)

[@felipeguimaraes2568]

great video

[@statquest]

Thanks!