Logistic Regression and the Perceptron Algorithm: A friendly introduction
Вставка
- Опубліковано 2 чер 2024
- For a code implementation, check out these repos:
github.com/luisguiserrano/man...
github.com/luisguiserrano/man...
Announcement: New Book by Luis Serrano! Grokking Machine Learning. bit.ly/grokkingML
40% discount code: serranoyt
An introduction to logistic regression and the perceptron algorithm that requires very little math (no calculus or linear algebra), only a visual mind.
0:00 Introduction
0:08 Series of 3 videos
0:41 E-mail spam classifier
7:19 Classification goal: split data
11:36 How to move a line
12:21 Rotating and translating
18:47 Perceptron Trick
23:20 Correctly and incorrectly classified points
24:20 Positive and negative regions
27:18 Perceptron Error
29:40 Gradient Descent
34:36 A friendly introduction to deep learning and neural networks
37:48 Activation function (sigmoid)
38:31 Log-Loss Error
41:37 Perceptron Algorithm
42:45 Logistic regression algorithm
44:48 Thank you! - Наука та технологія
One of your greatest videos sir. Hands down... Perfect timing perfect explanation... Wow simply amazed.. I downloaded the video so that I have a copy of it. Just in case UA-cam is non existent in a zillion years
Cheers to you men. I just opened a beer to celebrate. I finally understand what Gradient Descent is how it works and why . Thanks Luis
Thank you very much for depicting the mathematical concepts into very simple graphs! Unforgettable!
Your tutorial is very easy to grasp. Best channel on machine learning with good graphic demonstration. Thank you for your hard work
The best ever video on Logistic Regression ever seen.
SIr, keep sharing tutorials like this, very helpful in making deep understanding and implementations.
You sir are a great teacher! The way you explained that was simply amazing! That was so engaging!
Thank you very much for such a great in-depth explanation. Please continue uploading more and more videos.
The best #MachineLearning videos are by Luis Serrano. Respect + Thank you, Maestro!
You deserve more subscribers. All my professors should be at your level. Great video, I learned too much!
Really really great. I looked for this explanation for months
Just saw this. Wow. I'm looking forward to seeing ALL of your vids. Thank you for your kindness and time to share with the world.
Excellent clear and informative explanation.
Amazing work, thank you!
you are the best in the business of teaching. I came across your content couple of days ago and now I am addicted.
Just want to leave a comment so that more people could learn from your amazing videos! Many thanks for the wonderful and fun creation!!!
Thank you! :)
One of the best videos so far on the logistic regression..
Awesome tutorial. The best explaination on Logistic regression and perceptron alogorithm! Take a bow Luis!
This is the best channel for Machine learning. Best to understand.
Great video.Learnt the concept in an hour
Amazing Video! This video explains logistic regression in a layman language which helped me understand the algorithm in depth! Thank-you so much!
Best tutorial on perceptron out there! Thank you
Amazing, this really was as friendly as this topic can get.
Thank for your excellent video. It was a real help!
Thanks for the lesson Luis :)
love u for making my life so much easier. And adding fuel for passion in learning. This video helped a ton.
Best video I've seen on Perceptron Algorithm hands down. Thank you Luis!
The best video I've come across to understand perceptron algorithm concept... And believe me I've tried many! :-)
Very good Luis. I am new in your channel. Im here because your book in grooking is nice
I hope you could create the "Maximum Entropy Markov Model" which training based with logistic regression but the test with Viterbi
maximum entropy is logistic regression with more than one class
Gracias por compartir este video!
Rather then picking the points randomly, what if we linearly iterate over the array of points? I think by doing this we can improve our model accuracy because in case of picking a random point it may happen that random function keep on picking some few points every time. Sir what do you think upon this?
By the way, your explanation was really good
Great content! Thanks so much :)
excellent video thanks for sharing!
Amazing as always
Thank you for this video. :)
Great video thank you so much.
Lovely, thanks a lot dear.
Thanks for that video !
Thank you, once again!
Very clear. Thanks.
Thank you so much. Its very easy to understand and your presentation skill are awesome. Sir would u please share the slides ??
Wow, this is absoulute gold.
In some videos about perceptron, lecturers say "if our total error is 0 (linearly separable) then perceptron algorithm finds that linear classifier after some iteration." Perceptron decreases the error but it may not be 0. And if perceptron finds minimum error linear classifier, we can call that as linear classifier as well. Not just a perfect one. Can you correct me about that Luis? Also thanks for your work, its a sound introduction.
THANK YOU SO MUCH!!!
Great for developing intuition!
Thank you for sharing it
sir, your awesome the way u explain things are very simple and clear
Thanks Indratej! There's a whole deep learning course I taught here (free)! www.udacity.com/course/deep-learning-pytorch--ud188
@@SerranoAcademy sure i will check out sir thanks for sharing
Sir, you are awesome, I have just started learning Data Science and your explanations really clear the fog from the picture. Thank you so much for putting such wonderful content on internet. If you have any paid course on Data Science for beginners like me then please do share the link of that in reply of this comment. And once again, your explanations are just great, loved it❤
Nailed it... Thanks
very nice video!
Wow I have been month try to understand ML thank you a lot
"Hello grandson, I have made cookies, love grandMa" ... that's obviously spam
Halfway into the video, I thought: "This is the Khan Academy of Machine Learning!" Really great explanations. One thing you didn't drive home as much, is that I could just code this up and it would work. I imagine this is still true though (for perceptron and logistic).
Thanks! Yes, I plan to start making GitHub lavs with videos, just need to get around it. :)
If you have any code you'd like to share, lemme know and I'll link it!
Can you please please make a video on maximum likelihood estimation or expectation maximisation
wonderful Thanks
Sir, Your explanation is very well. It helped me a lot. Thank you so much. Please make some others videos of ML.
Clever great!
Watching for 3rd time.. not because I couldn't understand, but for the beauty and simplicity of explanation
Please make the separate video on logistic regression that how it is different from linear. You mixed it with perceptron algorithm. You explained linear algorithm very well but I unable get clear understanding about logistic through this video.
I love you!!!!😍
Can you do a video on variational bayed and KL divergence?
The gradient descent challenge might need some further help on "What is Gradient Descent?" I know there are lots of videos on this online, but do you have you you like or you produced?
Yeah, I need to do some serious material on gradient descent. I have something on a video called "A friendly introduction to deep learning", if you'd like to take a look.
You clever and clear my 5th grade son understands it.
11:11 I thought the epoch is how many times we scroll through *all* the points, not how many points we pick to repeat the process of slightly moving the line. Am I wrong ? Thanks for help
BTW, why is it called *Perceptron algorithm* ? It has nothing to do with perceptron ?
you are right, I guess he is referring to batch not epoch
I kind of wonder why it's called Logistic Regression. Because it uses a Log-Based Error? Did Linear Regression use a linear error?
Yes great questions, I think it's because the log error, or the logit, which is the function sending everything to [0,1]. Although the strangest thing for me is that it's called logistic regression, even though it is not regression, but classification.
Linear regression can use a quadratic error, or an absolute value (almost linear) error, so the reason it's called linear is because the output is a line.
Sir, please explain ANCOVA & GLM
when are you planning to finish Chapter 7 on Linear Regression of your book : Grokking Machine Learning
Hi Luis, great video! The way you explained these concepts was nice and easy to understand. I decided to implement the basic perceptron algorithm in python, feel free to check it out here:
github.com/nenslen/perceptron
I tried to use the same terminology as you did in the video (eg. red and blue points), so it should be easier to relate it to your explanation. If you end up taking a look, any comments or feedback are appreciated, thanks!
Nice...
i want implementation of the following pseudo code :
Step I: Start with a random line
of equation ax + by + c = O
Step 2: Pick a large number. 1000
(number of repetitions, or epochs)
Step 3: Pick a small
0.01
(learning rate)
Step 4: (repeat 1000 times)
Pick random point from
If point is correctly classified
Do nothing
If point is incorrectly classified
Add ± 0.01 to a
Add ± 0.01 to b
Add ± 0.01 to c help me
Definitely! HEre it is: github.com/luisguiserrano/manning/tree/master/Chapter_5_Perceptron_Algorithm
In that same repo github.com/luisguiserrano/manning/ I have many others from the videos
🥰🥰😍😍@@SerranoAcademy
The error is minimized as the derivative of the error function approaches zero.
❤