I'm currently self studying machine learning, and the very first thing I did after learning about decision boundaries was check if 3blue1brown had a video on it, because his animations are just incredible for understanding math and gaining intuition. The way this video is constructed, and again, the animations used in here are incredible. Thank you so much for making this!
This video is exactly what I was looking for, I was getting confused between decision boundry and the sigmoid function for a 2d input problem, thanks a lot for the wonderful animations!
Thanks for the kind words. I thought this video didn't receive the attention I thought it should have. But glad there are others out there like you who find value here. :)
This is insanely helpful. I feel like I can actually use logistic regression libraries and have a good idea of what's happening. Generalizing this to higher dimensions was eye-opening--I never quite knew what was going on there.
Thanks a ton! I had some life changing events take place in the last few months (graduated, travel, moved, new job). Now that things have settled a bit, I can be more regular :) Thanks for the support. Means a lot!
Love your stuff. I'm not a math major, and I've learned that you don't have to be to understand, but it's kind of offputting when people use a ton of symbols. It's not necessary to explain what is going on
Great video. It really helped me to get a better understanding of logistic regression. However, I have a couple of queries - What is the target function of logistic regression which s being learned (like in linear regression we have y = w.T*x)? To what curve do we fit the training data, the decision boundary of sigmoid function (like in linear regression we fit the straight line defined above)? Thank you !!!!
Why decision boundary doesn't depend on activation function? So if i want to have a curved dicision boundary, i don't have to change activation function, but rather change my features?
Thanks so much for watching! I’ll keep your suggestion in mind and see if there is leeway to do this at some point (tho I don’t think it will be anytime soon admittedly).
Please explain how the value for bias and weigh are calculated That sigma there If n is also 1 Then y1 and x1 What are there values Please I want to calculate and loop them like you did
Super glad you do! Had some life changing events come in the last few months (graduation, move, new job). But now that things have settled, I'll be more frequent. :)
You've done an amazing video! At 14.40 you show a plot in 3 dimensions. On the z-axis (vertical one) the values should spread on the interval [0,1] which is not clear here. It's not clear why the boundary is not a plane since we have a scatter plot in 3 dimensions. I'm quite confused with the dimensions of the plot.
why do we need to use e^-x instead of any f(x) >=0 with every x to express the possibility, I forgot all the math learned from highschool so At This Point I'm Too Afraid to Ask
@@balajikannan7393 There are thousands of function that can map real number to a number between 0 and 1. For example Step function being one of them. Then , why pick sigmoid out of hat ?
This visualization is so strong, I feel like it's like one of those lecture in university that were so good, you'll never forget them!
Thank you for the amazing compliments! I definitely tried a lot with this one haha
I'm currently self studying machine learning, and the very first thing I did after learning about decision boundaries was check if 3blue1brown had a video on it, because his animations are just incredible for understanding math and gaining intuition. The way this video is constructed, and again, the animations used in here are incredible. Thank you so much for making this!
Glad you liked the visuals here. Honestly creating this video solidified my understanding of this as well :)
This video is exactly what I was looking for, I was getting confused between decision boundry and the sigmoid function for a 2d input problem, thanks a lot for the wonderful animations!
Thank you mate, I think visualization is so underestimated in universities, in math and science THIS is the key of teaching. Great job!
Thanks for the kind words. I thought this video didn't receive the attention I thought it should have. But glad there are others out there like you who find value here. :)
This is insanely helpful. I feel like I can actually use logistic regression libraries and have a good idea of what's happening. Generalizing this to higher dimensions was eye-opening--I never quite knew what was going on there.
A brilliant visualization of the logistic regression, thanks for making this!
My pleasure :)
Beautifully explained
That was so fire! Nice bro!
This video deserves a million views
dude please be regular You will earn more subscribers as you desrve million of subscribers keep it up
Thanks a ton! I had some life changing events take place in the last few months (graduated, travel, moved, new job). Now that things have settled a bit, I can be more regular :) Thanks for the support. Means a lot!
Oh wow! This is so great! I just learned the math in a class but this really explains the intuition! Thank you so much
Of course :) Thanks for watching
Love your stuff. I'm not a math major, and I've learned that you don't have to be to understand, but it's kind of offputting when people use a ton of symbols. It's not necessary to explain what is going on
Excellent explanation of Logistic Regression
Thanks for the video. It is really helpful
Please, how can one optimize the coefficients of a Logistic Regression Model using a Genetic Algorithm?
simply lovely mate! this helped me connect everything
This was very cool! Thank you!
The visualization at the end is what wee need more off
Glad you like the visuals!
This is amazing!! Thanks a lot for sharing
Great video! Thank you for your time and creativity!
Great video. It really helped me to get a better understanding of logistic regression. However, I have a couple of queries -
What is the target function of logistic regression which s being learned (like in linear regression we have y = w.T*x)?
To what curve do we fit the training data, the decision boundary of sigmoid function (like in linear regression we fit the straight line defined above)?
Thank you !!!!
Why decision boundary doesn't depend on activation function? So if i want to have a curved dicision boundary, i don't have to change activation function, but rather change my features?
17:32 ¿"m" dimensions or "d" dimensions?
Great video, your content is really high quality
Yup. I didn't write m because I didn't want to confound this with the "m" in number of iterations.
Can u make a video which explains the plot for 3 labels using 2 features, I am just curious how the sigmoid function looks for it.
Amazing work!!!
Thanks so much for watching! I’ll keep your suggestion in mind and see if there is leeway to do this at some point (tho I don’t think it will be anytime soon admittedly).
Please explain how the value for bias and weigh are calculated
That sigma there
If n is also 1
Then y1 and x1
What are there values
Please I want to calculate and loop them like you did
Thank you so much for this video!
You are very welcome. Thank you for watching
I really love this channel 😘
Pls post many videos often, not once in blue moon 😁
Super glad you do! Had some life changing events come in the last few months (graduation, move, new job). But now that things have settled, I'll be more frequent. :)
Thank you! Super helpful on a lot of levels :)
You've done an amazing video! At 14.40 you show a plot in 3 dimensions. On the z-axis (vertical one) the values should spread on the interval [0,1] which is not clear here. It's not clear why the boundary is not a plane since we have a scatter plot in 3 dimensions. I'm quite confused with the dimensions of the plot.
Oh boy, this visualization is incredible. I always knew there was a sigmoid function in 2D. Guess what... It was hidden in 3D LOL
The mystery has been solved by Detective Emporium.
These visualizations are hot!
Love both of your channels :)
which is the other channel?
@@kpratik41 3blue1brown
awesome explanation
thanks so much
You are so welcome
why do we need to use e^-x instead of any f(x) >=0 with every x to express the possibility, I forgot all the math learned from highschool so At This Point I'm Too Afraid to Ask
This video was great, thank you
Great!! Thank you
not seeing a link to visualization program
loved the explanation.
But, why do we use sigmoid function ?
A sigmoid function transforms any real number to be between 0 and 1. In other words probability would lie between 0 and 1.
@@balajikannan7393
There are thousands of function that can map real number to a number between 0 and 1. For example Step function being one of them.
Then , why pick sigmoid out of hat ?
@@vijayendrasdm sigmoid function is differentiable which allows us to train our weights using gradient descent, step function is not differentiable
thank you so much
what is the book in the beginning of the video?
That wasn’t a book; just me listing out some topics :)
Sir it's amzing make more on ml
DUDE YOU ARE A LIFE SAVER. Subbed and reccommended to my fellow msc colleagues. Keep up the great work brother.
Thanks a ton for the share :) And so happy this helps
9:03
Bro, please use dark theme
I do now. Recent videos