The Neural Network, A Visual Introduction
Вставка
- Опубліковано 31 лип 2024
- A visual introduction to the structure of an artificial neural network. More to come!
Support me on Patreon! / vcubingx
Source Code: github.com/vivek3141/dl-visua...
Here's the course I referred to in the video. I am not affiliated with NYU.
• NYU Deep Learning SP20
Here's 3blue1brown's video on Linear Transformations:
• Linear transformations...
Special thanks to Matt Henderson, David Ha, Oliver Ni and Sumedh Shenoy for reviewing the video.
And also thanks to Grant Sanderson himself for giving me some manim tips!
I've been quite active on twitter, follow me here!
/ vcubingx
Join the discord server!
/ discord
These videos were made using 3blue1brown's library, manim:
github.com/3b1b/manim
Follow me!
Website: vcubingx.com
Twitter: / vcubingx
Github: github.com/vivek3141
Instagram: / vcubingx
Patreon: / vcubingx
The Neural Network, A Visual Introduction | Visualizing Deep Learning, Chapter 1
0:00 Intro
1:55 One input Perceptron
3:30 Two input Perceptron
4:40 Three input Perceptron
5:17 Activation Functions
6:58 Neural Network
9:45 Visualizing 2-2-2 Network
10:59 Visualizing 2-3-2 Network
12:33 Classification
13:05 Outro
Part 2 is out! ua-cam.com/video/-at7SLoVK_I/v-deo.html
We are looking for Part 3. Thx for sharing your experience and knowledge.
Did you just say you got Yann Lecun to help you!!!! He's got a TURING award boi!
Well, I think he is one of Yann's students so yeah.
Haha yeah, Yann was one of the guys who took a look at the video before I published :)
vcubingx dudeee that is so coolll....
Dang
@@vcubingx that's amazing man!
Really good content, one of the clearest explanations i've heard about neural networks so far! Keep up the good job, cannot wait for the following videos!
This is actually so good! You've explained it so very clearly and left no gaps in the logic.
I have been wanting to get into machine learning, and you have helped immensely.
This is awesome!. I had half-baked knowledge on all these topics before, after watching this video it's crystal clear!. You made it look so simple.
Thank You!
I liked it too. I couldn’t help notice the accordion action assiciated with the squares roots being used with two lengths to scale them.
This Deep Learning Series will be a life-saver for many !
Great man, thank you so much! Can't wait to see the chapter 2!
I always tried to visualise the decision hyperplane on the data's domain, but this has been very insightful: Visualising the data into the projected-non-linear domain. Brilliant video! :)
Thanks!
This is great! Makes the analogy with biological neurons crystal clear for me for the first time 😄
Thanks! I'm happy that you understood it!
Great stuff! I'm familiar enough to understand the basics, but I love that this is visually done.
Glad you liked it!
One of the best and most intuitive way of descibing neural network! You took it to next level... looking forward more from you :)
Thank you!
This is great work from you, congratulations!! Also a big thank you to Grant Sanderson, from @3blue1brown, for manim. Both of you make quality education so much more fun, as it should be. So thanks a lot!
This is amazing stuff. So many things I was able to understand that I couldn't get my head around before. Thank you so much!!! 😊
WOW. I've been studying neural networks for a bit now, but this made me see them in a new way. PLEASE MAKE MORE VIDEOS!!!!
Really well done! It's cool to see the differences in the way you covered things compared to 3b1b. Can't wait to see more :D
Thanks a ton!
By far the most essential visualization of neural net Ive seen to date! 🤩
Amazing visualization. Looking forward to next videos in the series.
Thank you!
Masterfully done, you managed to explain it in "simple terms, but not simpler"
Great video. Really looking forward to the series!
Fabulous! Looking forward to the next in the series.
Thanks a lot for such a vivid explanation ! Looking forward to more such content
Man it is just so high level. Your explanation, vizuals and the topic itself are great. Subscribed and waiting for the next chapters!!!
Thank you very much!
Awesome video!!!
Can’t wait for the next ones!
Absolutely awesome. Very informative and helpful for my visual mind.
One thing I would love to see go along with your video, would be at the start you showed 3 neurons with 3 hidden layers. I would love to see a small dataset with perhaps 3 features, and follow along through with that throughout the whole video, and using real numbers so we could follow along and even work it out on paper if we wanted to.
Anyways, Thank you so much for your awesome work.
Subscribed!
Thank you for your video, this is one of the best videos explaining neural networks that I have seen. Good Work
Another banger Vivek!
Thanks a lot, this definetly will become handy for my study just in a bit over a month.
Superb!! Eagerly waiting for the next videos! :D
Woahh, incredible! Happy to come this early :D
Please make more, these are amazing!
Awesome job! I love it!
When you first showed 10:32, I was thinking that ReLUs are very bad because they collapse data too much and makes points indistinguishable. However, you later showed the 3D case in 11:49, which was very insightful for me. When data lies on a low dimensional manifold of a high dimensional space, the 11:49 picture is probably more accurate. In this case, ReLUs don't actually collapse data in such a bad way.
ReLUs don't "need" to collapse data, it only collapses what is necessary. If you think in terms of linear combination of functions, 2 ReLUs can be combined into a "S" shaped sigmoid function, and 4 ReLUs can be combined to form a "Bell Curve" function. Both are very crude and merely approximations, but as you increase the number of dimensions they become smoother. An infinite amount of ReLUs (differently scaled and translated) can approximate any function.
one of the better talks on the topic. well done
Another excellent video🙌
Great video! You were right, even as an experienced user of neural networks it helped me see things in a different way
Glad to hear it!
I love these videos. All of my life I was considered mathematically stupid. I can't read mathematical notations well. I failed pre-calc. But now as an adult, watching these visual videos have led me to be able to understand those concepts that were impenetrable to me when I was younger.
Awesome content man. Bravo!
Great video, love the animations!
Interesting, looking forward to part 2😉
OOH MY GOSHHH THIS IS GREAT CONTENT. thanks a lot!!!!
Wow, amazing way of visualization of non linear function and how data is transformed.
RT from THE three blue one brown, great work dude!
love your series， it‘s so great
Great! Looking forward to the rest
I love it great video! And thanks for sharing the course too! ...
Eagerly waiting for chapter 2
What a great explanation. 💯💯💯
Excellent. Thank you!
Absolutely fantastic!
Subscribed. Excellent video!
awesome explanation and video, kudos!
Glad you liked it!
Nice! Looking forward to this series. 😁Imagine if we see an animation of an actual handwritten number image transformed into the decision "square"
Good idea! I believe distill.pub has something like this
He’s probably using publicly available data, so I doubt he’ll do an animation like that.
Sir, you have earned my subscribe, outstanding video.
this is suuuuuuuuuch a great video! Thanks
Neural networks look simpler than these animations made. Fantastic job!
This is fantastic!
You have really developed man. Great progress and keep it up.
Superb animation, well done
Nice video.. Waiting for next chapter on visualising neural-nets !
Working on it! It should be out soon
Great work. I am still left wanting a more course overview which metaphorically explains how AI is not simply a series of input->hidden->output byt way of some narrative discussion and/or metaphore. Wanting that before I go deep into the linear algebra, and then reference the steps in the matrix max discussion with what was described in the initial narrative.
This is too good. 3B1B vibes man
I come from the new course by Alfredo and I dare say this was fantastic. Regards....
Insane 🎉🎉,,,,more strong visualisation videos
omg, I am so glad I found this channel
Wow this is great!
absolut fantastisch. Thank you so much!
Glad you enjoyed it!
Is this Manim? Nice work!
Great Video!
Great job , excellent
Great explanation
Thank you for this
Amazing video!
Thanks!
Wow! I've done things with neural networks before without even understanding the actual math behind it! Very enlightening!
so amazing.
Awesome 😎👍
Broooo it is awesome visualisation video😍,it makes foggy image of neural network fully cristal clear , i am really waiting for next chapter bro, when you gonna upload the next chapter....
You explained it really well. Really like the videos. Plus your voice is as soothing as Sal's.
You think? Haha thank you so much, I don't think many people think that :)
Thanks!
Awesome work!! Can you maybe elaborate on the convexity of the cost function with respect to the parameters of the model ? I am currently struggling to understand when the cost function has a single minimum and when it has multiple minima with respect to those parameters. Maybe you can talk about it in one of your next videos.
Great visualisatiom
Thanks for these videos. Visualization provides powerful ways of understanding and these videos are of great help.
Beautiful and intuitive!
When is next part coming? Any updates?
hes in college now
@@AnishBhethanabotla I am yes, but I'm currently working on the next part! I've scripted, recorded and made most of the animations, so I have some editing and reviewing to go but it should be out soon!
Still waiting for the next most precious videos on the world of this series, please update.
Nice one :)
thank you so much for making videos on deep learning , much neded.
Amen from the community 🙌🙌
It would be nice to pay attention to the colors in the plots. I am colorblind, and at 6:52 it's almost impossible to see the boundary between the two colors.
Well let me tell you they were beautiful and vibrant.
@@tristunalekzander5608 ... Talk about rubbing salt to a wound..
@@deformercr6680 you are pitying him for a condition he is already used to. I would argue that is worse than the pointless comment about how vibrant the colours were.
@@hybmnzz2658 it's not pity, it's being considerate. If you're eating some delicious food right in front of someone who can't eat, and then you start telling the person how tasty the meal is... I would say that's a little inconsiderate.
@@deformercr6680 if you tell someone who is lactose intolerant that your milk tastes good I think they would not care. And yes I think colourblindness is closer to that than the immediate sensation of tasting food in general.
You meant no harm so I won't argue anymore. I just don't see it.
Great !!!!
Simply beautiful. Thank you
Part 2 and 3 please!
thank you
since you mentioned, sigmoid and relu i was hoping you would mention the softmax activation function and probably draw the graph as well, this is good video none the less
Really good job on your accent!
Great video. When is part 2 coming out?
who came here from canziani sir course? :) Loved the visualization bro
super poggers video
Nice video dude! How the hell did you make such a complex animations? :-)
Hi this explaination&visualization is awesome... Can you pls tell using which tools you created that 3d visualization coz i am desperatly looking for that to add in my Clg presentation and some of my lectures 🙂 thanks in advance
Great video and explication maybe you should add a low sound classical music in the background like 3b1b