Neural Network 3D Simulation
Вставка
- Опубліковано 9 чер 2024
- Artificial Neural Networks 3D simulation.
Subscribe to this UA-cam channel or connect on:
Web:
LinkedIn: / denis-dmitriev-b6a95993
Support on Patreon: / deep_robotics
Support on PayPal, user: denis.y.dmitriev@gmail.com - Наука та технологія
this is the coolest visualization of neural nets , i have ever seen. awesome
thanks
On an unrelated note, how do I give a comment -1 likes? Asking for a friend.
I agree
@@DenisDmitrievDeepRobotics ua-cam.com/video/0U_FBHKYqRk/v-deo.html
I only love neural nets
"do you ever look at someone and wonder what is going on inside their head?"
@David Parry there's something going on inside of the head of a stereotypical stereotyper... unfortunately, you rarely get to see their regression model. oh well. who am I to judge?
@David Parry we may not have anything going on up there, but at least we're finally as smart as you.
Beautiful comment
Inside out? Where did I see this dialogue??
@@kinseysharon2672 inside out yes
The spiking network looked like what I'd imagine the brain would do
@hyper Computational neural networks model brains the same way a stick figure models a person. 웃 Adding a couple of lines for hair, might might the stick figure more closely model a person but it's still a bad model.
The interconnected nature of brain neurons might be partially modeled by neural networks but there is a lot of brain structure that is left out. It's not just a matter of scale, it's a matter of kind. For example, hormones are integral to brain function but neural nets have nothing that is analogous.
@@myothersoul1953 Hmmmm... All models are wrong, some are useful. Just because it is incomplete and doesn't get anywhere near the scale or complexity of the brain doesn't make it a bad model. What's important is to know what you are trying to learn from the model and if it serves that purpose it is a good model. Got a better idea for computationally modelling the brain?
@@TheRealJavahead That it doesn't get near the scale of complexity or include major components of the brain makes it a very poor model. Just like a stick figure is very poor model of human anatomy. Fortunately I am not in the business of modeling the brain because that's a very challenging task. Before a model could build how the brain functions needs to me understood. Many scholars across the world are working on parts of that. I'm sure they would tell they are making progress but are we no where near a complete understanding.
You are right, what you are trying to learn from the model is important to know. What aspects of the brain you model focuses will vary depending on whether you are interested on perception, cognition, emotions or motor control. It would be a huge mistake to think the such a simple model such as neural nets come close to representing any of those.
@@myothersoul1953 I do note that you have gone from categorising this as "a bad model" to "a poor model," next step might be that this is an "acceptable model." ;-) Relying on a reductio ad absurdum argument with your stick figure analogy is a false equivalency and doesn't support your assertion that this is a very poor (or bad) model. My point is, neither of us is in a position to determine how bad or good the model is without knowing its purpose.
@@TheRealJavahead The purpose of a model is to represent something. A poor model does a bad job of representing.
The reason I use the stick figure analogy is neural nets are often represent with lines a circles which are the same things used to draw stick figures. Stick figures only represent actual humans at the grosses of levels and neural nets resemble brain function at the grosses of levels (at best). That is neural nest are poor modes. But you are right, all analogies break down when pushed. The neural net analogy of the brain just needs the slightest breezy to fall down.
A better representation of neural nets would be a set of equations and procedures but that still doesn't match the brain. That's why they do such a bad job of representing how brains actually function.
that's the sound of my GTX 1050 screaming in pain..
@@whannabi It's not.
@@whannabi it's 50% slower
タメル Who exactly... said that?
@@whannabi lol
I’m tryna make a neural net that discovers better neural nets through random trial and error. I’ll update you guys in 42000 years.
it has already been done by deepmind, they used neural network to tune hyperparameters of other neural network.
Already done. Check out Google's AutoML !!
Ah, but where is the neural network that tests neural networks on their ability to discover better neural networks?
@@J4hk2 you can always go deeper.
check out HyperNEAT
Best video on youtube, deserves to be on main stream during football game commercials
This is amazing. I think this animation provides an incredibly intuitive understanding of how neural networks operate and a generalized interpretation of the fundamental mechanics of how they work.
This is such a cool project to have realized. Mind blowing. I would be interested in seeing a 'making of' this one. I think this is so beautiful it deserves being called art and needs a place on a screen on my wall, in an infinite loop.
This is so cool. I love it. The spiking neural net was the coolest to watch. However, I couldn't help but notice that the spiking net wasn't working either.
They are super difficult to train. But they have been shown to be potentially more powerful than any ANN
@@kronek88 I think it depends on the problem you want to tackle, if you need a immediate approximation of something that requires a lot of computational power, then yes it's useful. But if you want a very precise result of a problem that isn't time consuming computationally. Then I think there are better algorithms than this one.
@MetraMan09 Yes, they mimic natural human brains. Like they can try and solve a task, approach it another way, check their answer, etc. It's kind of able to divide itsself up and basically train another couple neural nets to each do their thing to work together to solve complex tasks. It requires a LOT of computational resources but also can solve tasks static networks simply can not solve. It is, however, capable of being potentially dangerous if not done correctly. In theory, this kind of network is the kind of artificial intelligence that we theorize could pass for human in a turing test.
Also spiking neural network could create autonomous AI system, simulate memory and brain functions.
How? Can you elaborate?@@kotcraftchannelukraine6118
Machine learning makes sense to me at a very basic level but overall it still seems like magic to pass stimulus through a weighted network like that and it eventually can recognize patterns. Especially since this process leads to consciousness in human brains..
Суть всей "магии" заключается в том, что скрытый слой можно настроить так, что на любое входное значение, на выходе будет соответствующий нужный правильный выходной сигнал, который мы хотели получить.
This is amazing! It must've been a pain to render, considering the reflections and the frame-rate.
@DarkXSeries7 how about you can easily code it ;) in python or c#
Wish the resolution was a bit higher and the bit rate didn't destroy the detail. I'd like to see this in at least 1440p
The final version shows the back propagation in such a nice way! Well done
It's the best visualization of a neural network I've seen so far. Do you allow snippets of your video to be used in other youtube videos ? With a mention of your channel, of course.
Tient tient, vous ici !! ^^
As someone who has written digit recognition networks from scratch and wrote a paper about it I must say that this is a really good 3d visualization of the neural net.
Beautiful animations! You did a terrific job with the visualizations! Thank you, it brings great insights to a network!😊
That's amazing, best visualisation on a nn I've seen!! Great work!
the song is called "Soft Hearted - Anders Baldwin"
thanks
Namaste 🙏
And the second song?
i do not know
It's called namaste indeed, from audiotronix
most awwesome video for neural networks representation
That's a lot of hidden layers ya got there Bucko.
I smell... overfitting
@@trentonpaul6376 Depends on the size of the dataset.
3? I guess that's a lot... If you're training on like an embedded graphics chip 😆
@@NilesBlackX 3 is for really non linear data. Written numbers doesn't need more than 1 hidden layer
@@terrykarekarem9180 MNIST doesn't, but proper handwriting training benefits from more layers. Adding punctuation, capitalization and diacritics makes the complexity rise above O(26) by an exponential.
Regardless, 3 hidden layers isn't 'a lot' by any means, since that's a relative term which implies greater than average, and average depth for a FFNN definitely isn't < 4.
This is absolutely beautiful.
We're currently developing our deep learning infrastructure in our group (freeD), and I work specifically on the visualizing tools.
I'm nowhere near your master level rendering skills and I kinda feel like crying right now.
Spiking neural network gave me goose bumps.
This is a good spatial representation of the tensor as a hypergraph.
This is just like I imagined neural nets when I first heard about them. So glad you were able to make it real!
Beautiful !
Thanks Denis! Wonderful Creativity!
Hats off to the visualization!! Great job
So mesmerizing 😍, reason 1: The beauty of the network, reason2: The Background Score.
Professor! Too Cool!
This visualization is so awesome that it feels like a science fiction movie!!! Great job!
Music+visual both are cool
The image actually moves when you stop the clip. So cool!
It is not the image that moves - it is our brains automl experimenting with the bias hyperparameter.
Now I'm experiencing rapidly growing number of subscribers, and probably will be spending more effort on this youtube channel vs other project. Guys, let me know how did you find my channel and what kind of videos you would like to see next?
Tutorial how to visualize neural network would be nice. This video is in my recommendation, and it's very mind blowing. Do you think this can help to debug NN? For example adjusting dropout rate? I will be very happy to follow your progress on this kind of video, is there any link, or github perhaps?
@@ErlandDevona this video in particular is not intended to help you in droprate adjustments. Probably will cover droprate effect on next video, also will consider putting source code into github. Thanks.
@@DenisDmitrievDeepRobotics Hi. Did you put the source code to the github or somewhere since then?
Great work !
hands down.. this is the best visualization of neural networks I have ever seen! just WOW
I can't even imagine how this visualization has been made. Because making a complex neural network itself is a troublesome process.
the visualization part is easy. you make the neural network first, then you just get a bunch of points to represent the neurons. then, whenever data is “sent” from one neuron to another, just draw a line between the two.
This is crazy! Awesome visualization! Thx! :)
absolutely incredible upload. Thank you!
Actually even the music is awesome! it evokes curiosity and adds sense of mystery to the scene!
This is so satisfying to watch.
Beautiful simulation! Thanks.
Watching this made me reflect on life.
This is absolutely awesome, will share it on my social network, great job!
pls make 3d visulaization of that lol
this is absolutely awesome! great work
Excellent work, truly praiseworthy!
this is really amazing man , Exquisite
Thanks a lot man! Just incredible!
Minor correction: The spooky Audionautix song at the beginning of the video is "Atlantis", not "Atlantic" as seen in the end credits.
Interestingly, the same song is used in another video about machine learning, by the channel New Mind (link: ua-cam.com/video/owe9cPEdm7k/v-deo.html ). Maybe the song will become an inside joke among sound mixers, like The Wilhelm Scream. Whenever a film is about ML, sneak in a clip from "Atlantis".
Denis.. Congratulations !!! Amazing render + animation
This is just awesome. I usually don’t comment on videos, but mate, this, is one of the best videos I’ve seen on yt
Ben Kahrmann what? Do you even know anything about machine learning?
this visualization is next level, dope as hell
This is an awesome visualization job.
The Coolest and the best visualization to understand neural nets! loved it!
The spiking viz was amazing. Feels like in your brain, you're trying to understand the concept but it doesn't sink in and there is the darkness. And suddenly you get the point! It all lights up.
Great job. Very exciting demonstration
This is absolutely awesome! music too!!
This is amazing. Thanks for sharing!
Would love to see a 4K render
I must say this video is brilliant!
Gorgeous! Great Work!
This is the coolest video I have ever watched.
great animation - especially in combination with those sounds!
Please don’t stop making this kind of videos
Absolutely AWESOME !!!!
I think it helps little for real understanding. It helps for fun indeed.
Honestly I didn't think it achieved either.
if understanding is important we shouldn't use training based models to begin with
@Ben Kahrmann It's dots and lines which represent in a visible way what is happening in some next level computing stuff. Computing stuff which can correctly categorize hand-written digits, and which forms the basis of systems which have mastered chess, go, commodity trading, medical diagnosis, self-driving cars, suggested videos, targeted ads, and much, much more. That might mean absolutely nothing to you, but most people would be happy if they could have just a tiny fraction of the many billions that Google and others have made out of that nothing.
Денис, великолепная работа!
Хорошая демонстрация работы нейосетей для новичков этой сфере
UNBELIEVABLE !! Wow... :) Thank you... !
It's really helpful. Thank you.
this is the most fascinating visual representation of the neural network
Amazing video! great work
Could you please make a tutorial? This is by far the coolest simulation I have ever seen!
this is very dramatic and impressive
This is an amazing creation.
This is amazing! congrats my friend!
Beautiful. I use neural nets heavily in my work in computational neuroscience. Agreed with others that this is one of the coolest representations I've come across. Would love to collaborate on some future work, if you're interested.
Computational Neuroscience....that seem awesome
I do not know how you did it, but I guess you had a very good concept to coding such a beauty simulation, very nice done!
The coolest way to answer the question "So, what do you study?". That.
i subscribed for content like this!
Perfect visualization.
Good job, Denis.
This really cool... The music also!
Amazing work
Amazing appreciate your work
WOW! amazing visualisation!
Looks like if you leave a vegetable in the fridge for a long time.
A way to summarize it all this is great!
Amazing!
Hi Denis , please note you incorrectly attributed the song named "AtlantiS" as "AtlantiC". (Discovered while looking for the song). Great video, thoroughly enjoyed.
Aj Ulyate Thanks for your observation.
Of course that's what my brain doing everyday.
You never knew neural network that beautiful
1:35 GIMBAL LOCK !
Very cool... would love to see more of those spiking network animations, but then in slow motion..
I've wanted to see this and my time has come. I've always wondered what a 3D model of the data would look like.
I like that spiking neural network idea.
What my entire brain cells during the math exam absolutely NOT look like:
I feel you
Soo clear, helps us understand better how theyvwork
really cool visualization :)
excellent visualisation
Great video, thanks :)
That's the better animations of neural network i never seen
super amazing, thanks a lot!!