'How neural networks learn' - Part I: Feature Visualization
Вставка
- Опубліковано 14 гру 2017
- Interpreting what neural networks are doing is a tricky problem.
In this video I dive into the approach of feature visualisation.
From simple neuron excitation to the Deep Visualisation Toolbox and the Google DeepDream project, let's open up the black box!
Links:
Distill.pub post on Feature Visualisation: distill.pub/2017/feature-visu...
Sander Dieleman post on music recommendation: benanne.github.io/2014/08/05/s...
Blogpost on Deep Feature visualisation: yosinski.com/deepvis
Github link to DeepVis Toolbox: github.com/yosinski/deep-visu...
Paper by Zeiler & Fergus: arxiv.org/abs/1311.2901
If you want to support this channel, here is my patreon link:
/ arxivinsights --- You are amazing!! ;)
If you have questions you would like to discuss with me personally, you can book a 1-on-1 video call through Pensight: pensight.com/x/xander-steenbr...
I watched this video when I wanted to fall asleep, to satisfy my conscience that I had done something in my assignment , and also hearing these subjects makes me fall asleep quickly, but your way of presenting the information was beautiful and not boring, so I could not sleep but became more active to complete my assignment ! Thank you & keep going ⚡️
Going through interesting topics with a direct link to research. You're truly doing amazing work.
Dude your content is amazing. So is Your way of talking and explaining... just amazing
Amazing videos! You have an awesome art of squeezing advanced concepts into a short, simple and interesting video!
This guy is super clear compared to everything else I have watched so far.
Very nice video! Looking forward to the next parts. Love the dreamy images ^^
This is really high quality stuff. I really appreciate the work you put in here. Keep it up!
Fantastic channel! Great idea with highlighting the latest arXiv articles. I’ve been looking for a channel like yours! Subscribed and can’t wait to go through your content. Thanks for doing it.
Using gradient descent to generate an image to max a neuron is cool, I suppose the same can be done with audio also? It would be interesting to hear what a neuron 'sounds like'.
I guess its the exact same process but you convert the generated spectrogram image into an audio file.
Really enjoying your videos, please keep it up!
oh man. this is wicked stuff! I really enjoy your style.
i wan to mention that, your videos are super awesome! thank you!
Damn, this video is sooooo good! I subscribed to this channel after two minutes into the video. Great job!
Very informative, and summarized knowledge. keep it up bro.
You are doing such a great job!
I wanna see more :)
this is so cool that you're here to explain stuff. too many video are like "you copy this code, press play, boom, you built the 344th billion mnist image classifier, gg"
Your channel is top quality. Thank you.
THANK YOOOOOOOU
I was reading that article you commented on and I couldn't understand for the life of me how they were generating those images, so tysm ;-;
Excellent educational video on artificial and deep neural network learning.
You are amazing! Please keep posting new content!
Great video! Cheers from Belgium,
you are really awesome brother.
love from INDIA.
Excellent video, good job!
Thank you for making these videos
Quite dense, but vey well explained!
Really nice explanation :) Thank you
great presentation ! Thanks.
Awesome explanation!!
Really informative video, thanks :)
Thank you! Good Explanation!
Excellent videos. I was wondering how can you evaluate and measure the layers inside, I've heard about these visualization methods so far. Thank you so much.
Amazing video!
Nice video... explained pretty well..
Your videos are amazing! Thank you
Can’t wait for part 2)
This was just amazingggg
Great video!
Great videos!
Awesome insights
Amazing video👍🏼
Quality of your videos are the best. Good things take time but if you could upload weekly. It would be great.
Really good content
Great video
Thanks a lot, dude.
Great overview! Although I'm not sure Zeiler and Fergus' work on feature visualization you've mentioned is actually training the deconvnet via backprob, I remembered that he mentioned that deconvnet is used as a probe to reconstruct image patches from the selected activation maps.
I agree with you. In the original deconvolutional network's paper (ieeexplore.ieee.org/abstract/document/5539957) they do train deconvolutional layers to reconstruct images in order to perform unsupervised training, but in the paper mentioned in the video they use transposed versions of the convolutional layers' filters to investigate a trained CNN for image classification.
nice, i hope you make more videos. Good luck
Bro! you were soo ahead of your time! Like Scooby Doo
Hi Dear Arxiv, very good video! subscribed. any resource regarding how to look into a RNN （bi-GRU) to visualize the feature?
Super cool!
Super thanks for amazing videos! And I'm really waiting for the Part III :) You channel is the only one in my subscription list with the Bell turned ON :)
very nice video
At 4:20 you said the audio spectogram is converted to image. So how is it done? Like mapping those spectogram with image feature or those spectograms are somehow converted to an image.
This Thing can be used in Modern Art for sure. :)
thisartworkdoesnotexist.com
Bravo!
How effective is this music recognition algorithm? Some www 2018 challenge showed the winners only got 60% accuracy - how can this be effective at such a low level?
OMG feature visualisation LSD!
Is the deconvolution a selective autoencoder?
A trip to Bulgaria song :) Greetings from BG :)
I was here when this channel had 200 subscribers!
I wasn't
me neither
Here is a project that i created to focus on visualization. Hope someone finds it useful. Can be applied to images, audio, text or anything else: github.com/raghakot/keras-vis
Great series of videos. The part 3 has been released??
Roxana Noelia Not yet, but I'm working on it! Hopefully somewhere next month :)
Thank you so much for doing these videos. This particularly one is great.
Nice video, carry up! :}
which software are you using for video editing? plz reply...
what motivated you to start this kind of videos? when and how you started? I love explaining what i know but: i am not as clear as you are, and i certainly do not have patience to learn all those editing tools
Damn great video! Carry on ! This subject is so fundamental in Artificial Neural Networks : what the h*** do they learn ? ;)
Best AI channel EVER
When you say Neuron do you mean the filters of a convolutional neural network?
Thanks for the video
How visualizing works in playground tensorflow? What do they mean?
Is there a way to visualize neural networks in general?
how can I visualize the features in Matlab??
What if we try maximizing a certain class (e.g. dog) instead of a specific neuron?
I wish there were more videos.
The term "activation" in the context of neural networks generally refers to the output of a neuron, regardless of whether the network is recognizing a specific pattern. The activation is indeed a numerical value that represents the result of applying the neuron's activation function to the weighted sum of its inputs.
Just posting here what ChatGPT told me, because the definition of "activation" in this video confused me
Feature visualisation is what an acid trip looks like
I think deep visualization of games networks like checkers or go would be interesting.
That tune is the bassi tune
you are so cool...
@Arxiv Insight - Cold start problem will not be solved by using deep nets to extract musical features. You will still not know what songs to recommend given a new user.
Also, there is a way to figure out if a neural net is looking at the sky or the ship. Black-out the sky and feed the ship - see the response!
woow peacock in a educational video !
When's part 3 coming out?
Oh man, I really wanna make part 3 but I'm currently working on two episodes on Reinforcement Learning first, I wish I could do more episodes/month but currently I'm just too busy to work on this more than 10 hours/week. I need to find a way to increase my video output rate though :)
Is there any way we can help besides the Patreon?
By the way, a fan of your contributions across mediums! ^_^
Really excited for the RL series -- I can't wait to be able to give back in the way you are once I've accumulated a bit of knowledge.
How do you view this channel and its impact relative to any other work you're doing?
Has Part III ever been created?
Not yet, but I'm actually starting work on it right now. Should be finished in a couple of weeks!
@@ArxivInsights OK, great :)
the c64 neutral net code did what these advanced nettoworks do back in the 80s in a single matrix input output layer reconstructing but with letters. it could not handle to much data as the same problem with it was the same as the modern version. the network get confused so make it big enough kind of solves it but not really. there is to many copies of mostly the same data in the network. im sure if such a basic linear function generated network like the 80s if big enough could feed a entire page of random letters and still make it reconstruct each trained letter correctly from random. think if you could do that with apples and bananas. im not sure if that would work but think in theory it chould. there is no reason why the network chould store the pattern of a banana or apple like a mess. i imagine the network can be trained with random objects and still reconstruct individual objects without classification.
overall very good, but
pops are a bit too loud and baby crying sounds at 1:28 are awful
With theory it is ok to explain, but in real world we need some code to implement it practically, so have some code, btw Ur videos are awesome
Can neural network learn creat 3D enviroment from reading book specific chapter where author specificly is discribing that inviroment?
Guys make this question viral!!!
why you stop update new vedios ?
Faaaar better than siraj
noted
@@SirajRaval lmao
why do those pictures look like an ayahuasca trip?
But there should be some code
Great content but unnecessarily long. You could say the same in half of the time. But really, that’s cool stuff 😎 congrats.
8:57 sus
test
If Spotify is using a deep neural net, then why are it's recommendations still awful.........
Make sure you give it feedback. Really take some time to rate the songs in your recommended weekly, and after some time it'll get better!
Either stop waving your arms around, or focus more on your face and less on your hands .. its very distracting
Too much bla blaa blaaa blaaaaaaaaaaaaaaaaaaaaaaa...........................