Deep Dream (Google) - Computerphile
Вставка
- Опубліковано 25 сер 2016
- Surreal images created by Google's Deep Dream code flooded the internet in 2015 but how does deep dream do it? Image analyst Dr Mike Pound.
Inside a Neural Network: • Inside a Neural Networ...
Cookie Stealing: • Cookie Stealing - Comp...
FPS & Digital Video: • FPS & Digital Video - ...
Password Cracking: • Password Cracking - Co...
Gamer's Paradise: • Gamer's Paradise - Com...
/ computerphile
/ computer_phile
This video was filmed and edited by Sean Riley.
Computer Science at the University of Nottingham: bit.ly/nottscomputer
Computerphile is a sister project to Brady Haran's Numberphile. More at www.bradyharan.com
"I want more. I want more ears, I want more paws, I want more bits of cat."
have you tried anime?
😂😂 this had me laughing alone like a madman
"Ah, I see you are a man of culture as well 😌."
😂😂😂😂😂😂😂
You know you are a programmer when you exactly have 6 books standing on your shelf because you learned the rest from online-tutorials.
LOL
and what about the rubik's cube! is a kit part as well x'D
Or by reverse engineering
LOL you got me. I learned Java entirely by online tuts. But it would've be a pain in the a$$ if I didn't have the interest tbh.
No...
The hills do indeed have eyes
Lol
They have a soul
Why haven't I heard about such an interesting thing up until now?????
no seriously, how DID you miss this? This was _everywhere_ not all too long ago.
It was all over the news about a year ago
There is a subbreddit for this / r/deepdream
you must be deaf
im just hearing about it now lol
Honestly, some of these images look like they belong in a museum of some kind.
maybe in a museum that focuses on technology? Or one that might even solely focus on computers or even just the internet.
You belong in a museum!
That`s most epic Hearthstone mentioning I`ve ever seen. :)
Perhaps in Strangethink's Secret Habitat museums?
+Moritz Durtschi Give this guy a medal.
I wonder if this has anything to do with why people see faces in inanimate objects? Are our brains maximizing neurons for facial recognition?
Also instinct, so you can recognize faces from birth.
That is actually exactly what our brains are trying to do.
Yes, that's why you look at the shirt in your room and think it's a ghost. Also if you're anticipating a phone call, anything that resembles your phone ringing will be mistaken as phone ringtone.
I see faces in cars.
All around me are familiar faces...
This guy is amazing how does this have so little views?
I think one part is that, at this time, there's not really many programmers around at this time. However, another more reasonable part is that this is actually their most recent video, which actually doesn't record much views around this point in time.
I am subscribed for interesting things, and also becasue i want to learn more proggraming though i only know C.
So im really impressed some times on this channel.
Because it's not long since it was uploaded...?
Because you made your comment after the video been live for 15 minutes.
By the time A.I. makes programmers obsolete, they'll have already made most other jobs obsolete as well lol
I think this is the most accessible explanation of Deep Dream I've heard. Although I do disagree that you can't explain backpropagation and gradient descent in an intuitive way.
yeah, Coursera's Machine Learning course has relatively short videos showing it and I thought they were quite reasonable
I believe the word intuitive is rather personal though. Some are intuitively good at drawing, others are better at math, some at writing, and few are good at it all "generally".
We need a new word (or already established word) that measures the general intuitiveness of some knowledge. How easily it can be grasped.
I think we could use approachabilty
Innate comes close
The most accessible explanation is by Jeremy Howard and his free online course at course.fast.ai
11:28 "It's more of a cat than the landscape was."
Am I the only one who really wants computerphile2 with math and stuff?
So look at the "Numberphile" channel?
+Un4GivNX I know of it, my point is that somewhere with all the gritty calculus would be great
I would like that channel also, with all the math involved
You are not alone
I want this
How do we get into a class with this fella. He makes me want to learn computing skills. Clear, precise, funny, knowledgeable, makes learning fun...
‘I’m all ears.'
"Are you sure, that's how it works?" - Google Engineer
"Are you sure about that comma?"
- Literate people
;P
Well comma is an instruction on how to read a sentence. It is a bit different in formal documents than it is on internet. So relax and enjoy the freedom.
Underrated comment.
This guy is certainly forward-thinking when it comes to shelf space for books.
And look where we are now.
I really love this series, Dr Pound
Absolutely awesome video. This guy is not only smart but also teaches in a very entertaining way. More of him please!
Salvidor Digitali
I get the feeling Mike has accidentally dashed a line across his monitor at least once while pointing to it with a marker like that. - 1:13
Digital cloud gazing basically. "Whoa, dude! That cloud looks like a cat. And that too. And that one looks like a bunch of cats." "You are obsessed with cats, Jim."
I guess this is one of the coolest videos in this channel
You can't change C, it's the speed of light.
i love interdiscipline jokes.
I saw this movie earlier today and later saw Jason Bourne in the cinema. JB also has a computer related Deep Dream in it. I couldn't help thinking about this movie, of course. Anyhow, Mike and Brady, thanks again for a great computerphile episode.
those deep dream pictures always give me a shiver...
What an excellent explanation of such a tricky topic
what a pleasant voice to listen to
Most pointless shelves ever. :)
Makes me feel like I'm back in my college dorm lol
His main shelf is on his desk. ;)
That rubik's cube isn't going to float by itself.
true story
Shows how much computer science folk rely on online documentation. :-)
Thank you for this great explanation.
I love programming and have started taking interest in neural nets!
This really gives me a lot to think about.
Perhaps giving lower-lever nodes weight for what the hit is NOT can help ascertain the weight of a node from a newer generations' determined context via back propagation.
I expect a door across the room from me because I am aware that I am in a room.
If all of the sudden I were to see a giant walrus instead of my door;
it would be obvious my context was wrong. I'm either dreaming or crazy.
Even psychologically speaking, we see more of what we think and see.
If I'm constantly bombarded with cat images, I would most likely start seeing cat faces everywhere.
If I am in my living room; I know what should typically not exist in a room from being in various rooms over the course of my lifetime.
Anything unexpected, and my brain just fills in the blanks because things out of context get forced into a context that fits.
Deep Dream is only going off the life it's lived, and is already exhibiting all these emergent properties
I'm not hip to all the terminology; but I'm definitely fascinated.
I mean, cats are basically just a bag of fur with ears and eyes.
1:11 his face brought so much joy and enthusiasm. i love this guy.
mike pound is the best!
Thank you for this! I'm a pro video editor, but I don't know the first thing about programming. I recently learned about altering video images using a neural network, and this is the first resource I've found that can break it down in a way I start to understand. Thanks!
I love videos with Mike.
The camera man of ComputerPhile is going to become expert in all fields of computer
I wish I could retain half of it! -Sean
@@Computerphile so your name is Sean . I didn't expect you reply. Thanks you
i love the vids with this guy, he's great
omg the people one! so trippy. I am really intrigued by this. great video!
What an excellent demonstration of ML...
i love this guy, he explains these things so well :D
This is super inspiring; I see so much I'd want to do with this. Thank you.
Thank you for this great and comprehensible explanation! Liked it a lot, and learned something.
Mike, you are the best man! Thanks!
@6:55 you've never seen a rabbit fox bird before?
What I think would be interesting to see is a network that was let's say, specifically trained to identify cats and not give it any input but tell it to maximize on the highest level the feature "cat" itself so find out what in the eye of the network the optimal cat is.
how will you not give it any input? the whole point of deep learning and neural network is that there has to be some sort of training data. the machine's perspective about this ideal cat is just some output of the images you gave it- you give it different pictures, it forms different opinions on how a cat really looks like. it doesn't conjure them out of thin air.
I am aware of that, I meant to not input anything after it has been trained and just reverse the neural network, so instead of starting with a picture to identify or hallucinate into an existing image start with the result 'cat' reverse the network and look at what it comes up with.
It sounds like it works like Newton's method. Newton's method will only find a local minimum, which might not even be a (real) root. If the derivative at the current point is zero it doesn't do anything. There are other kinds of traps depending on the function. If you fed Deep Dream a solid color, it would probably behave similarly. It needs something, anything to go on.
"I want more bits of cat!" sounded kinda creepy :x
Better than most art I've seen.
One thing that wasn't explained (or I missed it) was: how exactly are the images changed to have the result we want?
What operations are applied to the image to give the result that decreases the error?
Well, if you look at the video about convolutional neuron networks, you'll see it's all some small kernels with basic functions and abstract operations working with weights of previous layers.
The thing is that we don't know specifically what they're doing at that point, because it's been so convoluted and abstracted that it's impossible to ascribe human readable meaning to it.
You just look at the results, and if they're better after some change, you keep changing in that direction.
Inverting the process uses the same process: We more or less know what we want (through training the network), so we can use the skews in that direction
LSD must have some similar mechanism.
these images and the deep dream videos available on YT, especially the famous grocery store video, look extremely similar to what happens with high doses of LSD
Yep it does, especially in the cases of back propagation, weighted feedback and spill over. Tryptamines in particular turn off areas that dampen feedback (especially in the visual system), causing massive loops which then enhances a small signal over and over until it becomes an extremely large one.
Or rather, it's how the brain works, how it recognizes objects. They don't call it a "neural network" for nothing. What LSD does is increase crosstalk &/or sensitivity in the network.
I remember having a similar psychedelic insight.
"Omg, we're just pattern-recognizing machines..."
I said as I looked at the fractal like clouds repeating is the sky.
I was silent for a moment, shocked by this 'hidden truth' I uncovered on acid.
But I quickly realized this was quite obvious and nothing to worry about.
xD
Autolykos
Wut, N2O doesn't get you extremely high.
Not to the extend that you would find secrets of the universe.
That sounds more like tryptamines.
Mike always does the more interesting videoes :)
thank you!!! been waiting for a video on this :)
best artist ive ever seen
which watch are you wearing ? : ) always enjoy your videos
This reminds me a lot about the Photoshop filters :) Fascinating!
That empty shelf somehow bothers me... those books need some company
He first started in this series at that office with absolutely nothing there. Each episode he seems to get more and more.
Ryan N
I know, thats why its so sad ... its been like this for months....
This was a great explanation!
Best explanation yet
"I want more ears, I want more paws, I want more bits of cat." - Dr. Mike Pound, 2016
So if I got this right its something like this:
"This leaf looks like a cat-feature, let's put more things with cat-features in the picture."
Right?
I enjoyed this video like a child!
congratulations
Hello Computerphile! What an interesting video, thank you for explaining this interesting way of using neural networks!
Do you know if this has ever been used for music? Martin
"It's only for fun!"
- Illuminati
AI imagiage generation has advanced a lot since then with Dalle 2, Midjourny and stable dffusion.
I do essentially the same thing when I use the bathroom and look for hidden pictures in the linoleum. Mind = Blown.
Get you some more books! Just being flippant, this was a really cool video.
Beautiful insight.
Such a great teacher. Thanks.
the picture at 6:41 was not included in the zip file. there is a file named generalimage, but this is actually moreiterations, while the moreiterations file is a cropped version of the same image.
Please do one of these on the neural artistic style algorithm as well! They are great
Mike' s watch looks cool!
I would be curious to hear his explanation on psychedelic visuals, like what people see on LSD
please correct me if im wrong but does this instantly invalidate all forms of CAPTCHA for bot protection with correct weight editing of a neural network? it will just be able to return a very high probability of letters
also googles new reCAPTCHA service, "please click all the pictures with trees" could be completely implied
you can even download captcha api and generate your own letter samples to teach your neural network, that's right
Alphanumeric CAPTCHAs had already been circumvented by machines a few years back, that is why companies (particularly Google) are moving towards image-recognition based CAPTCHAs now, but it's only a matter of time until that becomes obsolete too. Should be interesting what the next stage will be.
+Jeraru MC
Not really, the classic captchas (letters and numbers) can be solved very easily with comparatively small networks. Really, coding with ANNs has become so easy, programming a bot to deal with the UI will likely take more lines of code than the actual ANN itself.
I already saw some captchas asking me what monkeys like to eat etc., things that require an understanding of a sentence combined with general knowledge, and I think it will take quite some time until computers can reliably handle that stuff.
one day, our captchas will have unintentionally become very successful turing test.
Art Project A+.
Thanks Google!
thanks again for blowing my mind
Is there like a readymade windows binary available of the version you can train on your own "matching" images rather than having to keep with the standard creeptacular settings? I did come across a website once where you could upload two pictures - essentially "rework the detail of image A with the texture of image B", which was quite neat in its way, but still rather limited - but that's as close as I ever came.
This is so incredible and interesting and I know it's going to be so interesting for AI and recognition, but...
I couldn't even look at those last images I was so freaked out. They are just as disturbing as any post-modern human art I've ever seen. Straight nightmare-fuel.
I’ve always been interested at how AI image generations feel very similar to the kinds of images you get when half asleep, as your dreams start to form but aren’t fully consolidated.
I wonder if it’s coincidental or if this is truly an instrumental part of visualization.
Great stuff, we want more... How about extra bits on how Mike goes around to create these images via Python
even more deep learning videos please!
I wonder, what if we design a neural network that can learn from 3D models instead of just pictures? Wouldn't the recognition result be better?
You think training data grows on trees?
@@DasAntiNaziBroetchen Well yes. If you want your network to recognize apples that is
That's the emptiest bookshelf I've seen on a computerphile/numberphile video
Got a link for the source code mentioned at the end?
Yep! This is the google deep dream code:
github.com/google/deepdream/blob/master/dream.ipynb
I actually did away with notebook stuff, and just copied the relevant stuff into a large python file, and messed about with it. You'll need to have caffe, python, numpy etc. installed. Have fun!
+Michael Pound how easy/difficult is it to train a neural network with images?
It's simple, really. The weight-changing aspect is so standard that by now, you could probably call a single method from a library to do it all for you. The only "difficult" part is that you need to find a lot of images for training and reliably tag the proper outputs. But that's not even hard, since Google Image Search exists XD
What is it that makes this computer generated artwork look so psychedelic? It's amazing how accurately this network represents the visual effects of a psychedelic experience. I have not ever seen a human artist represent this in such a way, and I have been looking. I am dying to know if there is some connection between the human brain under the influence of LSD and this network.I would love to get an experienced neurologist and a neural network engineer in the same room for a discussion on this subject. It is fascinating!....will Google make custom prints of this to order ? I need to go find out~~~see ya!
This program is, in my opinion, is scratching the surface using the method our brain uses to relate thoughts and concepts. How images communicate with each other to remind us of things we've seen before, or imagine, or try to visualize. I think these psychedelic looking images, as well as those people might see under the influence of LSDs, are a primitive or low efficiency version of how our brain treats information and images function at normal. I don't know if I'm making sense here, I guess I just mean that our brain produces more requested cost functions with more accurate weights, with a wider selection of weights, at a much much much higher speed, many many many times over. LSDs alter that process, perhaps by slowing down (or somehow else) the entire process of arriving at the normally desired output, and so the resulting trippy images are a magnified version of the normal process. Like stretching out a slinky, the stretched out bit is way different from what a slinky usually looks like. Sorry mate it seems like I'm making no sense lol
I think it's because psychedelic visuals/hallucinations are made through a sort of perceptual feedback loop. This is all my own conjecture, but if you think about when you see something out to the corner of your eye and think it's something else, what is happening is that your subconscious goes "oh, that shape kinda looked like a person" and fills in some of the missing features. What happens with psychedelics is that the image of a person generated by your subconscious is then superimposed onto your vision and re-processed, eventually building up a complete image of a person over many iterations. If you think about it in terms of what was explained in this video, there's a pretty clear correlation. "Lower level" hallucinations (colors, shapes, and patterns) would come from your subconscious "maximizing" the lower nodes of the network, and higher level hallucinations (identifiable objects) come from maximizing the higher nodes.
Its "thinking" way faster then our brain usually does.....until you drop some kind of drug on it. This looks exactly like an x-dream. Go figure
@@ianhamilton350 That seems to ba very compelling explanation. I've seen some articles about the few recent psychedelic clinical studies, and they seem to suggest an increase in activity in and between regions of the brain. To me it follows that some of that increased activity could be from the visual processing areas back to the visual perception areas, and that's basically what's going on here, using visual processing data to create an image...
Thank you for a great video! nice start of thd weekend
Any tips on how to start with making your own model / train the neural network with your own pictures?
What happens if you maximise the very last layer instead of the one just previous to it?
After my exams I'm making it my mission to watch every single Computerphile video ever. Also, I wonder if these guys are mini celebrities on Notts campus in the UK. I know that's how I'd see them lol
11:44 Trypophobiacs: **cringes**
Lotus seed pods.
Fear is the mind killer.
👍
Great video! 😀
Dang, even Cyriac isn't safe from robots encroaching on his job.
12:15 _hybrid baby things that give me nightmares_ 😂
So is the Prisma app based on a lower level neuron network?
yes
***** Sound reasonable (and looks like it)
Would it be possible to apply this to a sound visualization (spectragram?) with an AI that determines who's voice that is, and make everything sound like one person's voice?
he was still rockin windows 7 even 6 years ago. man i wish there was some sort of community driven effort to get windows 7 up and ready for modern use :/ rip win 7
Had an interesting question, what's going on with Auxiliary chord to cassette tape converters? How does that interface with a cassette player + phone/other input.
You mention the source code, could we get a link to that in the description?
Also, maybe a video about the deepstyle community and how those networks differ from classic deepdream could be interesting.
I like how bare the bookshelf in the background is, haha.
What happens if you run an image, and then continues to run the program on the output image?
It seems like the image showed in the video got closer and closer to a "final" image. But I would imagine that it would just keep changing in varying places each time.
"I want more ears, I want more paws, I want more bits of cat."
Last images are somewhat haunting
All I see is Trypophobia
lol
That eyes/fur picture must've really set some people off.
Yup. It didn't trigger me, although google image search can do that to me, but I can easily see how more sensitive people would be getting triggered HARD.
you could foreseeably make a deep dream filter that emphasizes holes in flesh, what a horrible idea.
Hello Satan
I personally think "Google Dream" is an AI system thats learning different images which we upload into it and by doing this they can eventually release a search engine, in the near future based on images. Meaning you can search by images and very accurately.
Doesn't sound terribly useful. Writing is a lot easier than drawing, after all.
Very interesting video!