I've just been reading these papers for the openai retro competition. Your video went into a lot of depth, which is really hard to do with complex ideas, bravo!
Ah dude just discovered your videos!! Just what I needed. Can't believe, have 6 year degree in engineering, work in AI and I can still learn from UA-cam.mad when you think out it. It's a new paradigm of education
Holy shit. I have been working on this problem for months and to see that professionals are getting almost the exact same answers as me is pretty cool. There are a whole bunch if ideas in here I have not tried yet as well. Super useful
This a very effective strategy for personal productivity as a programmer with ADHD. I augment my unreliable reward-signaling system with Test-Driven Development.
The video quality is great but the topics are just not interesting for many people. And of course few subs makes it hard to find this channel. I'm glad I did though. This is a great overview.
AMAZING! The prediction-reward algorithm in the first mentioned paper is very similar to how humans learn, at least based on a computational neurobiology course I took in college.
It's always interesting to see how ideas around curiosity have taken off in reinforcement learning (I think about the "Never give up" paper and atari57
I was really touched by the ending of the video. We need research on models and the social-economic consequences of the AI models...and I don't mean that terminator, Butlerian jihad crap. I mean human side: job losses, bias, morality, misuse...etc
Maan it is so damn interesting and good video. I come from a completely different area - game development. And I wanted to understand some basics of A.I because I really want to dive deep into this to eventually teach for example rocket to fly, flappy bird to jump, snake to play efficiently. Reading papers is really difficult without knowledge of some basics, and the way you explained all these things is so good. I still don't understand the terminology and all these formulas, but at least I got one step closer :) Thank you for this brilliant video :)
This is a marvel. I read a book with similar content, and it was a marvel to behold. "The Art of Saying No: Mastering Boundaries for a Fulfilling Life" by Samuel Dawn
So "HER" basically starts off as "if I do this action, I can get to this goal", and then gradually learns how to flip the statement to "if I want to get to this goal, I need to do this action". Pretty nice.
Amazing video again! Clear and concise as always, all but trivial with this kind of topics. I am very curious to see what you will be focusing on next!
This channel is really amazing initiative as I've always found ArXiv extremely interesting but don't have the time to read all the papers. :) This question may sound very silly, but - How do programs play game like Mario and Reversi ? What I mean is, don't we need some kind of hardware like a keyboard or joystick to play these games ? How do software agents play this game ? I have always been curious about this. Please explain my doubt if anyone has my answer. :)
It's not that hard to hack the game engine so that an RL agent controls the game inputs via an API (so you can do that from eg Python) in stead of via a controller/joystick. In most gym games there's even an option to train your agent from the raw game state in stead of the rendered pixel version!
Nice video. I didn't get the last part: how does it learn faster if it sets virtual goals? If it gets the same reward for a virtual goal as for the real goal, then it will just learn it can shoot at any point which is made a goal but the real goal will never be found. If it gets a lower reward then it learns that shooting at goals gives a reward but it tells nothing about the proximity to the real goal. I'm obviously missing something here and I'm really curious what it is. Thank you :)
I sort of feel the same way. We shouldn't make any public policy decisions until we see actual damage happening, and not just overexcited predictions. So far it seems DL/ML is creating net additional jobs and increasing average salaries. If that changes, then maybe it is time to think about new public policies. In the meantime, I would recommend retargeting the time spent worrying about AI into time spent learning about AI to increase your human capital. www.wsj.com/articles/workers-fear-not-the-robot-apocalypse-1504631505 www.forbes.com/sites/bernardmarr/2017/10/12/instead-of-destroying-jobs-artificial-intelligence-ai-is-creating-new-jobs-in-4-out-of-5-companies
Agreed. And even imagining the worst scenario, where AI replaces all jobs, we still will be capable of owning bots and renting then. We will live like gods on earth.
The question here though, is WHO will be owning these robots, and how will these jobs be distributed? For highly educated and resourceful people, this will probably not be a huge issue. But there are something like N million truck drivers in the US, which will have a much harder time adjusting. Going from blue-collar to white-collar is probably not as easy.
A feedback on your video: Trim your content, and be more entertaining for the videos. Watch how Siraj does it. From my point of view, I dozed off a couple of times, even though the accuracy of the content is high. Bascially use less words, less images, less intro, less buildup and focus more on the crux, while going faster to keep your audience on edge and curious. Hope my view is productive to you. Good luck.
Do it like an AI optimizer does it. Minimize and use simplicity as much as possible until you reach the goal: Communicate the idea you want to convey, in as little time and actions as possible.
Your teaching style is incredible! Can you please do a video on Capsule Networks?
I've just been reading these papers for the openai retro competition. Your video went into a lot of depth, which is really hard to do with complex ideas, bravo!
Ah dude just discovered your videos!! Just what I needed. Can't believe, have 6 year degree in engineering, work in AI and I can still learn from UA-cam.mad when you think out it. It's a new paradigm of education
Haha, glad to hear that! You're welcome :)
fantastic content lad!
Instablaster...
Holy shit. I have been working on this problem for months and to see that professionals are getting almost the exact same answers as me is pretty cool. There are a whole bunch if ideas in here I have not tried yet as well. Super useful
This a very effective strategy for personal productivity as a programmer with ADHD.
I augment my unreliable reward-signaling system with Test-Driven Development.
Seriously great, I'd love to see an updated video with the newest research!
no clickbait , good video quality , good sound, relative nice topics for some people, but 16k subs Excuse me , wtf
The video quality is great but the topics are just not interesting for many people. And of course few subs makes it hard to find this channel.
I'm glad I did though. This is a great overview.
AMAZING! The prediction-reward algorithm in the first mentioned paper is very similar to how humans learn, at least based on a computational neurobiology course I took in college.
It's always interesting to see how ideas around curiosity have taken off in reinforcement learning (I think about the "Never give up" paper and atari57
Love your passion for what you are talking about!
Fantastic video! Making me gain time and in an enjoyable way.
Many thanks
I was really touched by the ending of the video. We need research on models and the social-economic consequences of the AI models...and I don't mean that terminator, Butlerian jihad crap. I mean human side: job losses, bias, morality, misuse...etc
Always impressing and I never get bored watching your videos. Good job and keep it up 👍
need more deep RL stuff ^^
Maan it is so damn interesting and good video. I come from a completely different area - game development. And I wanted to understand some basics of A.I because I really want to dive deep into this to eventually teach for example rocket to fly, flappy bird to jump, snake to play efficiently.
Reading papers is really difficult without knowledge of some basics, and the way you explained all these things is so good. I still don't understand the terminology and all these formulas, but at least I got one step closer :)
Thank you for this brilliant video :)
This is a marvel. I read a book with similar content, and it was a marvel to behold. "The Art of Saying No: Mastering Boundaries for a Fulfilling Life" by Samuel Dawn
So "HER" basically starts off as "if I do this action, I can get to this goal", and then gradually learns how to flip the statement to "if I want to get to this goal, I need to do this action". Pretty nice.
if it wasn't for this channel I'd have never have known it wasn't pronounced 'ark-ziv'
Same here, at least we got it corrected without embarrassing ourselves IRL
@@ritajitdey7567 INR
Amazing video again! Clear and concise as always, all but trivial with this kind of topics.
I am very curious to see what you will be focusing on next!
Really happy to find your channel, really sad to find out few videos in it.
amazing content(s), you are a very good teacher
Recommend to read "Curiosity-driven Exploration by Self-supervised Prediction"
it's really awesome paper.
Your videos are awesome!! Im going to tell all my frieds about you
I would like to see a video on meta reinforcement learning. Its an exciting field now!
Great channel. Thanks for this and other videos.
great content , great purposes . please do more videos asap . im studding at the same field would you suggest some links for up to date good articles?
Great video, I can now look to read the papers. It would be great to post the links of the papers here
All links are in the video description! :)
Awesome video as usual!
What's the website you used in 2:23?
Nice video. Question: Is DDQN efficient at solving sparse reward environments? Say I only give an agent a reward at the end of an episode.
You make high quality videos A+
This is so cool, specially the "HER" method. Wow!
This channel is really amazing initiative as I've always found ArXiv extremely interesting but don't have the time to read all the papers. :)
This question may sound very silly, but - How do programs play game like Mario and Reversi ? What I mean is, don't we need some kind of hardware like a keyboard or joystick to play these games ? How do software agents play this game ?
I have always been curious about this. Please explain my doubt if anyone has my answer. :)
It's not that hard to hack the game engine so that an RL agent controls the game inputs via an API (so you can do that from eg Python) in stead of via a controller/joystick. In most gym games there's even an option to train your agent from the raw game state in stead of the rendered pixel version!
Great vid! re: the ending of the video, what do you think about creating something on AI safety or ethics?
Actually, that's a really good suggestion! Added to my pipeline :)
Have you seen Robert Miles' channel? He has some good stuff on AI safety, but posts rather infrequently.
Hey dude, awesome video as always! Could you do one for the Relational Deep Reinforcement Learning paper of Zambaldi et al. ?
you are doing great, keep it up
Thanks for the nice explanation.
great stuff well done man
Great videos and channel. Why don't you make any more videos? :(
Can you tell me where you find these articles?
Website appears to be Arxiv. Searching for DeepMind and OpenAI papers will yield results too
What about delayed rewards?
Hey, very nice video :)
What is the source for that video containing the boat in a behavioural circuit?
if some one want to contact you directly is there any way ?? i have some questions related to my thesis topic. thanks in advance for your efforts .
Excellent video! Thx.
Make a video on the MuZero paper
C a n. you do an example for RL?
7:56 where the main point starts
brother please explain about capsule network
Aurelien Geron has a great video on CapsNets, no need to redo his video, its already perfect! ua-cam.com/video/pPN8d0E3900/v-deo.html
+Arxiv Insights thanks bro
Hi Xander, I made a Patreon account just for you! Keep it up!
Thx a lot Cody!! Getting this kind of support from people I've never is such a great motivation to keep going! Many thanks :)
Nice video.
I didn't get the last part: how does it learn faster if it sets virtual goals? If it gets the same reward for a virtual goal as for the real goal, then it will just learn it can shoot at any point which is made a goal but the real goal will never be found. If it gets a lower reward then it learns that shooting at goals gives a reward but it tells nothing about the proximity to the real goal. I'm obviously missing something here and I'm really curious what it is. Thank you :)
Awesome video
any coding videos?
15:29 Modi
lol!!
you are amazing
can you suggest a link of research paper on reinforcement learning?.
why his head bigger then the body? Alien?
The number of views of your videos is not proportional to their quality. Looking forward to new content!
Very nice video. Thanks you :)
I really like machine learning because it feels like training a pokemon sure it sometimes take a very long time to get it set up but yeah...
I don't see any social problem automation can cause.
If you let the market free, it will ajust itself as it always did.
I sort of feel the same way. We shouldn't make any public policy decisions until we see actual damage happening, and not just overexcited predictions. So far it seems DL/ML is creating net additional jobs and increasing average salaries. If that changes, then maybe it is time to think about new public policies. In the meantime, I would recommend retargeting the time spent worrying about AI into time spent learning about AI to increase your human capital.
www.wsj.com/articles/workers-fear-not-the-robot-apocalypse-1504631505
www.forbes.com/sites/bernardmarr/2017/10/12/instead-of-destroying-jobs-artificial-intelligence-ai-is-creating-new-jobs-in-4-out-of-5-companies
Agreed.
And even imagining the worst scenario, where AI replaces all jobs, we still will be capable of owning bots and renting then.
We will live like gods on earth.
The question here though, is WHO will be owning these robots, and how will these jobs be distributed? For highly educated and resourceful people, this will probably not be a huge issue. But there are something like N million truck drivers in the US, which will have a much harder time adjusting. Going from blue-collar to white-collar is probably not as easy.
I just want my computer to grind levels. Not take a my job.
Her?
Smart guy
VOLUME TOO LOW!!!
big brain filter
louder pls
what happened to this channel..
A feedback on your video: Trim your content, and be more entertaining for the videos.
Watch how Siraj does it.
From my point of view, I dozed off a couple of times, even though the accuracy of the content is high.
Bascially use less words, less images, less intro, less buildup and focus more on the crux, while going faster to keep your audience on edge and curious.
Hope my view is productive to you. Good luck.
Do it like an AI optimizer does it. Minimize and use simplicity as much as possible until you reach the goal: Communicate the idea you want to convey, in as little time and actions as possible.