I've just been reading these papers for the openai retro competition. Your video went into a lot of depth, which is really hard to do with complex ideas, bravo!
The video quality is great but the topics are just not interesting for many people. And of course few subs makes it hard to find this channel. I'm glad I did though. This is a great overview.
This a very effective strategy for personal productivity as a programmer with ADHD. I augment my unreliable reward-signaling system with Test-Driven Development.
Holy shit. I have been working on this problem for months and to see that professionals are getting almost the exact same answers as me is pretty cool. There are a whole bunch if ideas in here I have not tried yet as well. Super useful
Ah dude just discovered your videos!! Just what I needed. Can't believe, have 6 year degree in engineering, work in AI and I can still learn from UA-cam.mad when you think out it. It's a new paradigm of education
I was really touched by the ending of the video. We need research on models and the social-economic consequences of the AI models...and I don't mean that terminator, Butlerian jihad crap. I mean human side: job losses, bias, morality, misuse...etc
It's always interesting to see how ideas around curiosity have taken off in reinforcement learning (I think about the "Never give up" paper and atari57
AMAZING! The prediction-reward algorithm in the first mentioned paper is very similar to how humans learn, at least based on a computational neurobiology course I took in college.
This is a marvel. I read a book with similar content, and it was a marvel to behold. "The Art of Saying No: Mastering Boundaries for a Fulfilling Life" by Samuel Dawn
Maan it is so damn interesting and good video. I come from a completely different area - game development. And I wanted to understand some basics of A.I because I really want to dive deep into this to eventually teach for example rocket to fly, flappy bird to jump, snake to play efficiently. Reading papers is really difficult without knowledge of some basics, and the way you explained all these things is so good. I still don't understand the terminology and all these formulas, but at least I got one step closer :) Thank you for this brilliant video :)
So "HER" basically starts off as "if I do this action, I can get to this goal", and then gradually learns how to flip the statement to "if I want to get to this goal, I need to do this action". Pretty nice.
Amazing video again! Clear and concise as always, all but trivial with this kind of topics. I am very curious to see what you will be focusing on next!
This channel is really amazing initiative as I've always found ArXiv extremely interesting but don't have the time to read all the papers. :) This question may sound very silly, but - How do programs play game like Mario and Reversi ? What I mean is, don't we need some kind of hardware like a keyboard or joystick to play these games ? How do software agents play this game ? I have always been curious about this. Please explain my doubt if anyone has my answer. :)
It's not that hard to hack the game engine so that an RL agent controls the game inputs via an API (so you can do that from eg Python) in stead of via a controller/joystick. In most gym games there's even an option to train your agent from the raw game state in stead of the rendered pixel version!
Nice video. I didn't get the last part: how does it learn faster if it sets virtual goals? If it gets the same reward for a virtual goal as for the real goal, then it will just learn it can shoot at any point which is made a goal but the real goal will never be found. If it gets a lower reward then it learns that shooting at goals gives a reward but it tells nothing about the proximity to the real goal. I'm obviously missing something here and I'm really curious what it is. Thank you :)
I sort of feel the same way. We shouldn't make any public policy decisions until we see actual damage happening, and not just overexcited predictions. So far it seems DL/ML is creating net additional jobs and increasing average salaries. If that changes, then maybe it is time to think about new public policies. In the meantime, I would recommend retargeting the time spent worrying about AI into time spent learning about AI to increase your human capital. www.wsj.com/articles/workers-fear-not-the-robot-apocalypse-1504631505 www.forbes.com/sites/bernardmarr/2017/10/12/instead-of-destroying-jobs-artificial-intelligence-ai-is-creating-new-jobs-in-4-out-of-5-companies
Agreed. And even imagining the worst scenario, where AI replaces all jobs, we still will be capable of owning bots and renting then. We will live like gods on earth.
The question here though, is WHO will be owning these robots, and how will these jobs be distributed? For highly educated and resourceful people, this will probably not be a huge issue. But there are something like N million truck drivers in the US, which will have a much harder time adjusting. Going from blue-collar to white-collar is probably not as easy.
A feedback on your video: Trim your content, and be more entertaining for the videos. Watch how Siraj does it. From my point of view, I dozed off a couple of times, even though the accuracy of the content is high. Bascially use less words, less images, less intro, less buildup and focus more on the crux, while going faster to keep your audience on edge and curious. Hope my view is productive to you. Good luck.
Do it like an AI optimizer does it. Minimize and use simplicity as much as possible until you reach the goal: Communicate the idea you want to convey, in as little time and actions as possible.
Your teaching style is incredible! Can you please do a video on Capsule Networks?
I've just been reading these papers for the openai retro competition. Your video went into a lot of depth, which is really hard to do with complex ideas, bravo!
no clickbait , good video quality , good sound, relative nice topics for some people, but 16k subs Excuse me , wtf
The video quality is great but the topics are just not interesting for many people. And of course few subs makes it hard to find this channel.
I'm glad I did though. This is a great overview.
Seriously great, I'd love to see an updated video with the newest research!
This a very effective strategy for personal productivity as a programmer with ADHD.
I augment my unreliable reward-signaling system with Test-Driven Development.
Holy shit. I have been working on this problem for months and to see that professionals are getting almost the exact same answers as me is pretty cool. There are a whole bunch if ideas in here I have not tried yet as well. Super useful
Ah dude just discovered your videos!! Just what I needed. Can't believe, have 6 year degree in engineering, work in AI and I can still learn from UA-cam.mad when you think out it. It's a new paradigm of education
Haha, glad to hear that! You're welcome :)
I was really touched by the ending of the video. We need research on models and the social-economic consequences of the AI models...and I don't mean that terminator, Butlerian jihad crap. I mean human side: job losses, bias, morality, misuse...etc
fantastic content lad!
Instablaster...
It's always interesting to see how ideas around curiosity have taken off in reinforcement learning (I think about the "Never give up" paper and atari57
AMAZING! The prediction-reward algorithm in the first mentioned paper is very similar to how humans learn, at least based on a computational neurobiology course I took in college.
Love your passion for what you are talking about!
need more deep RL stuff ^^
Fantastic video! Making me gain time and in an enjoyable way.
Many thanks
I would like to see a video on meta reinforcement learning. Its an exciting field now!
if it wasn't for this channel I'd have never have known it wasn't pronounced 'ark-ziv'
Same here, at least we got it corrected without embarrassing ourselves IRL
@@ritajitdey7567 INR
This is a marvel. I read a book with similar content, and it was a marvel to behold. "The Art of Saying No: Mastering Boundaries for a Fulfilling Life" by Samuel Dawn
Always impressing and I never get bored watching your videos. Good job and keep it up 👍
Recommend to read "Curiosity-driven Exploration by Self-supervised Prediction"
it's really awesome paper.
Really happy to find your channel, really sad to find out few videos in it.
Maan it is so damn interesting and good video. I come from a completely different area - game development. And I wanted to understand some basics of A.I because I really want to dive deep into this to eventually teach for example rocket to fly, flappy bird to jump, snake to play efficiently.
Reading papers is really difficult without knowledge of some basics, and the way you explained all these things is so good. I still don't understand the terminology and all these formulas, but at least I got one step closer :)
Thank you for this brilliant video :)
So "HER" basically starts off as "if I do this action, I can get to this goal", and then gradually learns how to flip the statement to "if I want to get to this goal, I need to do this action". Pretty nice.
Amazing video again! Clear and concise as always, all but trivial with this kind of topics.
I am very curious to see what you will be focusing on next!
Great video, I can now look to read the papers. It would be great to post the links of the papers here
All links are in the video description! :)
Your videos are awesome!! Im going to tell all my frieds about you
great content , great purposes . please do more videos asap . im studding at the same field would you suggest some links for up to date good articles?
amazing content(s), you are a very good teacher
Great channel. Thanks for this and other videos.
This is so cool, specially the "HER" method. Wow!
Excellent video! Thx.
you are doing great, keep it up
Nice video. Question: Is DDQN efficient at solving sparse reward environments? Say I only give an agent a reward at the end of an episode.
Hey dude, awesome video as always! Could you do one for the Relational Deep Reinforcement Learning paper of Zambaldi et al. ?
Awesome video as usual!
This channel is really amazing initiative as I've always found ArXiv extremely interesting but don't have the time to read all the papers. :)
This question may sound very silly, but - How do programs play game like Mario and Reversi ? What I mean is, don't we need some kind of hardware like a keyboard or joystick to play these games ? How do software agents play this game ?
I have always been curious about this. Please explain my doubt if anyone has my answer. :)
It's not that hard to hack the game engine so that an RL agent controls the game inputs via an API (so you can do that from eg Python) in stead of via a controller/joystick. In most gym games there's even an option to train your agent from the raw game state in stead of the rendered pixel version!
You make high quality videos A+
great stuff well done man
Thanks for the nice explanation.
Great vid! re: the ending of the video, what do you think about creating something on AI safety or ethics?
Actually, that's a really good suggestion! Added to my pipeline :)
Have you seen Robert Miles' channel? He has some good stuff on AI safety, but posts rather infrequently.
Great videos and channel. Why don't you make any more videos? :(
Hey, very nice video :)
What is the source for that video containing the boat in a behavioural circuit?
Awesome video
if some one want to contact you directly is there any way ?? i have some questions related to my thesis topic. thanks in advance for your efforts .
Can you tell me where you find these articles?
Website appears to be Arxiv. Searching for DeepMind and OpenAI papers will yield results too
Make a video on the MuZero paper
you are amazing
What about delayed rewards?
Very nice video. Thanks you :)
Nice video.
I didn't get the last part: how does it learn faster if it sets virtual goals? If it gets the same reward for a virtual goal as for the real goal, then it will just learn it can shoot at any point which is made a goal but the real goal will never be found. If it gets a lower reward then it learns that shooting at goals gives a reward but it tells nothing about the proximity to the real goal. I'm obviously missing something here and I'm really curious what it is. Thank you :)
C a n. you do an example for RL?
What's the website you used in 2:23?
7:56 where the main point starts
Hi Xander, I made a Patreon account just for you! Keep it up!
Thx a lot Cody!! Getting this kind of support from people I've never is such a great motivation to keep going! Many thanks :)
brother please explain about capsule network
Aurelien Geron has a great video on CapsNets, no need to redo his video, its already perfect! ua-cam.com/video/pPN8d0E3900/v-deo.html
+Arxiv Insights thanks bro
The number of views of your videos is not proportional to their quality. Looking forward to new content!
can you suggest a link of research paper on reinforcement learning?.
I really like machine learning because it feels like training a pokemon sure it sometimes take a very long time to get it set up but yeah...
any coding videos?
Smart guy
15:29 Modi
lol!!
I just want my computer to grind levels. Not take a my job.
I don't see any social problem automation can cause.
If you let the market free, it will ajust itself as it always did.
I sort of feel the same way. We shouldn't make any public policy decisions until we see actual damage happening, and not just overexcited predictions. So far it seems DL/ML is creating net additional jobs and increasing average salaries. If that changes, then maybe it is time to think about new public policies. In the meantime, I would recommend retargeting the time spent worrying about AI into time spent learning about AI to increase your human capital.
www.wsj.com/articles/workers-fear-not-the-robot-apocalypse-1504631505
www.forbes.com/sites/bernardmarr/2017/10/12/instead-of-destroying-jobs-artificial-intelligence-ai-is-creating-new-jobs-in-4-out-of-5-companies
Agreed.
And even imagining the worst scenario, where AI replaces all jobs, we still will be capable of owning bots and renting then.
We will live like gods on earth.
The question here though, is WHO will be owning these robots, and how will these jobs be distributed? For highly educated and resourceful people, this will probably not be a huge issue. But there are something like N million truck drivers in the US, which will have a much harder time adjusting. Going from blue-collar to white-collar is probably not as easy.
why his head bigger then the body? Alien?
big brain filter
Her?
VOLUME TOO LOW!!!
louder pls
what happened to this channel..
A feedback on your video: Trim your content, and be more entertaining for the videos.
Watch how Siraj does it.
From my point of view, I dozed off a couple of times, even though the accuracy of the content is high.
Bascially use less words, less images, less intro, less buildup and focus more on the crux, while going faster to keep your audience on edge and curious.
Hope my view is productive to you. Good luck.
Do it like an AI optimizer does it. Minimize and use simplicity as much as possible until you reach the goal: Communicate the idea you want to convey, in as little time and actions as possible.