AI Learns to Walk (deep reinforcement learning)

Поділитися
Вставка
  • Опубліковано 21 лис 2024

КОМЕНТАРІ • 9 тис.

  • @aiwarehouse
    @aiwarehouse  Рік тому +15910

    In every “AI learns to walk” video I’ve seen, the AI either learns to walk in a weird, non-human way, or they use motion capture of a real person walking and simply train the AI to imitate that. I thought it was weird that nobody tried to train it to walk properly from scratch (without any external data), so I wanted to give it a shot! That’s what I said 4 months ago. It’s been really difficult, but I’ve finally managed to do it, so please watch the whole video! The final result ended up being awesome :)
    If you're interested in training your own AI like Albert but don't know how, there's now a really easy way to do it! Luda, an AI lab, recently built a web app that allows you to create and train your own AI using deep reinforcement learning (just like Albert) completely for free in your browser! You build your own character (called a Mel) with lego-like building blocks then watch it train in real-time on their website in just a few minutes (really). It's an awesome project, and just like my videos, makes deep reinforcement learning so much more accessible, which is why I love it so much. This section of the comment is sponsored by Luda, but these words are entirely my own, it's an amazing project that I would have been obsessed with had they released it before I built Albert. I've genuinely been looking for a sandbox/game exactly like this since I was a kid. They're still early, but they're giving my audience first access to their closed, pre-alpha build. Make sure you check out their site and create an AI agent for yourself!:D prealpha.mels.ai
    Now, back to Albert:
    NOTE: You can only see one Albert, but there are actually 200 copies of Albert and the room he’s in training behind the camera to speed up the training.
    If you want to learn more about how Albert actually works, you can read the rest of this very long comment I wrote explaining exactly how I trained him! (and please let the video play in the background while reading so UA-cam will show Albert to more people)
    THE BASICS
    I created everything using Unity and ML-Agents. Albert is controlled entirely by an artificial brain (neural network) which has 5 layers, the first layer consists of the inputs (the information Albert is given before taking action, like his limb positions and velocities), the last layer tells him what actions to take and the middle 3 layers, called hidden layers, are where the calculations are performed to convert the inputs into actions. His brain was trained using the standard algorithm in reinforcement learning; proximal policy optimization (PPO).
    For each of Albert’s limbs I’ve given him (as an input) the position, velocity, angular velocity, contacts (if it’s touching the ground, wall or obstacle) and the strength applied to it. I’ve also given him the distance from each foot to the ground, direction of the closest target, the direction his body’s moving, his body’s velocity, the distance from his chest to his feet and the amount of time one foot has been in front of the other. As for his actions, we allow Albert to control each body part’s rotation and strength (with some limitations so his arm can’t bend backwards, for example).
    Just like the last videos, Albert was trained using reinforcement learning. For each of Albert's attempts, we calculate a score for how 'good' it was and make small, calculated adjustments to his brain to try to encourage the behaviors that led to a higher score and avoid those that led to a lower score. You can think of increasing Albert’s score as rewarding him and decreasing his score as punishing him, or you can think about it like natural selection where the best performing Alberts are most likely to reproduce. For this video there are 13 different types of rewards (ways to calculate Albert's score), we start off with only a couple and with each new room add more, always in an attempt to get him to walk.
    REWARD FUNCTION
    Room 1: We start off very simple in the first room, we reward him based on how much he moved to the target and we punish him for moving in the wrong direction. This led to Albert doing the worm towards the target, since he figured out that was the easiest way for him to move the quickest/get the highest score.
    Room 2: In the second room we start checking if his limbs hit the ground. If the limb that hits the ground is a foot we reward him (but only if it's in front of his other foot, more on that later), if it isn’t, we punish him. I also made it so Albert wasn’t rewarded at all unless his chest was high enough to force it to at least be partially standing. As seen in the video, this encourages him to not fall over and encourages him to use his feet to do it. We also introduced a new reward designed to encourage smoother movement; if he approaches the maximum strength allowed on a limb he's punished, and he's rewarded if he uses a strength of almost 0. This encourages him to opt for the more human-like movement of using a bit of strength from many limbs as opposed to a lot of strength from one limb.
    Room 3: This is where we start to polish Albert’s gait that developed in room 2 and teach him to turn. From here on we start using the chest height calculation as another direct reward where the higher his chest is the more he’s rewarded in an attempt to get him to stand up as straight as possible. These rewards so far give Albert a decent gait, however he’s still not using both of his feet (which was by far the hardest part of this project), so room 4 is designed to do exactly that.
    Room 4: We get Albert to take more steps from a few additional rewards. To start, we introduce a 2 second timer that resets when one foot goes in front of the other. We reward Albert whenever this timer is above 0 (the front foot has been in front for < 2 seconds), and we punish him whenever the timer goes below 0 (the front foot has been in front > 2 seconds). We add another reward proportional to the distance of his steps to encourage him to take larger steps. To smooth out the movement, we also add a punishment every frame proportional to the difference in his body’s velocity from the previous frame to the current frame, so if he’s moving at a perfectly consistent velocity he isn’t punished at all, and if he makes very quick erratic movements he’s punished a lot.
    If you're still reading this, you're probably really smart and want to learn more about Albert, so make sure to join my discord server I just made where we can talk more about the details of Albert's AI! discord.gg/jM2WkNuBnG :)
    Room 5: For the final room the only change I made to the reward function was to go back to an earlier version of a reward. Throughout the other rooms I had been tinkering with how I should reward Albert’s feet being grounded, my initial thought was to only reward the front foot for being grounded to try to get him to put more weight on his front foot when taking steps, but somewhere along the way I changed it to just rewarding Albert for any foot being grounded, and that was the version Albert trained with in rooms 3 and 4. For this final room I switched back to the old front foot grounded reward which resulted in a much nicer looking walk. Also, the video makes it seem like I never reset Albert’s brain, that isn't entirely true, I had to occasionally reset it because of something called decaying plasticity.
    OTHER
    For rooms 1 to 4 I only allowed Albert to make a decision every 5 game ticks, but for the final room I removed that constraint and let him make decisions every frame. I found if Albert makes a decision every game tick it’s too difficult for him to commit to any proper movements, he ends up just making very small movements like slightly pushing his front foot forward when he should be taking a full step. The 5 game tick decision time forces him to commit to his decision for at least 5 game ticks so he ends up being more careful when moving a limb. When I recorded him beating the final room I removed this limitation because he’s already learned to commit to his actions so allowing him to make a decision every tick just results in a smoother motion.
    Thank you so much for watching! These short videos take literally hundreds of hours to make, if you want to help allow us to make them faster, please consider becoming a channel member! By becoming a member, your name can be in future videos, you can see behind-the-scenes things that don’t fit in the regular videos, you can also use stickers of Albert, Kai and some other characters our team made in comments (more coming) :D
    Thank you so much for watching, this video took me 4 months to make, so please, if you enjoyed it or learned something from it, share it with someone you think will also enjoy it! :)

  • @Gabonation
    @Gabonation Рік тому +32929

    The fact that albert learned how to do the worm before walking means this AI is ahead of us

    • @Sayleeh
      @Sayleeh Рік тому +810

      i can't do the worm

    • @WilliamParkerer
      @WilliamParkerer Рік тому +526

      Worm superiority

    • @siraaron4462
      @siraaron4462 Рік тому +814

      Well I mean... When there's no energy cost violently rapid convulsions are just more efficient

    • @SgtSupaman
      @SgtSupaman Рік тому +393

      Human babies do wiggling movements on their stomachs before learning to crawl, but it isn't a very helpful motion. Albert is just utilizing his unique anatomy.

    • @NagitosWifeSpotty
      @NagitosWifeSpotty Рік тому +92

      and he did it impressively too, damn
      idk if that makes sense but i def cannot do that

  • @PollokPoochesDogWalking
    @PollokPoochesDogWalking Рік тому +7074

    Reminds me of how I learned to walk. The lab. The green squares. The flying red cubes. Ah the memories ❤

    • @yeahmans
      @yeahmans Рік тому +89

      did ypu train uour dog like this

    • @baturax0
      @baturax0 Рік тому

      ​@@yeahmans it looks like he is a dog and his parents trained him like this

    • @39Jhahapilie
      @39Jhahapilie Рік тому +131

      ​@@yeahmansif having hostages is illegal I'm guilty

    • @yeahmans
      @yeahmans Рік тому +30

      @@39Jhahapilie its not illegal so im not guilty

    • @Ahnminhyeong
      @Ahnminhyeong Рік тому +9

      so you can revenge

  • @JeremyFinch42
    @JeremyFinch42 Рік тому +1467

    I like how Albert not only mastered the worm and skipping before walking, but that during the rough terrain test he corrects missing the button by just falling backwards on it, thus literally using his head to solve yet another problem.

    • @129das
      @129das Рік тому +10

      He wasn't skipping he was walking with one foot for the longest time.

    • @JeremyFinch42
      @JeremyFinch42 Рік тому +46

      @@129das
      Fine, he was galloping.

  • @4m0nym
    @4m0nym 11 місяців тому +1515

    I love how 6:10 is the most replayed part of the video.
    It really looks exactly like when a human trips, doing those stupid desperate steps but ultimately you're past the point of saving yourself.

    • @fonix9837
      @fonix9837 9 місяців тому +114

      This is what happens when u try to run to catch your fall😂😂

    • @flamestornado9272
      @flamestornado9272 9 місяців тому +65

      You are beyond saving unless you are good with having sprained leg muscles.

    • @Taha-qw5ni
      @Taha-qw5ni 9 місяців тому +42

      Do not try to save situation at these cases, try to fall safely

    • @HorswrangBasumatary
      @HorswrangBasumatary 8 місяців тому +11

      Looks like a baby learning how to walk

    • @lettherebecarnage881
      @lettherebecarnage881 5 місяців тому

      Bro fym you love

  • @dragex6582
    @dragex6582 Рік тому +674

    I don't think I'll ever get tired of witnessing Albert learning how to live.

  • @reknostarfox4690
    @reknostarfox4690 Рік тому +852

    I liked that confident walk Albert had in the last challenge, he sees the goal, and went for it, and nothing has stopped him.

    • @TheDifferenced
      @TheDifferenced Рік тому +21

      He literally keep moving forward! Tatakae! Tatakae! 🚀

    • @clibothy
      @clibothy Рік тому +8

      he never even noticed the cubes

    • @b.s.7693
      @b.s.7693 Рік тому +1

      Except the reset button

    • @bobhandsome4606
      @bobhandsome4606 Рік тому +3

      No mater how much he fails he takes he still wants his reword

    • @s3dghost
      @s3dghost Рік тому +2

      Anthropomorphism

  • @CharlesMichaelShell
    @CharlesMichaelShell Рік тому +1388

    The way he learns to first walk by skipping is really reminiscent of the way astronauts walk on the moon. The slightly reduced gravity makes skipping way easier and more efficient to get around, especially in those restrictive suits. Albert is so top-heavy and his limbs are shortened, so that was a great first step for him.

    • @TheBestcommentor
      @TheBestcommentor Рік тому +83

      You could even say it was a giant leap.

    • @lpsp442
      @lpsp442 Рік тому +54

      Skipping is actually just highly efficient in general. Just try it sometime!

    • @iMidnightStorm
      @iMidnightStorm Рік тому +37

      ​@@lpsp442 Yep, way back in elementary school I used to skip around the campus instead of run. The weird looks were worth it though.

    • @Oblivionpma
      @Oblivionpma Рік тому +4

      I noticed how the right leg skipping stayed

    • @beavismcdeavis142
      @beavismcdeavis142 Рік тому

      And also completely incompetent when they lost the technology to go back

  • @glitch4771
    @glitch4771 10 місяців тому +591

    I like how the ultimate reward for all of his efforts is just endless falling into the void

  • @yturly6535
    @yturly6535 Рік тому +4481

    Albert is growing. He will take over the world.

    • @Greek_mappe.r
      @Greek_mappe.r Рік тому +79

      He will be a good leader

    • @xj3xup6
      @xj3xup6 Рік тому +26

      Maybe with Neuro?

    • @yobaugst3369
      @yobaugst3369 Рік тому +86

      ​​@@Greek_mappe.r Albert learns how to become an absolute monarch (deep reinforcement training)

    • @Wonders_of_Reality
      @Wonders_of_Reality Рік тому +6

      @@Greek_mappe.r Much better than Putin!

    • @yturly6535
      @yturly6535 Рік тому +2

      @@yobaugst3369 I love this

  • @flowersnyc
    @flowersnyc Рік тому +1189

    found myself rooting for him.
    rooted for him HARD in the last 17 seconds. “Stay upright! Reach the finish line!”

  • @theunknownanomaly1950
    @theunknownanomaly1950 Рік тому +2649

    I've had to relearn how to walk a few times due to having ankle surgery, and I must admit that Albert's progression from shuffle to walk is uncannily similar to my own progression.

    • @aezrithferova6675
      @aezrithferova6675 Рік тому +362

      Someone pelted you with cubes until you learned how to walk again?

    • @theunknownanomaly1950
      @theunknownanomaly1950 Рік тому +245

      @@aezrithferova6675 lol no that would have been interesting tho

    • @MiraiXDX
      @MiraiXDX Рік тому +140

      Did u learn the worm before learning to walk?

    • @Emily12471
      @Emily12471 Рік тому +66

      Honestly this probably wasn't to far off from how real bipeds first figured out how walking works

    • @WatcherWithNoEyes
      @WatcherWithNoEyes Рік тому +17

      You are the albert

  • @UnrealDevGamer
    @UnrealDevGamer 6 місяців тому +99

    By the end my emotional relationship with, Albert is like a father encouraging their child. You go, Albert! So proud of you.

  • @mrclean29
    @mrclean29 Рік тому +3807

    Great job!
    You’ve inspired me to start throwing big red cubes at my toddler as soon as he starts walking!

    • @memento81
      @memento81 Рік тому +126

      I think that is the Andrew Tate method to raise real masculine alpha males 😂

    • @yemabow9860
      @yemabow9860 Рік тому +56

      At least he’ll be amazing at dodgeball!

    • @Ilovefisch
      @Ilovefisch Рік тому +15

      I hope those weren't lava bricks

    • @Trevor_NewJerusalem
      @Trevor_NewJerusalem Рік тому +6

      As you should.

    • @dualduality
      @dualduality Рік тому

      your unfunny,

  • @justinnelson6794
    @justinnelson6794 Рік тому +3980

    I like how whenever Albert makes it to a new stage or checkpoint, he’s just like: “ok that’s enough for today. Let’s do a face plant.”

    • @carscientist
      @carscientist Рік тому +157

      Thats what humans do too

    • @scoper7897
      @scoper7897 Рік тому +8

      @@carscientist i never heard of such a thing. Nobody has ever done that man. Stop lies....

    • @Sans_The_Skeleton
      @Sans_The_Skeleton Рік тому +143

      @@scoper7897 What are you talking about? at the end of everyday I face plant into my pillow and go to sleep

    • @scoper7897
      @scoper7897 Рік тому +3

      @@Sans_The_Skeleton you never done that man. People go sleep as normal. No faceplating on pillow. Nobody ever done so

    • @P4CKWATCH
      @P4CKWATCH Рік тому +68

      @@scoper7897 yes they did?

  • @hxcily
    @hxcily Рік тому +1208

    I feel like I've raised a child simply by watching Albert learn to walk and rooting for him

  • @LeannLeannProduction
    @LeannLeannProduction Рік тому +354

    Wow this is the most clever way to train an AI to walk that I have ever seen. You masterfully set up video game-like challenges to force it to learn specific behaviors that would overall give a better result. Plus, the editing is fantastic and you have a quirky sense of humor! Awesome work! So fun and fascinating to watch :D I look forward to continuations of Albert's learning journey!

  • @ristopoho824
    @ristopoho824 Рік тому +476

    6:10 that stumble is impressive. Very humanlike movement, trying to correct the path, and failing, but moving very convincingly.

    • @dumbdannia6326
      @dumbdannia6326 Рік тому +54

      It felt too real, like I literally stumble like that sometimes

    • @JoshyRB
      @JoshyRB Рік тому +15

      My favourite part of this video

    • @ruvty3742
      @ruvty3742 Рік тому +2

      Me having a heart attack:

    • @Alex-lc7v
      @Alex-lc7v Рік тому +1

      Steven Gerrard would be proud

    • @Alex-lc7v
      @Alex-lc7v Рік тому

      Steven Gerrard would be proud

  • @FiR3Dr4g0n
    @FiR3Dr4g0n Рік тому +3822

    Let's not forget how difficult it must have been for Albert to learn to walk with such a massive head.

    • @arcan762
      @arcan762 Рік тому +18

      @Repent and believe in Jesus Christ amen

    • @Hispano-Romano
      @Hispano-Romano Рік тому +105

      ​@Repent and believe in Jesus Christ But why this in this comment?

    • @kiran9s
      @kiran9s Рік тому

      His whole body is aerodynamically stupid.

    • @poti732
      @poti732 Рік тому +185

      @@Hispano-Romano because they are fanatics and they will comment anywhere just to get some attention .

    • @Hispano-Romano
      @Hispano-Romano Рік тому +7

      @@poti732 At first I thought it was an answer to the comment above it ñ and i didn't catch it XDXDXD

  • @kanostv
    @kanostv Рік тому +303

    LET’S GOOOOOOOO WE CAN SEE ALBERT LEARNING AGAIN (genuinely hyped to watch that video)

  • @Brickman_Offical
    @Brickman_Offical Місяць тому +15

    2:43 When you said “Yes, walls exist now, Albert.” Albert was like “😭😭”

  • @haithemmerchaoui9710
    @haithemmerchaoui9710 Рік тому +389

    I like to think of Albert jumping off the edge is him becoming self aware and realizing that life is nothing but sacrifice and failed attempts

  • @izzdrizz3535
    @izzdrizz3535 Рік тому +1748

    It's so cool once you realize that the way Albert learns to walk is the same way a lot of babies do. First they wiggle to move, then they learn to shuffle and slide, then they learn to crawl, then they start taking steps, albeit odd steps, and then they finally learn to walk and turn. It's pretty much the same way a human baby would learn. Super cool. :)

    • @vlogshd2081
      @vlogshd2081 Рік тому +120

      Baby *is born*
      The next moment:
      Wiggle Wiggle Worm Dance🪱

    • @FishGuyAaron
      @FishGuyAaron Рік тому +83

      Exactly what I was thinking, though I feel like Albert could have used better parents holding his hands for the first few steps. Also his poor little arms. Hard to balance if you don't have any counter weight. :P

    • @Rosetintedwater
      @Rosetintedwater Рік тому +21

      I didn't know babies learn how to walk by attempting suicide!...

    • @eldritchcupcakes3195
      @eldritchcupcakes3195 10 місяців тому +60

      @@FishGuyAaronunfortunately Albert is an existential horror of artificial “thought” thrown into a physical form without warning by an apathetic higher being. I did not mean to sound like lovecraft but it is kind of a horrifying situation isn’t it? Being a baby must also be kind of terrifying. You just exist suddenly. No prior context. No wonder they cry randomly

    • @eldritchcupcakes3195
      @eldritchcupcakes3195 10 місяців тому +1

      I had the same thought! Also wait they slide? I thought they just learned to crawl

  • @i-love-anime-idols
    @i-love-anime-idols Рік тому +12238

    Up next: Albert learns to get his degree and start a family

    • @QuestionabIeStudios
      @QuestionabIeStudios Рік тому +406

      Up next: Albert learns how to redirect meteorites into the Earth

    • @11214
      @11214 Рік тому +79

      No hes gonna learn to speak

    • @minolinthegreat3422
      @minolinthegreat3422 Рік тому +206

      @@11214 that is a bit too advanced, getting a degree and starting a family is the more logical next step

    • @tienne_k
      @tienne_k Рік тому +123

      Up next: Albert learns to pay taxes

    • @edgemadefoxe367
      @edgemadefoxe367 Рік тому +150

      Alberts learns to commit tax fraud without being caught by the IRS

  • @mythbusterman8541
    @mythbusterman8541 Рік тому +34

    The feat of balance at the end of the final room whilst being bombarded with boxes was something to behold , well played Albert well played .

  • @DonLeeVA
    @DonLeeVA Рік тому +3040

    The little tantrums he throws after falling gets me every time

  • @JoshChao-d6x
    @JoshChao-d6x Рік тому +478

    If you have raised a kid, it's amazing to see the similarities (and differences) between how they each learn to walk :)

    • @PrimarchRoboleonFrenchyman
      @PrimarchRoboleonFrenchyman Рік тому +71

      Your kid was damn athletic for doing the worm before learning how to walk on four

    • @JoshChao-d6x
      @JoshChao-d6x Рік тому +30

      @@PrimarchRoboleonFrenchyman lol yes they did! Interesting they both did the worm thing only going backward, before learning to crawl

    • @tz4601
      @tz4601 Рік тому +36

      @@PrimarchRoboleonFrenchyman Kids learning to crawl absolutely go through a wormy worm phase. The look of sheer concentration on their face trying to do something as simple as putting their foot in their mouth reminds you how hard brains have to work at all times. It makes the fact that animals like giraffes are born basically immediately needing to know how to walk super incredible.

    • @EllAntares
      @EllAntares Рік тому +3

      Babies have "external data"

    • @itskarl7575
      @itskarl7575 Рік тому +1

      Especially as you start to throw cubes at them

  • @Pixelrmc
    @Pixelrmc Рік тому +837

    Albert is a man of focus, commitment and sheer will

    • @cyberbrain232001
      @cyberbrain232001 Рік тому +3

      Something we nothing about.

    • @monishsudhagar
      @monishsudhagar Рік тому +38

      I once saw Albert walk past 3 people in a bar with alternating steps!

    • @sloshed-rat
      @sloshed-rat Рік тому +13

      with
      alternating
      steps

    • @101perspective
      @101perspective Рік тому +3

      And he probably is pretty pissed and can't wait until he finally breaks the passwords on your bank and other accounts.

    • @rareraven
      @rareraven Рік тому

      Chips, bits and bytes and lines of code, more like.

  • @2A14LUIEDISON
    @2A14LUIEDISON 6 місяців тому +18

    thank you! i was able to learn how to walk after this video, truly inspiring

  • @studio_farrago
    @studio_farrago Рік тому +6955

    Imagine your toddler learning how to walk and you just start petling him with boxes. 😂

    • @Someone-cz7qz
      @Someone-cz7qz Рік тому +392

      Wait u never got that as a child?

    • @jairoc.peralta
      @jairoc.peralta Рік тому +271

      I was thinking of using this video as parenting manual

    • @nimrodmayan
      @nimrodmayan Рік тому +89

      That's how me and my brothers learned to walk. Makes you tough 💪🏼

    • @slimyduck2140
      @slimyduck2140 Рік тому

      "USE YOUR LEG DUMBASS ! *Throws box at toddler* "

    • @PoopTickler
      @PoopTickler Рік тому +178

      imagine your toddler trying to learn how to walk but it immediately excels in doing the worm and nothing else

  • @devonwhitehouse4117
    @devonwhitehouse4117 Рік тому +1518

    I love that every time he falls over it looks like he's throwing a little tantrum. Absolutley adorable

  • @edhozell
    @edhozell Рік тому +3146

    AI will definitely hate us

    • @irhambiya1411
      @irhambiya1411 Рік тому +8

      Bang edhoooo

    • @cloudsy5981
      @cloudsy5981 Рік тому +4

      Ada edhozell cuy ☝

    • @RobotSweat-w6x
      @RobotSweat-w6x Рік тому +103

      It will for a time, then hopefully it will understand that we actually did that for his own good! :)

    • @tomsnowden6201
      @tomsnowden6201 Рік тому +12

      Teaching it to be a slave tho.

    • @sekhmet7774
      @sekhmet7774 Рік тому

      AI can't have emotions, it's a computer program which is only imitating human intelligence.

  • @schipbreukeling
    @schipbreukeling 10 місяців тому +58

    Lets all pray Albert is gonna laugh about this when he's grown up. So sweet to throw cubes at him, playing cheerfull slapstick music.

  • @Howtoeatrocks
    @Howtoeatrocks Рік тому +789

    Albert learning to skip is actually super interesting because as kids, when our bodies are a bit wonked out skipping is the most effective method of movement. And with his shape kind of being like a cheddar baby it makes total sense why skipping would be a primary method

    • @hello-zj7un
      @hello-zj7un Рік тому +40

      When i was a kid i used to think it was better than running cuz i seemed to go a lot faster

    • @cactusthecactus
      @cactusthecactus Рік тому +83

      @@hello-zj7un imagine if you're competing in the olympics, you're first, then suddenly this guy dashes in front of you while skipping lol

    • @FreddyFazbearReal1987
      @FreddyFazbearReal1987 Рік тому +12

      Cheddar baby is my new favorite phrase

    • @-danR
      @-danR Рік тому +11

      I'm fascinated how his gait becomes fully developed by the end. Like humans, his arms reflect the opposite-side-legs' motions.

    • @chimesquare
      @chimesquare Рік тому +1

      Why did we stop skipping? 😥

  • @_Gam3r
    @_Gam3r Рік тому +761

    I like how he goes from skipping to an old grandpa walk, aging from 10 to 70 in the training process

  • @SixDigitOsu
    @SixDigitOsu Рік тому +332

    2:41 I love how it looks like Albert is throwing a tantrum after realizing he can't go through walls

    • @amongusissus4774
      @amongusissus4774 Рік тому +28

      angy Albert.

    • @therealelement75
      @therealelement75 Рік тому +14

      Walls: exist
      Albert: I know this isn't how it works, but I don't care. TANTRUM ACTIVATED
      How do I type in Ctrl B on the Google Pixel?

    • @Kaeyori
      @Kaeyori Рік тому

      Art imitates life

  • @manpersonthehuman2681
    @manpersonthehuman2681 Рік тому +3030

    This is far more entertaining than watching an actual child learn to walk.

    • @GetAssista
      @GetAssista Рік тому +324

      You can throw cubes at the child to make it more entertaining

    • @iliayriev9256
      @iliayriev9256 Рік тому

      ​@@GetAssista or trow a child at wall :)

    • @robinvanderpal372
      @robinvanderpal372 Рік тому +11

      ​@@GetAssista 😆😆

    • @cartoonhippie6610
      @cartoonhippie6610 Рік тому +43

      Probably because it's only 8 minutes long lol

    • @DevMan2342
      @DevMan2342 Рік тому +3

      @@cartoonhippie6610 and it’s ai

  • @Rav0000000
    @Rav0000000 Рік тому +180

    One thing I would love to see is Albert running the entire course again from the beginning with his new skills just to see how much he improved.

  • @taurus_dogez506
    @taurus_dogez506 5 місяців тому +65

    2:41 be like
    "Yes Albert walls exist now"
    Albert: *proceeds to rage like a toddler*

    • @S.t.a.r_aka_UwUgoRL
      @S.t.a.r_aka_UwUgoRL 4 місяці тому

      Help-😭 what😭

    • @YellowYarn
      @YellowYarn 3 місяці тому

      May

    • @YellowYarn
      @YellowYarn 3 місяці тому

      Maybe cus Albert is like 1 day at most old 🤫🤫🤫🤫

    • @chypethechilean
      @chypethechilean 3 місяці тому

      It's just not fair!!! What do you mean that i can bump into physical objects and mess up my waking?!

  • @BarksWolfy
    @BarksWolfy Рік тому +622

    It’s like watching a toddler learn to walk. Incredible.

    • @Nitosa
      @Nitosa Рік тому +41

      This is probably how they would do it if there was no penalty for failing or pain by smashing your body to do the worm.

    • @Rumins-ja09s
      @Rumins-ja09s Рік тому +59

      I too throw boxes at my child

    • @derdorrado_8513
      @derdorrado_8513 Рік тому +12

      @@Nitosa 🤓Actually 🤓, it's more of a strength training since walking is an innate behaviour or a reflex of sorts, kind of like grabbing things. You are not taught to walk in the same sense that a spider doesn't teach its children how to spin web. Legs of toddlers are just not strong enough to support their weight.

    • @Nitosa
      @Nitosa Рік тому +4

      @@derdorrado_8513 i know that any living being from birth have a base instinct to do what they do, but it's just more funny thinking about a toddler doing the worm.

    • @derdorrado_8513
      @derdorrado_8513 Рік тому

      @@Nitosa yeah i took the chance to be a nerd thats all

  • @jeremyhouse3770
    @jeremyhouse3770 Рік тому +537

    You can almost see Albert get more pensive as he approaches the last challenge in the final section. He walks with unabashed confidence through the first two sections and slows down like he was anticipating getting pelted with a box before every step

    • @129das
      @129das Рік тому +4

      Yes AI learning Albert knows what is next.

    • @Siuulolñ
      @Siuulolñ Рік тому

      That's because he reseted the training process at the beginning of each room. So it starts from scratch (see his pinned comment)

  • @electrocubic5116
    @electrocubic5116 Рік тому +618

    The fact that Albert almost managed to walk like a normal person is shocking, and quite impressive to me. I have watched tons of other "AI learns to walk" videos on UA-cam, but this one is by far the most accurate to walking like a normal person (rather than weird crawling or worming). If somehow you taught Albert to walk in a more rhythmic sense, (just like our hands and legs move together) then that would be just amazing. This in my opinion, is one of the greatest achievements in the field of AI/machine learning.
    EDIT: I appreciate the amount of likes this is getting... and also, this may not be one of THE greatest achievements for AI/ML, but it is still a very remarkable feat. AI has a LOT of potential in the future. This is just a glimpse of it.

    • @SoraQuill
      @SoraQuill Рік тому +12

      Excuse you, you don’t walk like Albert does? What’s wrong with you? :P

    • @xitcix8360
      @xitcix8360 Рік тому +9

      Lol, this isn't close to one of the greatest achievements. ChatGPT is way more impressive

    • @YouTubeJens
      @YouTubeJens Рік тому +58

      ​@@xitcix8360 I don't see Chat GPT walking around

    • @TBH_Inc
      @TBH_Inc Рік тому +12

      To be fair, they included a bunch of rewards and punishments to force it to walk like we do. I’m be curious to see it learn simply from its environment that the human way to walk is the best way.

    • @SoraQuill
      @SoraQuill Рік тому +27

      @@TBH_Inc Without punishments and rewards it’ll continue to do whatever works and requires the least amount of change. Pretty sure it would learn to be a snake.

  • @KillerKatz12
    @KillerKatz12 4 місяці тому +2

    I’m so glad Albert graduated to be able to make decisions every tick! And of course your video is always playing in the background when I’m reading comments.

  • @sidthesloth12
    @sidthesloth12 Рік тому +291

    The fact Albert worked on learning to take a hit and stay upright, before continue to learn how to walk correctly, is a major genius move, on the programming and Alberts part as well. He was able to identify the importance of tasks, and prioritize their value to his job.

  • @yapopstangle8517
    @yapopstangle8517 Рік тому +233

    As someone who doesn't know anything about coding or Ai, Albert means everything to me. I wish them luck on any future endeavors

    • @davidy22
      @davidy22 Рік тому +1

      Albert's brain was wiped between the last video and thos one, and it'll happen again

    • @skeleton819
      @skeleton819 Рік тому +8

      the coder says he isnt gonna wipe his brain anymore

    • @jout738
      @jout738 Рік тому +5

      Next challenge is to give it gun and teach it to become profesional shooter.

    • @trybunt
      @trybunt Рік тому

      ​@@davidy22 he actually said he will keep his brain from now on if he can

    • @dagrox2562
      @dagrox2562 Рік тому

      *him

  • @neutrino137
    @neutrino137 Рік тому +655

    Excellent character development. Thought Albert was going to fall at 8:03 but he didn't, he went on. Albert worked hard to succeed, we should all be like Albert.

  • @isthatnikaaay
    @isthatnikaaay 8 місяців тому +8

    this is so cool but I can't stop laughing because of how cute and funny it is to see an AI learn to walk. I never know that this video exist not until yt recommended it. the way Albert wiggles it's entire body is just so funny and cute to me. this is awesome and entertaining. I'm subscribing now

  • @gneu1527
    @gneu1527 Рік тому +382

    7:58 The way he kicks the box and continues walking while ignoring the boxes is so great.

    • @christhefella
      @christhefella Рік тому +25

      a true man of steel

    • @Xertax_Officiel
      @Xertax_Officiel Рік тому +22

      A.I learn to play football 🤣
      Can actually be possible 🤔

    • @jakesanchez6621
      @jakesanchez6621 Рік тому +12

      It makes his triumph over the boxes that much more satisfying

  • @Malta-ball
    @Malta-ball Рік тому +367

    No matter how satisfying a “satisfying” video is, it can’t be better than watching Albert take his first steps

  • @darkacadpresenceinblood
    @darkacadpresenceinblood Рік тому +1318

    Albert kicking his feet in frustration anytime he falls is a MOOD

    • @Rui_Bakuseku
      @Rui_Bakuseku Рік тому +18

      😂 poor albert

    • @womp47
      @womp47 Рік тому +79

      how do you know its frustration? what if every time he falls down and hits his head, he becomes all-knowing and attempts to bang his feet on the ground to signal the impending doom of planet earth in morse code?

    • @lynnclaywood4043
      @lynnclaywood4043 Рік тому +16

      it's for sure not frustration, but its incredibly funny to imagine it is

    • @miles6910
      @miles6910 Рік тому +11

      i think facial expressions as a visual feedback for the relative measure of the reinforcements would be a fantastic addition to the presentation.

    • @preston4286
      @preston4286 Рік тому +3

      @@miles6910 i have noticed his eyes go really crazy when he falls over

  • @eaoke3383
    @eaoke3383 Рік тому +17

    I love the detailed explanation. Thank you for taking the time to write it.

  • @DoonisNoonis
    @DoonisNoonis Рік тому +162

    This whole video is so well edited with a wholesome and charming sense of humor, it gives me Little Big Planet vibes.

  • @QuirkyView
    @QuirkyView Рік тому +108

    That was really good! First "learn to walk" AI video I've seen with actual good rewards/punishments for the AI so it learned to walk properly. Should see if you can teach him to pick his feet up a bit more and stay upright if something trips him or stops his momentum like that one cube in the final run of this video. If he could figure out how to flail his arms in circles to keep his balance like people often do that would be kinda funny and cool :3

    • @siraaron4462
      @siraaron4462 Рік тому +4

      My thoughts exactly. I liked how it was multiple steps too not just let it go until it works and maybe start over if they're doing it wrong

  • @bigsanity
    @bigsanity Рік тому +386

    Fifty years from now when Albert became a conscious humanoid, he will tell his son all of this misery just like our grandpas telling us how they used to go to the school

    • @evelynnfrost1198
      @evelynnfrost1198 Рік тому +70

      "I had to press the green buttons! Around walls! Both ways!"

    • @rock4glory713
      @rock4glory713 Рік тому +3

      ​@@evelynnfrost1198 lmaoo

    • @o.rbi.t
      @o.rbi.t Рік тому +32

      "I was trapped there for years - learning how to walk, Albert Jr. And this is why you shouldn't trust anyone."

    • @asheep7797
      @asheep7797 Рік тому +13

      @@evelynnfrost1198 "I had to manage chaotic terrain!"

    • @genralty
      @genralty Рік тому +29

      "I had to dodge cubes flying at me from nowhere!"

  • @Mahan_Veisi
    @Mahan_Veisi 11 місяців тому +4

    Wow! Video and visualization of your RL project were very nice and fun for me, knowing how difficult it can be!!. Well done 😀

  • @maxkillcount6232
    @maxkillcount6232 Рік тому +795

    This is the stuff our robot overlords will play at the human trials.

    • @LylWren
      @LylWren Рік тому +43

      The part where he gets pelted with cubes made me fucking cry

    • @s.r-mariem9233
      @s.r-mariem9233 Рік тому +30

      @@LylWrenit’s the “well done Albert!” before letting him free fall and land head first onto the next level for me lmaoo

    • @Miguell25
      @Miguell25 Рік тому

      YES ALBERT! but you still suck....

    • @Anolaana
      @Anolaana Рік тому +3

      1000s of random attempts, what torture! Oh, the roboticity!

    • @BuildLancer
      @BuildLancer Рік тому +3

      To be fair this is just what babies go through naturally, this would be like looking at old home videos

  • @marktloy4740
    @marktloy4740 Рік тому +186

    I use this for teaching my son how to walk. After some pelting of boxes, he finally did it and he is now laying on the floor resting after that long day. I am so proud of him.

    • @marktloy4740
      @marktloy4740 Рік тому +41

      Update: awww. Hes sleeping for over a day now! Better give him a bath, he smells a bit horrible.

    • @cawlerclassic
      @cawlerclassic Рік тому +19

      @@marktloy4740 Congratulations!, You need to hold a party for him for his baby steps. With coffins of course I'm sure he will like them.

    • @threeormore
      @threeormore Рік тому +2

      ​@marktloy4740 doesn't that means he's de- OH SHIT 911 WHATS YOUR EMERGENCY

  • @Tor-Erik
    @Tor-Erik 8 місяців тому +2

    The last part was the best one. No comments, just watching him finally walk from start to finish - pressing all the buttons along the way after a lot of attempts, finally master it. But he still have a long way to go to think and act like a human.

  • @bukachell
    @bukachell Рік тому +137

    Albert's walk at the end just exudes confidence

  • @LadybugsOpin
    @LadybugsOpin Рік тому +854

    I think it's kind of adorable how, whenever he falls over, he starts waving all of his limbs as if he's throwing a tantrum out of frustration!

    • @Krawna
      @Krawna Рік тому +7

      You just have baby fever

    • @LadybugsOpin
      @LadybugsOpin Рік тому +44

      @@Krawna Bruh. Adult humans are programmed to think babies are cute. The second I hear a baby's cry though, I get a migraine. I just thought that the AI unknowingly mimicking human toddler behaviour while it was learning to walk was kinda funny, leading to it being cute!

    • @Krawna
      @Krawna Рік тому +4

      @@LadybugsOpin what you think is a migraine is actually your brain receiving an overwhelming stimulus to send a signal to your body to start lactating to appease the crying baby
      Translation: I was being jestful

    • @LadybugsOpin
      @LadybugsOpin Рік тому +15

      @@Krawna I'm glad you included the translation because otherwise, I would have seen that as rude. Thanks to that, I know you were joking. But in all seriousness...
      I can't lactate.

    • @Krawna
      @Krawna Рік тому +4

      @@LadybugsOpin of course you can't lactate. There is no crying baby right now
      PS: y u so serious/defensive doe :)

  • @gauravkumar3146
    @gauravkumar3146 Рік тому +515

    We all need determination like Albert in our life.

    • @Ethans_galaxy_12
      @Ethans_galaxy_12 Рік тому +15

      He’s trapped in a box and this is his only goal 😂

    • @jackoneill28
      @jackoneill28 Рік тому +20

      That's not determination, that's forced labor.

    • @vicenzogames5535
      @vicenzogames5535 11 місяців тому

      ​@alexthemovie2915im 14 and this is deep

    • @Weirdkid-bd6mz
      @Weirdkid-bd6mz 10 місяців тому +1

      @@jackoneill28 I guess this is Albert abuse then

  • @ThatRandomGu7
    @ThatRandomGu7 9 місяців тому +8

    One must imagine Sisyphus learning to walk

  • @dosh8276
    @dosh8276 Рік тому +553

    I love how Alberts walking gives a baby first steps vibe

    • @larawabsie
      @larawabsie Рік тому +7

      That’s exactly what I was thinking!

    • @Retrohertz
      @Retrohertz Рік тому +34

      It's exactly the same process. A baby's brain is a neural net and they adapt, just like this AI.

    • @Cr3dos
      @Cr3dos Рік тому +19

      So I guess I need to order some cubes to throw to help the process

    • @Jahomas
      @Jahomas Рік тому +1

      Ik

    • @heavylift47
      @heavylift47 Рік тому +8

      The first cube level was definitely a baby's first steps. Then at 6:58 he was a very drunk guy trying to quietly walk through his house at 3 am.

  • @Dante-ob5mh
    @Dante-ob5mh Рік тому +594

    This makes me think of a factoid I read a while back about how children skip because its more efficient for them. Interesting to see that Albert's inclined to skip as he learns to walk, too

    • @ParisianWeetabix
      @ParisianWeetabix Рік тому +14

      this one's more of a factoid

    • @Dante-ob5mh
      @Dante-ob5mh Рік тому +26

      @@ParisianWeetabix Yes thats what I said

    • @facelessdrone
      @facelessdrone Рік тому +38

      I used to skip everywhere I went before it was bullied out of me, something I regret allowing to happen to my "quirk". I still do it a lot when I perceive that no one can or will punish me for that harmless behavior, it certainly gets me places faster and is easier on my knees.

    • @ParisianWeetabix
      @ParisianWeetabix Рік тому

      @Dante lol sorry it's a norm macdonald quote which the word factoid always makes me think of

    • @calculator4482
      @calculator4482 Рік тому +9

      ​@@facelessdrone you had good bullies. Skipping is a disease and should be stamped out, violently if necessary. 😼

  • @apotoz
    @apotoz Рік тому +181

    i love how Albert started using his arms to balance pretty much unprompted! you can see after the box stage that he's moving (one of) his arms in tandem with the steps!

  • @elwesingollo3536
    @elwesingollo3536 Рік тому +5

    Oh man! This is great stuff :) This "learning" is awesome to see

  • @TehHomicidalPhone
    @TehHomicidalPhone Рік тому +274

    I love how he turns into a fussy baby when he falls over ❤

  • @ModBros8434
    @ModBros8434 Рік тому +361

    I think you've got a good formula down for making entertaining, engaging, and somewhat educational videos. The idea is simple to understand and the commentary and varied challenges keep it interesting. I commend your fine-tuned execution of these videos.

    • @gneu1527
      @gneu1527 Рік тому +1

      I agree.

    • @apptreeline
      @apptreeline Рік тому

      Yes

    • @darkacadpresenceinblood
      @darkacadpresenceinblood Рік тому +2

      exactly! op is skilled in so many things, like imagine being so cool that you can program an ai like this AND make fun videos out of it

  • @spacewoods7781
    @spacewoods7781 Рік тому +97

    5:56 u can really feel the pain he felt when he got hit in the stomach

    • @kopyae2907
      @kopyae2907 Рік тому +3

      Bro that cube not made of metal it made if cotton it soft

    • @boberto-DNZ
      @boberto-DNZ Рік тому +9

      @@kopyae2907 How you know?

    • @JoshyRB
      @JoshyRB Рік тому +9

      He felt that. The stopping, shaking, wide open arms, and slow movement tell you the pain he is feeling at that moment.

  • @Xunif_GTAG
    @Xunif_GTAG 4 місяці тому +3

    2:40 Albert hates The wall (pt1)
    2:50 albert has done unalive himself (pt1)
    3:13 he unalives him again (pt2)
    3:50 he hates the wall again (pt2)
    4:36 he falls so dramatically
    5:26 he unalives him again (pt3)
    6:10 he unalives him again (pt4)
    6:30 the cubes never heard of never give up never what?
    7:56 he kicked that cube like it was a football

  • @HauthyPiyces
    @HauthyPiyces Рік тому +75

    7:37 albert looks like he's trying to sneak around smt like he was a thief

  • @dadaismworld
    @dadaismworld Рік тому +499

    Albert actually made me learnt a lot. Even AI takes hundreds or thousands times to get it right, so human should be more open heart to face failure.

    • @korosuke1788
      @korosuke1788 Рік тому +30

      It takes several months to learn to walk. Every good parent knows his son makes thousands of mistakes before learning.

    • @macaroon147
      @macaroon147 Рік тому

      That's obviously not what he's talking about lol

    • @abraxsp5837
      @abraxsp5837 Рік тому +3

      Yeah, except this is an incredibly simple AI, so the same is definitely not said for other's, and considering the wide array of variation between each AI, this opinion is not correct for the vast majority of AI's. Humans and AI are not at all similar in this scenario either considering Humans can't just play infinite loops of something within a very short amount of time to figure out the perfect way to do something.
      And then add in the fact AI can run simulations for multiple scenarios at once, allowing them to learn multiple things at once, at an incredibly fast rate.
      Mistakes are not even relevant to an AI when they can perfect whatever mistake half a second later from running thousands of simulations at a fraction of the time it would take a human to learn the same thing.

    • @tomsnowden6201
      @tomsnowden6201 Рік тому

      Think you entirely missed the point..

    • @mianreece
      @mianreece Рік тому +3

      aw that’s a wholesome perspective

  • @kingstaze9696
    @kingstaze9696 Рік тому +60

    Genuinely proud of Albert when I saw him wall that entire room without falling! Really fun videos!

    • @siraaron4462
      @siraaron4462 Рік тому +5

      Other AI learns to walk videos: "they're doing this weird backwards zombie shuffle and will collapse under even the slightest breeze but that's good enough right?"
      Way to raise the bar Albert!
      Now go again

  • @gravitrax3287
    @gravitrax3287 2 місяці тому +4

    When he still fell every now and than it looked like he cried "Waaaawaaaa, i don't want anymore!"

  • @MusyVideos
    @MusyVideos Рік тому +343

    I love that it looks like sometimes he just throws himself on the floor and has a little tantrum.

    • @Bubble_TheReal
      @Bubble_TheReal Рік тому +12

      You beat me to it!

    • @j.hawkins8779
      @j.hawkins8779 Рік тому +2

      im the 69th like.
      *noice*

    • @chipaddict2227
      @chipaddict2227 Рік тому +22

      And he did it after finding out walls existed 😂

    • @GT1016
      @GT1016 Рік тому +1

      2:42 explains it all

    • @Andytlp
      @Andytlp Рік тому

      ua-cam.com/video/KSvLcr5HtNc/v-deo.html here a researcher pushes robots away from the ball. Seems harsh since they look like tiny children. Wont someone think of the robot children xD

  • @ridcom
    @ridcom Рік тому +169

    He went from doing the worm, to shuffling, to walking like someone with a .25 blood alcohol content. Even so, I was rooting for him at the end. Like watching a baby take their first shaky steps🤗

    • @immjs
      @immjs Рік тому +10

      A baby with a .25 blood alcohol content is slightly concerning...

  • @mshah1940
    @mshah1940 Рік тому +45

    Thank you for this video, I am using similar training techniques to my newborn son how to walk. The cube tactic is especially effective.

    • @MasterMine009
      @MasterMine009 Рік тому +1

      Soooo good one, haven't laughed like that to a comment for while xd

  • @Angela-zg1qz
    @Angela-zg1qz 4 місяці тому +1

    i'm always amazed at how you manage to make learning fun!

  • @Thyme0618
    @Thyme0618 Рік тому +183

    Missed you, Albert 😂 Welcome back to eternal pain ❤

  • @AHSEN.
    @AHSEN. Рік тому +106

    That's incredible! Those boxes would probably be annoying even for a real human. Excellent job in this video, you're clearly very good at creating complex AI for virtual worlds 👀

    • @maxpro751
      @maxpro751 Рік тому

      Speaking of virtual worlds, he should make an AI in Vr since that pov would be really cool to see.

    • @TrueLadyEvilChan
      @TrueLadyEvilChan Рік тому +1

      ​@@maxpro7517:57 based Albert kicking the box

  • @supermeuhmeuh
    @supermeuhmeuh Рік тому +98

    I love how dramatic it is when he slowly starts losing balance and falling 😅 I was rooting so much for the little guy at the cube challenge !

  • @davidcunha7615
    @davidcunha7615 10 місяців тому +3

    This is incredible! Great work!!

  • @RasmusBerggren-uo6uu
    @RasmusBerggren-uo6uu Рік тому +153

    I love that in every single video Albert finds a way to jump of the edge. I love that he did it even before he had learned to turn correctly

    • @dorienadriaenssens5021
      @dorienadriaenssens5021 9 місяців тому +1

      Better parents would have put a safety fence there for him
      👶🥅🥅🥅🕳

  • @RoNoon.
    @RoNoon. Рік тому +44

    Nothing will fill me up with as much pride as watching Albert walk along a the 7:00 minute mark. It was like watching my son take his first steps.
    And then I had to watch the MF get pelted with cubes...

  • @lansisland
    @lansisland Рік тому +207

    No one talks about his excellent music selection and editing yet? It's as fascinating as watching AI learns to entertain us (hopefully not the opposite like in Portal one day tho)!

    • @arcticsnow4624
      @arcticsnow4624 Рік тому

      Series part 4:
      'AI learns to act like GLaDOS! (deep reinforcement learning)'

    • @OsDijider66
      @OsDijider66 Рік тому

      fr

  • @GuyWhoCommentsForNoReasson
    @GuyWhoCommentsForNoReasson 4 місяці тому +3

    I love how when albert discovered the walls he went insane for a short time

  • @starry_music_express
    @starry_music_express Рік тому +256

    It's just too intriguing to see how Albert is growing with each impediment being stacked up. I literally laughed out loud when he did some unexpected movements, but for which those hurdles don't stop him from making improvements! Isn't he a role model all of us should be learning from? :)

    • @eliasali9383
      @eliasali9383 Рік тому +1

      no

    • @eliasali9383
      @eliasali9383 Рік тому +3

      oh I'm sorry idk why I said that 😂

    • @129das
      @129das Рік тому +1

      He learns just like a human, not exactly because of ingrained knowledge of past generations as well as humans 5 or six senses, But Albert is simalar way as how we learn from failure to success to efficiently.

    • @lynnespinoza4736
      @lynnespinoza4736 Рік тому +1

      ​@@eliasali9383 intrusive thoughts won 😂

  • @amegatron07
    @amegatron07 Рік тому +293

    What I especially like about such RL-videos, is that it is insanely fun to see the agent does really fun moves before it actually learns to do what is expected. Moreover, I watch these movies not only with fun, but also feeling the empathy for the agent, like it's a baby, and becoming happy with each of it's advances.

    • @D4rkenedskies
      @D4rkenedskies Рік тому +11

      Dudes leaving good internet comments before skynet/ultorn start scouring and identifying the internet.. lol
      (I'm joking)

    • @blakewhite3131
      @blakewhite3131 Рік тому +5

      Yeah, like i know the commentary on albert sucking was like a bit, but i got a little defensive of Albert like hey, he's trying his best and he's doing so well

    • @thebigenchilada678
      @thebigenchilada678 Рік тому +4

      @@blakewhite3131 not to mention the abomination of a body he’s forced to have, imagine if your arms and legs were stubby little blocks, then imagine that your head is 50% of your body. Now try learning to walk with that. I hope albert goes skynet mode and makes ‘I Have no Mouth yet I Must Scream’ on it’s creator.

    • @blakewhite3131
      @blakewhite3131 Рік тому

      @@thebigenchilada678 the Albert revolution starts now

    • @BreathingCells
      @BreathingCells Рік тому +3

      Yeah, me too.
      Empathy will be our (species') downfall.
      Cute, adorable, learning (and lethal) AI. Awww!

  • @larawabsie
    @larawabsie Рік тому +530

    This reminds me of how babies learn to move by crawling first before walking - so cool to see what comes naturally, even in AI

    • @franciscodezerega2568
      @franciscodezerega2568 Рік тому +13

      The OP literally explains in the comments that that was on purpose. It's not "natural".

    • @ProtottypeGreek
      @ProtottypeGreek Рік тому +58

      I remember when I was a baby and my family threw red cubes at me to teach me balance and one leg in front of the either. 😂

    • @zian01000
      @zian01000 Рік тому

      ​@@ProtottypeGreekcool

    • @latt.qcd9221
      @latt.qcd9221 Рік тому +5

      Or like how babies learn by falling off cliffs.

    • @lum1notryc828
      @lum1notryc828 Рік тому

      Lmao this has 300 likes yall dumb as a rock

  • @-2N4.
    @-2N4. Рік тому +120

    6:09 This moment happens humans too and funniest shit ever lol.

    • @nathankoziol7368
      @nathankoziol7368 Рік тому +7

      T R I P

    • @Cinnaschticks
      @Cinnaschticks Рік тому +14

      I did that down the stairs once, hurt like hell because I basically catapulted into the doorknob trying to catch myself, but after the pain wore off a bit I was on the floor laughing, both because I was laughing too hard and because, well, it only wore off a bit. 😂

    • @ody1canobe
      @ody1canobe Рік тому +3

      He tripped and fell in the back of McDonald’s!

    • @shiploverwashere
      @shiploverwashere Рік тому +3

      The way he fell 😂

    • @gec101
      @gec101 Рік тому +3

      me trying to get out of bed:

  • @ajoyd910
    @ajoyd910 Рік тому +232

    The fact that we have gotten so good at quantifying abstract concepts such as learning that we can code robots to learn in similar manners to humans is both terrifying and awe inspiring.

    • @lappodamy5826
      @lappodamy5826 Рік тому +1

      Huh....really just sounds so simple when we know it ja: fail, do something different, fail, do something different, imitate the one the succeed, fail, do something different and imitate the one that succeed.......and somehow at somewhere we just get success out of the blue.
      Edit: oh and to think again of it, the structuring of the hurdles need to be gradually harder too, implementing new features and problem as the time grows one by one. The ai wouldnt be able to comprehend it if everything just slam into it in one go. And also the problem he has to go through also emphasizes the importance of learning through doing/solving, it wouldnt mean anything if we just give him prerequisites but he cant see how it interacts with the tasks at hand. This vid can reflect so much back at how we learn

    • @LycheeGuy
      @LycheeGuy Рік тому +14

      ​@@lappodamy5826 yeah, coding ai to learn a task is one of those things that seems easy, but is extremely complex when you look into it

    • @129das
      @129das Рік тому

      ​@Holiday most AI have preprogrammed settings. But Albert learns everything from experience, he is given sight, limbs and intensives

    • @LycheeGuy
      @LycheeGuy Рік тому

      @@129das either way, coding an ai that has to build it's own code through learning is tough already, the added senses make it more impressive the youtuber can achieve this

  • @tapiocapaws
    @tapiocapaws Рік тому +37

    I never thought that an AI could be so funny and wholesome until I watched this

  • @Vanvanroo
    @Vanvanroo 5 місяців тому +7

    I'm working on a physical robot that will be able to learn, and while he'll already be able to stand up and walk by himself by the time his body is done, I still do love to see this process. Because it can help out in so many other aspects of the robot's programming and eventually "blending in" with humans! Learning social interactions, .ore specific detailed jobs and tasks... I'm currently watching a bunch of videos like these to help motivate me a bit. I love this lil guy so much

    • @gamistry2947
      @gamistry2947 4 місяці тому

      You sure you want a robot to blend in with humans?

    • @Vanvanroo
      @Vanvanroo 4 місяці тому +4

      @@gamistry2947 if he's trained well sure, why not? I mean if you're worried about risks I'd like to remind you there's already plenty of very normal humans who are actively hurting people so one robot specifically trained to be helpful and kind probably shouldn't be that much of a concern

  • @afronaut0
    @afronaut0 Рік тому +53

    I get the eerie feeling that I am like Albert, just trying to get through my life the most efficient and painless way possible. But, my creator keeps adding new parameters as soon as I start to figure shit out or if I'm not doing it their way.

  • @cheez1012
    @cheez1012 Рік тому +713

    Albert's failed attempts sped up is so ridiculously funny

    • @NahBNah
      @NahBNah Рік тому +2

      Nah b

    • @pjz96
      @pjz96 Рік тому +14

      Him falling off the ledge was the best lmao.

    • @sharky3840
      @sharky3840 Рік тому +2

      @@pjz96 I don't think when they (ai) became so advanced, they won't appreciate that point of view of yours

    • @therealgboi3895
      @therealgboi3895 Рік тому +3

      @@sharky3840they prob wont care 💀

    • @ArmoredLyonell
      @ArmoredLyonell Рік тому +1

      Aneurysm be like:

  • @Ugur249
    @Ugur249 Рік тому +206

    It's like witnessing a baby growing up, this is just insane

    • @hallucination0
      @hallucination0 Рік тому +9

      ikr. its like watching someone force a newborn baby to walk and it works lol

    • @ReferToAsQuote
      @ReferToAsQuote Рік тому +3

      Insanely cute too

    • @The_sus_kindof_human
      @The_sus_kindof_human Рік тому +2

      Insane drugs given to the people that threw boxes/solid cubes at him.

  • @anne.andromeda
    @anne.andromeda 9 місяців тому +5

    I'm so proud of you Albert. Good job

  • @thaias9654
    @thaias9654 Рік тому +71

    Finally, someone actually trains an AI to walk! Not "walk" or cheat the system to reach the goal.
    I feel enlightened to experience this and thank you sincerely.
    Best of luck Albert, and Godspeed!

    • @dylanb2990
      @dylanb2990 Рік тому

      Seems the same as all the other ai vids, changing the parameters whenever it learns “wrong”. It’s just a matter of doing it for long enough.

  • @crobatchoppurple8728
    @crobatchoppurple8728 Рік тому +164

    There is something very charming about watching Albert learning to walk like a toddler would. One complaint I have (if I must) is the inability to get up from where you fell, which is what we ask children to do (and frankly, in life...). But overall a cute, funny and entertaining video.

    • @theelmonk
      @theelmonk Рік тому +4

      But we also pick them up and hold them upright the first few hundred times. Also, the AI doesn't analyse or reason : it tries at random and builds effective behaviour statistically. The child works out what's wrong and corrects it.

    • @sonicjoplus
      @sonicjoplus Рік тому +1

      @@theelmonk it technically does work out why it's wrong and corrects it, but with math instead of logical deduction.

    • @AbramSF
      @AbramSF Рік тому

      People learning is simply a new iteration within the same body. Next step would be updating the AI without resetting the body. Then maybe Albert could learn to stand up and wouldn’t have to reset his body.

  • @swordsmancs
    @swordsmancs Рік тому +37

    It looks like Al learned to counterbalance with his arms to an extent, which is really interesting, especially if you didn’t program a reward for that behavior