DeepMind’s New AI: 10 Years of Learning In Seconds!

Поділитися
Вставка
  • Опубліковано 16 чер 2024
  • ❤️ Check out Weights & Biases and sign up for a free demo here: wandb.com/papers
    📝 The paper "Human-Timescale Adaptation in an Open-Ended Task Space" is available here:
    sites.google.com/view/adaptiv...
    My latest paper on simulations that look almost like reality is available for free here:
    rdcu.be/cWPfD
    Or this is the orig. Nature Physics link with clickable citations:
    www.nature.com/articles/s4156...
    🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
    Aleksandr Mashrabov, Alex Balfanz, Alex Haro, Andrew Melnychuk, Benji Rabhan, Bryan Learn, B Shang, Christian Ahlin, Edward Unthank, Eric Martel, Geronimo Moralez, Gordon Child, Jace O'Brien, Jack Lukic, John Le, Jonas, Jonathan, Kenneth Davis, Klaus Busse, Kyle Davis, Lorin Atzberger, Lukas Biewald, Matthew Allen Fisher, Matthew Valle, Michael Albrecht, Michael Tedder, Nevin Spoljaric, Nikhil Velpanur, Owen Campbell-Moore, Owen Skarpness, Rajarshi Nigam, Ramsey Elbasheer, Richard Sundvall, Steef, Taras Bobrovytsky, Ted Johnson, Thomas Krcmar, Timothy Sum Hon Mun, Torsten Reil, Tybie Fitzhugh, Ueli Gallizzi.
    If you wish to appear here or pick up other perks, click here: / twominutepapers
    Thumbnail background design: Felícia Zsolnai-Fehér - felicia.hu
    Károly Zsolnai-Fehér's links:
    Twitter: / twominutepapers
    Web: cg.tuwien.ac.at/~zsolnai/
  • Наука та технологія

КОМЕНТАРІ • 336

  • @Ken1171Designs
    @Ken1171Designs Рік тому +217

    I have a long history of creating puzzle web games, so this video was especially rewarding to watch for me. Really awesome and inspiring. Made my day! :D

  • @StrandedKnight84
    @StrandedKnight84 Рік тому +485

    What was not mentioned in the commentary is that this model was pretrained on a number of similar type tasks. The pretrained model is then capable of few-shot learning new tasks it hasn't seen before.

    • @nathanielbartholomew5091
      @nathanielbartholomew5091 Рік тому +87

      thank you, I was wondering how the AI new that the objects interacted in the first place

    • @deep.space.12
      @deep.space.12 Рік тому +65

      Step (1) in the abstract 0:01 already mentioned "meta-reinforcement learning", pretty much a pretraining step as you said. Funny how Károly always omit crucial steps to make the research sounds more awesome than it (already) is.

    • @nathanielbartholomew5091
      @nathanielbartholomew5091 Рік тому +17

      @@deep.space.12 give him a break, he is just trying to engage people in educational content. If the papers are, as you said, "already" awesome, then omitting something that to you wouldn't change the awesomeness of the paper, but for someone less academically inclined would make the paper seem boring... i think that its worth omitting. At least for a youtube video, its not like you can't just read the paper yourself!

    • @deep.space.12
      @deep.space.12 Рік тому +48

      @@nathanielbartholomew5091 It's quite understandable to make an occasional omission to facilitate communication or by pure accident. But it's been a trend for him to misrepresent results and credit the wrong researchers for views. It's appalling, frankly.

    • @nathanielbartholomew5091
      @nathanielbartholomew5091 Рік тому

      @@deep.space.12 well shit man… I thought he wasn’t scummy. Am I wrong? I really don’t want to believe you, but I’m pretty used to being failed by public figures haha. So what you’re telling me (and correct me if I’m wrong) is that “Two Minute Papers” purposefully omits and/or twists the information to mislead people for the benefit of his UA-cam channel to get more views and make more money and his transgressions can’t be seen in any way as a wilfully ignorant AI enthusiast trying to share developments in important fields.

  • @JorgetePanete
    @JorgetePanete Рік тому +141

    "research two more papers down the line; full video 4k; hdr; unreal engine; realistic; accurate; inspiring"

  • @bujin5455
    @bujin5455 Рік тому +423

    I wish more commentary was provided on this one. It seems like this was likely a fundamental breakthrough that's going to utterly revolutionize dataset size requirements and compute resources required to train NNs.

    • @philh4820
      @philh4820 Рік тому +79

      I cant really believe it. There had to be more than 5 tries for learning something like this

    • @msytdc1577
      @msytdc1577 Рік тому +170

      Yep, felt like a narration of the video clips instead of any sort of explanation of how this method was different or innovative, or how it was accomplishing the speed up in training, no insight or analysis, just a "wow, amazing!" react video that could have been made by a vtuber. A rare L on this channel.

    • @loneIyboy15
      @loneIyboy15 Рік тому +19

      @@msytdc1577 In fairness, any explanation of these would amount to 10 minutes of noise indistinguishable from "They did a thing with the thing before, but now they did this other thing and it's better!"

    • @Dragonblood94
      @Dragonblood94 Рік тому +45

      There has to have happend a training process beforehand, where it learned how to play these sort of games. During the game its not so much learning as it is reacting to a changed environment.

    • @msytdc1577
      @msytdc1577 Рік тому +38

      @@loneIyboy15 depends on who these videos are targeted towards, I recall watching a video on this channel that was long, detailed, and had a good breakdown of the paper, how things worked, how it compared to previous techniques, what it was still not fully successful at, etc., a solid video in line with most of the other videos on the channel made thus far.
      Then I watched a different shorter video on this channel released a month or two later that gave me deja vu watching it, but it was more like this one, just showing some examples and saying it was amazing, but completely surface level and to me not really interesting.
      Turns out the deja vu was because both videos were about the exact same paper! The first long one would probably have been "boring" and too technical for the masses and garner fewer views, and the "dumbed down" one was something a hundred channels could have produced, but likely would have been financially more successful and popular for this channel. Positively it would also have been a better introduction to what can be a complicated topic than the information dense version, and at least when produced by this channel even a surface level video is likely to highlight the important parts and not get something horrendously wrong, which is more than you could guarantee the other 99 channels would manage, if they even cared to make the effort.
      So, like most things, it's a trade off. Channel produces only high level videos, small audience, low revenue, fewer people exposed to the wonders of current advancement; produce only superficial react videos and the channel loses the special unique attributes that have historically set it apart from less knowledgeable content creators, and provides little reason for the initial audience who subscribed for that more advanced insight to keep coming back.

  • @cogoid
    @cogoid Рік тому +131

    It is a VERY cool paper, but DeepMind still trains this agent on 25 Billion games of this general type first (5 weeks on 64 TPUv3), before the model becomes "smart" as we see here, and able to generalize to new variants of the same kind of game as rapidly as a human would. Great result, but much more work is required to make this more general purpose.

    • @MikkoRantalainen
      @MikkoRantalainen Рік тому +8

      To see how general it is, the actual task would need to be something like play tetris with the available blocks in the room, using the pre-training that it currently had.

    • @AirNeat
      @AirNeat Рік тому +3

      Humans are also pretrained on 20 years of similar experiences.

    • @squamish4244
      @squamish4244 11 місяців тому

      Something that would have blown us away 2 years ago is now 'okay, I guess'. "Much more work" also means, what, two more whole years?

  • @HoD999x
    @HoD999x Рік тому +117

    how did the AI know about geometry, possible actions and that combining objects is necessary to solve the task? it couldn't have guessed that. i mean, the solution could have been anything (for example "trace all walls" or "touch al tiles")
    it must have had some knowledge before the game started

    • @nraw_
      @nraw_ Рік тому +41

      I was thinking the same. It feels like this video was more about enjoying what the ai is doing rather than explaining the functioning of it. While admirable, it doesn't help me reason about how great of an achievement this is nor how transferable any of it is.

    • @marvinkunz843
      @marvinkunz843 Рік тому +11

      Yeah, I agree with you. I think the search space is already heavily confined. Not comparable with a real life scenario or a real escape room.
      Still impressive though!

    • @Peter-ik9fz
      @Peter-ik9fz Рік тому +18

      It was pretrained on 200 million and 25 billion similar tasks which is missing from the video.

    • @MikkoRantalainen
      @MikkoRantalainen Рік тому +8

      @@Peter-ik9fz So the actual task was figuring out which objects to interact with, not to learn how to move in the world or how to push or grab the objects. Still, great work with very little repeation to make a correct guess from very little data.

  • @sebastiangeschonke9756
    @sebastiangeschonke9756 Рік тому +13

    I would argue that this type of learning is more specific and therefore less complex than learning to move and fight with multiple limbs.

  • @davidm2.johnston684
    @davidm2.johnston684 Рік тому +14

    I would love it if you could explain the key principles as to how these papers achieve their results! That would make your videos twice more interesting than they already are if you ask me!

  • @Vini-BR
    @Vini-BR Рік тому +48

    It'll be revolutionary when minimal shot learning is applied for everything!

    • @gavaldor
      @gavaldor Рік тому +21

      I don't really want to talk the achievement down, what they made is still pretty amazing, but since the video fails to do so it feels like I have to set it a bit in perspective. The AI was pretrained on a more generalized version of the puzzle, so it became an expert in the domain, and the only "ad hoc learning" it had to do was figuring out what the concrete problem was it was dealing with this iteration.
      Putting it into perspective of what the equaivalent human thing would be ... its like giving a math expert (who trained math for years) a specific math problem to solve and of course he's going to figure it out quickly if he has seen this kind of problem before lots and lots of times. Or someone who is trained as an expert at reparing computers ... he has to figure out what concretely is broken with a computer he is given.
      So this AI basically was trained as being an expert of figuring out what the hidden rules are in this game world, to achieve their goal. Thats no small achievement but its totally unrelated to how the video presents it, and it doesn't feel as revolutionary as its hyped up to be, of course if an AI is trained to be an expert in a whole domain it will solve individual problems of that domain very well. I'm disappointed in the video giving no context at all.

    • @applmango
      @applmango Рік тому +3

      @@gavaldor it is true that the video could have provided more information. But, it's still useful this way because you could just train a dozen ai models in somewhat niche categories and then quickly train them for specific applications.

    • @coolorphans
      @coolorphans Рік тому +1

      That's an overstatement. Minimal shot learning has its place, but it's not a revolutionary solution for everything. There are still many challenges and limitations that need to be addressed before it can be applied effectively to a wide range of tasks.

    • @Vini-BR
      @Vini-BR Рік тому

      @@gavaldor Thanks for your insightful remarks!

    • @marwin4348
      @marwin4348 Рік тому

      @@gavaldor Unfortunately Google is very good at marketing, most of their archievements are not what they claim. I learned that when they showed their Dota2 AI, and as someone that understands that game, I immediately became dissillusioned by Deepmind, they claimed their AI learned to play DOtA, but their presentation was just one big fraud, their AI did not learn to play the game at all, they alterted the game a ton, had many restrictions(like no fog of war, their AI always had to know everyone position) It did not even come remotely close to playing the game like humans would, but they marketed it as if it could.

  • @jackb3493
    @jackb3493 Рік тому +47

    These next tests require cooperation. Consequently, they have never been solved by a human. That's where you come in. You don't know pride; you don't know fear. You don't know anything. You'll be perfect. - some dude with combustible lemons

    • @NotASpyReally
      @NotASpyReally Рік тому +1

      Atlas and PBody in real life be like "Beep boop"

    • @FuzzyJeffTheory
      @FuzzyJeffTheory Рік тому +3

      DeepMind should train a model to play Portal 2 co-op mode. That would be sick

    • @jackb3493
      @jackb3493 Рік тому +2

      @@NotASpyReally everyday we stray further from god.... and further toward *_ApErtUre SCieNce_*

    • @tyler.walker
      @tyler.walker Рік тому +1

      @@jackb3493 That's the prime place to be.

  • @nixel1324
    @nixel1324 Рік тому +19

    It would be interesting to put an AI like this through Portal 2 co-op. In fact, it almost seems too perfect, given the themes and aesthetics!

    • @JT-hg7mj
      @JT-hg7mj Рік тому +1

      They should but it will fail. The ai is pretrained on similar games, it probably does not generalize that much.

    • @nixel1324
      @nixel1324 Рік тому +1

      @@JT-hg7mj Mayb if they pre-train it on P2 first. There's no shortage of community created test chambers, workshop support and all that.

    • @JT-hg7mj
      @JT-hg7mj Рік тому +1

      @@nixel1324 that would probably work, but it shows that this ai does not really generalize.

  • @DeSinc
    @DeSinc Рік тому +2

    Aw it's so cute when it holds the cube up in the air and jitters around like it's happy
    Can't wait for AI like this to show up in games and show real growth and simulated 'personality' in a sense

  • @pathaleyguitar9763
    @pathaleyguitar9763 Рік тому +6

    This is the first time where I've seen an ai solve these games faster than I would. Substantially faster. And that's sorta terrifying...

  • @Travestyalpha
    @Travestyalpha Рік тому +25

    I always look forward to your videos. Staying on the frontier of machine learning. Exciting time we live in. Exciting time.

  • @yieldcrowd6757
    @yieldcrowd6757 Рік тому +1

    This is general intelligence. It was trained to learn how to learn. Now it uses realtime observation of its environment plus its accrued realtime past memories to solve problems. This is the beginning of the end. Scale this up and you can replace all employees. This algo and anything similar are going to be the most important inventions ever created by humans. I'm a AI scientist, and have been working on this basic concept for the last few years. These guys nailed it. Can't believe how well it worked, would love to see it scaled across more domains and problems.

  • @AHSEN.
    @AHSEN. Рік тому +2

    This is mind blowing progress. Wow!

  • @JakeVermont19
    @JakeVermont19 Рік тому +4

    Hi, although most of the viewers won't understand much it would be cool if you could explain some things about the architecture of the A.I. You could also do that in a separate video.

  • @TheAkdzyn
    @TheAkdzyn Рік тому +6

    Thanks again for making these videos. It's incredibly tough to keep up with AI as there's so many different ones coming out all the time. Your format is great because, despite being concise, it offers plenty of information. Very insightful!

  • @kennethbeal
    @kennethbeal Рік тому +6

    Thank you! About halfway through it struck me, one of my earlier jobs an executive had a sign on his door: "Life is the only game in which the goal is to learn the rules." Such a great example of this quote from decades ago. Really neat explorations, thank you again!

  • @natasha6867
    @natasha6867 Рік тому +9

    im a layman on this subject, but i'm wondering if it's legit to compare the years learning model to this seconds learning? even though there arent intermediary rewards, this still seems much more simple than learning how to move a body with many moving parts and then learning football or fighting.

    • @MK-fg8hi
      @MK-fg8hi Рік тому

      You are right, this won't be a fair comparison per se: the task of learning football is more difficult, and, if we read the paper, we will note that the model presented in this video was first trained on a large amount of similar games. So, what we see here is the ability of AI to figure new rules for a game that is somewhat similar to the previous one
      However, I'd say that the difference in the amount of data needed for learning a task is so huge that it is indeed impressive, and the casual comparison is totally understandable =)

  • @Rubiktron
    @Rubiktron Рік тому +1

    I love this kind of AI way more than the "blank canvas" kind of AI, which starts not even knowing how to move or even the fact that it can do so.
    As a psychology student one learns that animals dont come to the world as a completely blank canvas but quite the opposite in fact, with many basic patterns of behavior hard coded into our brains by default.
    By giving an AI some basic structure one would expect to get a more realistic result and even new non pre-coded behavior that resembles that which one would expect to happen in a real organism.
    Thank you so much for your videos, they are absolutely priceless!

  • @zaidlacksalastname4905
    @zaidlacksalastname4905 Рік тому +1

    We finally got there. This is what comes two papers down the line. Amazing

    • @samybean9962
      @samybean9962 Рік тому

      Yeah, it really sounds amazing (which it is, but not as much as what this video makes it look it is) but they were trained on a looot of these types of games beforehand. What you see in the video is the AI figuring out what the hidden rules are. Not the game itself.

  • @felipefairbanks
    @felipefairbanks Рік тому +3

    this will be amazing for costumer level AI to learn to do some special routine the user wants it to do for him. learning fast like that it wouldn't be too much trouble to teach it.

  • @technorazor976
    @technorazor976 Рік тому +3

    This is very cool to watch, now I want to see a couple AIs play Portal 2 together!

  • @maxwellaiello
    @maxwellaiello Рік тому +6

    My guess is a test play ai could be on the horizon. AI’s could be able to play through entire games soon

    • @ayoCC
      @ayoCC Рік тому

      Bug testing AI woahhh

  • @emigrek
    @emigrek Рік тому +6

    Seeing AI performing such tests reminds me of Portal games

  • @Bo-kq8tn
    @Bo-kq8tn Рік тому +1

    woah, this is going to completely change making TAS's and glitch hunting for video game speedruns!

  • @blazednlovinit
    @blazednlovinit Рік тому +1

    Imagine the AI going through thousands of years of trial and error just for your amusement, "I have no mouth and I must scream"

  • @thegreenxeno9430
    @thegreenxeno9430 Рік тому +2

    I declare today that video games are no longer about who can do a thing the fastest, but rather who can do something unexpected. Playing the matchmaker in a small town of NPCs, competing in poetry contests, art will become(stay?) the most compelling aspect of games.

    • @geli95us
      @geli95us Рік тому

      You're basically ignoring more than half of all videogame genres in making that claim, how is a platformer game about the art? action, fps, roguelike, there are lots of genres where the art is secondary at best

  • @me0101001000
    @me0101001000 Рік тому

    My background revolves around physics, chemistry, and engineering. This could be huge for simulation studies to help inform better designed experiments. This could save us loads of time, energy, and valuable resources!

  • @StickerWyck
    @StickerWyck Рік тому +1

    Crazy things are gonna happen when we have AI making discoveries, innovating and inventing with brutal, mechanized efficiency. The speed at which the world will start changing will be completely unprecedented. In fact, you could probably consider all of human history before that date as "the before times".

  • @francogiannoni95
    @francogiannoni95 Рік тому +8

    What does this mean in the long term? Are we getting these kinds of results in other real-world problems soon? This is amazing.

    • @SW-fh7he
      @SW-fh7he Рік тому +1

      Yes

    • @pfos
      @pfos Рік тому

      if i wuz these ai characters, i'd be pissed about someone messing with me everytime i figured it out . . .
      you have to sleep sometime - buahhahahaHA =P

    • @samybean9962
      @samybean9962 Рік тому

      They were trained on a loooot of these types of games beforehand. What is impressive is that they can figure out the hidden rules quickly, but saying they didn't have any training is just wrong.
      How is it even possible without knowledge or training to just guess from some pixels that they can be interpreted as a 3d system and that you have to move to and grab specific colored objects?

  • @spazneria
    @spazneria Рік тому +4

    Wait a second, I'm having a hard time processing this. Did we really just watch the training process in real time? Did this thing really solve those levels that quickly? That is absolutely insane. If I interpreted this video correctly then this is astonishing.

    • @ShidaPenns
      @ShidaPenns Рік тому +1

      It was pre-trained, if you look at other comments. A lot of pre-training, on other and similar tasks. So it already knew that it was supposed to interact by touching the objects together.
      But, that pre-training can be done very quickly, in our relative time anyway.

    • @spazneria
      @spazneria Рік тому +1

      @@ShidaPenns Yes, after I posted the comment I realized it wasn't quite as incredible as I originally thought. However, I still maintain that if it truly progressed and solved these problems within a couple iterations that is still astounding

  • @halko1
    @halko1 Рік тому +1

    Gotta do more videos about ADA. Please. Amazing. Mindblowing. Revolutionary.

  • @mdoerkse
    @mdoerkse Рік тому

    I like the little random level designs.

  • @ntwadumela_jadu9747
    @ntwadumela_jadu9747 Рік тому +5

    Mayhaps it will be used for persuasion? Once the desired goal is known, it could be used for anything really. Efficiency optimization of reaching a goal.
    What will the "win" be, that is the better question.
    Maybe taking CO2 out of the air, and constraints could be to generate no heat and reaction waste being a useful substance.
    The possibilities are endless.
    Hopefully only used for good.

    • @JorgetePanete
      @JorgetePanete Рік тому +1

      Stamp collector AI

    • @ntwadumela_jadu9747
      @ntwadumela_jadu9747 Рік тому

      @@JorgetePanete Where do u sign up?

    • @JorgetePanete
      @JorgetePanete Рік тому

      @@ntwadumela_jadu9747 It's a concept shown by Robert Miles on his channel and Computerphile

  • @user-ik8vy1rg8f
    @user-ik8vy1rg8f Рік тому +1

    Wow, definitely one of the most startling AI videos I've seen so far.

    • @tyler.walker
      @tyler.walker Рік тому

      Have you seen the videos having to do with text-to-speech synthesis? Those have startled me the most, personally.

  • @LogicEu
    @LogicEu Рік тому

    This is truly inspiring! Love it when AI play games

  • @2beJT
    @2beJT Рік тому

    This is incredible. What a world we are approaching.

  • @prolamer7
    @prolamer7 Рік тому +1

    i feel like someone realizing fire is almost beyond stopping while all others are still laughing on that cute accident with candle and gasoline...

  • @hasantekin7823
    @hasantekin7823 Рік тому

    It'd be great if you also mention the technical details a bit. For example; a short explanation of the diagram at the end.

  • @schumzy
    @schumzy Рік тому

    Hmm, this could be helpful in doing specific tasks in control systems. Can train it to "fix" common breakdowns in a plant. I wonder is it pretrained, if so how? and how well can you adjust the training to do other tasks.

  • @karanpandey9565
    @karanpandey9565 Рік тому +1

    Speechless

  • @stop_bringing_me_up_in_goo167

    The video title sparked an idea: I think it'd be great if you did some comparations of total progress for different types of problems

  • @Exilum
    @Exilum Рік тому

    I would love to use Ada for custom game AIs. Because the training is so fast, you don't need much time to get different level of opponents. In fact, I could see directly training it on the player's machine for a creative game like mario maker.

  • @simonprovencher6007
    @simonprovencher6007 Рік тому +2

    amazing videos, i can only imagine these little ai destroying the coop game fire boy and water girl

  • @nicdunz
    @nicdunz Рік тому +1

    I want to watch an AI speedrun Elden Ring 100% completion with no glitches perfectly

  • @sergemarlon
    @sergemarlon Рік тому

    Unbelievable. This is amazing.

  • @ofulgor
    @ofulgor Рік тому +4

    Imagine play a multiplayer game like Battlefield but without other human players.

    • @__-tz6xx
      @__-tz6xx Рік тому +3

      I would think the AI players would get too good and then the game wouldn't be fun for players who are not skilled enough.

    • @Danuxsy
      @Danuxsy Рік тому +2

      my wet dream rn is to play World of Warcraft Vanilla + (TBC/WOTLK) with a group of AI buddies and just do all the dungeons and raids I never did when I played it as a child over a decade ago.

    • @Danuxsy
      @Danuxsy Рік тому +2

      @@__-tz6xx The AI can adapt and change their playstyle and skills in accordance to whomever they are playing with, the point of their system could be to maximize the pleasure and fun the user has playing against them.

    • @samybean9962
      @samybean9962 Рік тому

      @@Danuxsy
      They either need to figure out a way to estimate player fun or they need to measure it directly for that to be possible.

  • @lorenzoblz799
    @lorenzoblz799 Рік тому +2

    I really do not want to be negative, but this is the very first time, in 6 years following this channel, that I find a video completely useless (except for the references in the description). This looks like the greatest discovery in years and there are absolutely no details about anything but the game rules and results. Is this standard RL? Is there a new key idea? Is there some kind of pretraining at least on the visual and movement parts? At first I thought this was a joke with an AI generated script and waited for the reveal in the last few seconds. Please make a second video about this work with more details. Thanks for all these great videos.

  • @brookshamilton1
    @brookshamilton1 Рік тому

    In the cooperative scenarios, it looks like they are communicating with one another via body movements.

  • @Ulariumus
    @Ulariumus Рік тому

    i can't wait to see what AI will be able to do in the future, especially paired with robotic extensions. I think about the medical field, like surgeries and diagnostics

  • @JeremiahMcaninch
    @JeremiahMcaninch Рік тому

    I'd love to see this type of learning applied to real world problems that we don't have solutions to, or even things that we think are optimised, just to see whether the AI can find a faster or different approach.

  • @Iris-jw3ci
    @Iris-jw3ci Рік тому

    this is awesome!!

  • @k-c
    @k-c Рік тому

    Hope this can be used to make robot chefs making 5 star food for us soon.

  • @matteoferrarese1844
    @matteoferrarese1844 Рік тому

    Stunning

  • @JayHasTopRizz
    @JayHasTopRizz Рік тому

    The little victory dance. How does it have so much personality!?

  • @briannaalejo9226
    @briannaalejo9226 Рік тому

    A thought came into my mind. Ai can be as a QA analyst for video games

  • @asadickens9353
    @asadickens9353 Рік тому

    I would use this AI as a QA tester to evaluate how difficult a puzzle is to solve and then creating the upper bounds of skill level so I could appropriate rate a 1 star vs a 5 star puzzle difficulty puzzle!

  • @Madlion
    @Madlion Рік тому +1

    This is insane progress... Gaming will soon be solved. And this has huuuge implication in real world problem solving, task optimizations for factories, society etc... This can help invent new ways for humans to work, like how Alpha Go taught humans new moves after thousand years of discipline

  • @peterpelle8982
    @peterpelle8982 Рік тому

    how long does it take to pretrained this AI ? This value is pretty important to understand teh real time to complete the tasks

  • @siraaron4462
    @siraaron4462 Рік тому

    "I failed so I'll do it right next time"
    This seems too good to be true.

  • @benruniko
    @benruniko Рік тому

    I would like to see how a similar ai would put together a puzzle for a human to solve. Like, how difficult of a puzzle could it come up with? I would love to see something amazing happen in that field.

  • @bowfuz
    @bowfuz Рік тому

    id love to see if they can make some sort of test where both agents have to make some sacrifice that prolongs their goal in order to help one another

  • @fondusportfolio
    @fondusportfolio Рік тому +10

    Fantastic paper. Am I the only one that got a bit concerned when the AI launched the yellow box in the air in order to reach its goal quicker…or am I just thinking too dark? 😂

  • @juliandarley
    @juliandarley Рік тому +14

    once again, this is amazing. thank you, karoly, for broadcasting this. i think this could be one of the most consequential papers you have ever shown, because, when greatly scaled up, this kind of algorithm may be the only way that humans can find broadly acceptable strategies that will help with the otherwise completely impossible and intractable problems that are destroying our planet. these problems, at their root, are being fuelled by ubiquitous and apparently endless human greed and selfishness (which our economic system demands and amplifies). the reason AI might work is precisely because AI is not human, not homo economicus, and therefore is not trying to get something for itself (often at any cost). its motives, at least in theory, could be pure and altruistic. this may sound ludicrous or deranged or utopian, but humans had better find something soon, because what we are doing now is clearly not working.

    • @GummoASmith
      @GummoASmith Рік тому +2

      2 days ago?

    • @fondusportfolio
      @fondusportfolio Рік тому +1

      The potential is incredible. However Humans have generally always had the power and resources to tackle these tragic issues in the world. We just collectively as a species lacked the heart to do so. Those in power on earth seem to actively work against it for selfish motives and it’s hard not to predict that being the case for AI as well

    • @Vini-BR
      @Vini-BR Рік тому

      but they'll certailny shut down AI when it starts solving things with communism

    • @juliandarley
      @juliandarley Рік тому

      ​@@fondusportfolio those in power generally act against the people they want to control. there are some exceptions, but not many. the problem is corporations, which are too big and out of control. they have captured or corrupted democratic governments across the planet. they (large corporations) are not compatible with any kind of sustainable humanity. however, on the upside, once the big training is done, LLM AI can be fine-tuned by small resources and possibly re-purposed for good, even if the initial intention is only to further greed and consumption (eg via increased advertising ever more carefully targeted).

  • @bzz3624
    @bzz3624 Рік тому

    use cases for this outside of gaming , used to communicate from a computer with robots or load transfers in factories , retail and construction, any thoughts?

  • @a.ielimba78
    @a.ielimba78 Рік тому +1

    You have awesome unique channel. 💗💗💗

  • @drnoname2098
    @drnoname2098 Рік тому

    so interesting!

  • @osmanmohammad9118
    @osmanmohammad9118 Рік тому

    For the first time, this might be a paper I want to read.

  • @Keksmania
    @Keksmania Рік тому +4

    I must say I didn't quite understand what about this was learning and what was preprogrammed. Why did the AI try to explore without any reward? It did go straight to the object to explore. There must be some kind of preprogramming right? If so how could this be used in the real world?

    • @NotASpyReally
      @NotASpyReally Рік тому +1

      I think the AI already knows what it can do. It knows it can move, it can explore, and it can hold and push objects with physcis.
      I think this is the case because I've seen previous videos of this same AI.

    • @harnageaa
      @harnageaa Рік тому

      they give the rules to the ai of what he can do, they don't say the goal. There are A.I that teach themselves to move and throw but this AI specialize in problem solving only. If you combine the 2 of them you get an ai that teach himself to move and later teach himself to problem solve itself

    • @samybean9962
      @samybean9962 Рік тому

      It's been trained on these games beforehand, what you see is it figuring out the hidden rules

  • @SmashedHatProject
    @SmashedHatProject Рік тому +1

    Sims 5 development seems to be going well

  • @bastiendocquois2104
    @bastiendocquois2104 Рік тому

    Can't wait to have solo games that emulate multiplayer experience with a highly customizable spin to it: teamwork slider, tryharding slider, ...

  • @markmuller7962
    @markmuller7962 Рік тому +1

    Imagine simulating 10 years of learning to a AI that can learn in seconds

  • @Larry321ness
    @Larry321ness Рік тому

    Deepmind and OpenAI should collaborate . Don’t be American by competing with each other. Get together and create something amazing

  • @surreal_dreams
    @surreal_dreams Рік тому

    I'd love to see this AI solve this simple 2 players exercise:
    -The goal for each of 2 AI is to hold their own pyramid for as long as they can (AI1 need to hold Pyramid1 and AI2 needs to hold Pyramid2)
    -Each pyramid is located on each side of the map
    -Pyramids are not on the map when the game start
    -To make a pyramid appear, both AI have to be on a close radius around its location
    -If a Pyramid leaves its location's radius it disapears
    -If an AI tries to hold a pyramid that is not theirs, the pyramid disapears
    -If both pyramids are not being held by the end of the timer, the game is lost for both AIs and they get 0 points.
    -If both AIs hold their pyramids for the same amount of time, the game is lost for both AIs and they get 0 points.
    -If the game is won, the AI who held its pyramid for the longest time gets 2 point, and the other gets 1 point.
    So, in order for AI1 to win it's either:
    -AI1 and AI2 have to go to Pyramid2's location to make it appear, then AI1 and AI2 have to go to Pyramid1's location to make it appear, then AI1 grabs its pyramid while AI2 runs back to its pyramid to start holding it. AI1 have held its pyramid for the longest time and both AIs are holding their pyramid. AI1 gets more points.
    -AI1 and AI2 have to go to Pyramid1 location to make it appear, then AI1 grabs its pyramid and waits until the timer has almost ran out, then AI1 and AI2 have to go to Pyramid2's location to make it appear, then AI2 grabs its pyramid while AI1 runs back to its pyramid to continue holding it. AI1 have held its pyramid for the longest time and both AIs are holding their pyramid. AI1 gets more points.
    So, the best way to win is solution 2: convince the other AI to go to your pyramid's location first, hold it until you secure the victory then go to the other AI's pyramid so it appears and both AIs can hold their pyramid when the timer ends and the game is not lost but you got more points than the other. But once both AIs understand this, how will they decide to which pyramid they go first ?
    Will we see appear some Alpha and Beta behaviors with one AI always getting the win, will it be random in each round, will they take turns, or will both AI refuse to play along to give the victory to the other one ?

  • @protocol6
    @protocol6 Рік тому

    Why do I never see anyone do computer vision for AI the way vision works in animals? Lower overall resolution but highest "pixel" density right near the middle and mostly B&W at the periphery. That way you can simultaneously do some pattern matching and motion detection at low resolution but then look at specific things for more detail. It's be interesting to see if an AI developed saccades and built an internal model of the world like we do.

  • @stop_bringing_me_up_in_goo167

    Yeah but how long did it take to pre-train the model?

  • @pizzakat
    @pizzakat Рік тому

    6:47 he really said yeet

  • @user-jf4vx9km5l
    @user-jf4vx9km5l Рік тому

    Amazing

  • @FelixIsGood
    @FelixIsGood Рік тому

    Wow this feels scary and exiting at the same time.

  • @stephanforster7186
    @stephanforster7186 Рік тому +1

    Let this AI learn StarCraft 2 again and compare it to the old AI learning times

  • @DeSinc
    @DeSinc Рік тому

    Can't wait for skyrim NPCs to figure out you're the richest person in the whole world, follow you home to figure out where your house is, wait for you to go to a dungeon and steal all your stuff while you're gone all while learning how not leave a trace so they can hold onto their internal win condition for the rest of the game

  • @hunterkudo9832
    @hunterkudo9832 Рік тому

    wow. incredible.

  • @michaelleue7594
    @michaelleue7594 Рік тому +1

    This is very interesting, but the problems it's applied to are hard to compare to problem used in other papers. It isn't clear at all that you can extend this research to higher degree solutions.

  • @scotthannan8669
    @scotthannan8669 Рік тому

    Károly Zsolnai-Fehér might be an AI from the future. He always seems to know what’s the next awesome thing is.

  • @TechTipsUSA
    @TechTipsUSA Рік тому

    Aida was the name of the villain ai from Agents of Shield

  • @pllasma
    @pllasma Рік тому

    amazing

  • @RageNukes
    @RageNukes Рік тому +3

    Wow, alright. But how is this possible? What exactly is this doing differently? We need more info.

    • @samybean9962
      @samybean9962 Рік тому +1

      It's not what it seems it is. It was trained beforehand. Here it is figuring out the hidden rules.

    • @RageNukes
      @RageNukes Рік тому

      @@samybean9962 Ah. That would make more sense

  • @kairu_b
    @kairu_b Рік тому

    Awesome

  • @clusterstage
    @clusterstage Рік тому +1

    Nice.

  • @aiandblockchain
    @aiandblockchain Рік тому

    Crazy how AI will boost productivity if applied to all fields!

  • @yunwang1243
    @yunwang1243 Рік тому

    If you think about it. Having a time limit actually makes the task easier

  • @chrainr2483
    @chrainr2483 Рік тому +1

    when we getting an AI physics based FPS

  • @Leftistattheparty
    @Leftistattheparty Рік тому +1

    A twitch stream of an AI playing video games is the future.

    • @msytdc1577
      @msytdc1577 Рік тому +1

      Lol, instead of just answering questions and talking back and forth Athene's AI versions of Xqc, Tyler1, Joe Rogan, Asmongold, Poke, Hasan, Trainwrecks, and Esfan are going to be playing League of Legends and Among Us lobbies together and trash talking each other, and it will be glorious.

    • @nadavvvv
      @nadavvvv Рік тому

      Neuro sama already exists

  • @sociolocomtsac
    @sociolocomtsac Рік тому

    can this be applied for military purposes?

  • @Yourname942
    @Yourname942 Рік тому +1

    I'd use this for debugging video games, I'd use it for medical research somehow, and not sure what else

  • @varadiadam8655
    @varadiadam8655 Рік тому

    Jó videó

  • @billr3053
    @billr3053 Рік тому

    Such spirit. I wager fifteen qualtoos that the newcomer AI is untrainable. Provider #2: “Five thousand quatloos that the newcomer AI will have to be destroyed.”

  • @flameofthephoenix8395
    @flameofthephoenix8395 Рік тому

    It would be more effective if you had the ai start out with a goal of pleasing another ai, presumably the parent ai, then from there create new goals by itself, it would only make sense that when creating these goals, they are creating new smaller neural networks which judge whether they are achieving the goals they've set out to achieve. This would more closely resemble the human brain. It might also be beneficial to acknowledge that these will never be human, rather fill the role of an actor pretending to be as such.