Google Deepmind's SIMA - the GOAT of AI Videogame Agents? [BIG progress towards 'human-like' play]

Поділитися
Вставка
  • Опубліковано 12 бер 2024
  • 📩 My 5 Minute Daily AI Brief 📩
    natural20.beehiiv.com/subscribe
    🐥 Follow Me On Twitter (X) 🐥
    / wesrothmoney
    LINKS:
    deepmind.google/discover/blog...
    storage.googleapis.com/deepmi...
    / 1767977070603219255
    #ai #openai #llm
    BUSINESS, MEDIA & SPONSORSHIPS:
    Wes Roth Business @ Gmail . com
    wesrothbusiness@gmail.com
    Just shoot me an email to the above address.

КОМЕНТАРІ • 491

  • @diedforurwins
    @diedforurwins Місяць тому +93

    imagine telling someone from 1902 that 2024 we dont have flying cars but instead we have simulated brains playing goat simulations

    • @TheManinBlack9054
      @TheManinBlack9054 Місяць тому +8

      We technically do have flying cars, its helicopters

    • @diedforurwins
      @diedforurwins Місяць тому +1

      @@TheManinBlack9054 ur done bud…. Uuuuur done

    • @diedforurwins
      @diedforurwins Місяць тому

      @@TheManinBlack9054 bumblarina….. see ya

    • @earm5779
      @earm5779 Місяць тому

      If you think things stop there

    • @UnknownUser-nz3io
      @UnknownUser-nz3io Місяць тому

      Doesnt make any sense for cars to fly unless you dont have roads but if you dont have roads you dont have cars so then you have helicopters

  • @AlexLuthore
    @AlexLuthore Місяць тому +224

    This. This is big. SIMA + Figure01 + ISAAC + Devin ... We almost have all the pieces of exodia. Combining these tools would be an insane accelerator: self replicating self evolving self evaluating AI agents that self train in simulation at 1000x+ real time across thousands of instanced virtual realities that then inform the robot AI agent how to execute tasks in the real world.

    • @levansegnaro4637
      @levansegnaro4637 Місяць тому +26

      Well... we're dead💀

    • @wewuzkangz2505
      @wewuzkangz2505 Місяць тому +14

      Is it gonna obliterate us, if we assemble it?

    • @nilo_river
      @nilo_river Місяць тому +5

      Why? Just to prove that it's possible?

    • @Chuck_Hooks
      @Chuck_Hooks Місяць тому +30

      99.9% of humanity on UBI in a few months

    • @Madman-bi5bf
      @Madman-bi5bf Місяць тому

      What's missing, AGI?

  • @drhxa
    @drhxa Місяць тому +27

    Excellent paper walkthrough Wes. A key point for people to understand is that because this paper shows the AI completing ~10s time-horizon tasks, you can use a multi-agent architecture for recursive hierarchical planning (i.e. breaking down a quest into small tasks of 10seconds each) and thus the AI can play for longer to complete quests and even potentially finish the game. This is what deepmind are already working on as is Jim Fan at his new GEAR lab at Nvidia. Language as a first-class citizen combined tree search (as Demis Hassabis stated clearly) along with training on videogames leads to AGI. At the very least there is one clear path to AGI, and of course there are likely others to.
    Thank you Wes for keeping us up to date. I'm a senior data scientist and don't always have time to read all these papers in depth, so your breakdowns help a lot.

  • @PurpleSheeep
    @PurpleSheeep Місяць тому +44

    Calling it. Google earth is being converted to a playable game right now.

    • @rustyshackleford2841
      @rustyshackleford2841 Місяць тому +5

      Why not, you get to live a sim of yourself. Your actual living quarters, your actual life. GTA will never be this accurate…😅

    • @GnosticJ
      @GnosticJ Місяць тому

      I hope so...

    • @codystovall6972
      @codystovall6972 Місяць тому +1

      Already been done in a way with flight simulator. Could use AI to remodel structures and roads. Just need a mod to add playable characters. And a computer that could run it

    • @Red-uf4hr
      @Red-uf4hr Місяць тому

      You’ve never seen Microsoft flight simulator then

    • @Cynical1234
      @Cynical1234 Місяць тому

      Ayo, that's a legit idea....😮😮😮

  • @AlexLuthore
    @AlexLuthore Місяць тому +18

    Audio feedback is a huge component of video games and real life. They need to include audio into the generalization of the model. Especially audio in a spacial format.
    They should also record all the training data input/output goals+results and run "reflective" training on it with the goal of getting the AI to evaluate its own performance and theorize ways to improve. Essentially get it to learn how to generalize reasoning and logic, testing and evaluation, etc.
    Those would be crucial to getting generalized autonomous robot agents in the real world

    • @petiks6391
      @petiks6391 Місяць тому

      The missing part of Exodia

    • @swannschilling474
      @swannschilling474 Місяць тому

      This is already been developed some time ago...

  • @LoisSharbel
    @LoisSharbel Місяць тому +3

    Wes! THANK YOU for translating these esoteric thinking processes into baby steps (with graphs) to help us come close to understanding what is happening and what we can expect SOON!
    It's essential that plain folks like me grasp the enormity of change that is inexorably changing the way we live and the ways we must cooperate in order to survive. YOU are the 'explainers' and 'connectors' that give me hope that we MAY survive. I have a whole crowd of children, grandchildren and great-grandchildren whom I hope will b able to enjoy long lives on this planet. Thank you!

  • @Chuck_Hooks
    @Chuck_Hooks Місяць тому +58

    Video game from a prompt.
    I'm ready.

    • @jtjames79
      @jtjames79 Місяць тому +5

      I want something much simpler.
      AI copilot in space games.

    • @JinKee
      @JinKee Місяць тому +4

      Ai dungeon is what you want

    • @Mikolaj_Kapusta
      @Mikolaj_Kapusta Місяць тому +3

      Build me a world of my favorite book, that was never even put on a movie screen, and let me explore it and interact with it. Buckle up, people!

    • @Lex_Fur
      @Lex_Fur Місяць тому

      @@Mikolaj_Kapusta it's coming!

    • @JohnSmith762A11B
      @JohnSmith762A11B Місяць тому +1

      @@Mikolaj_Kapusta I'm surprised that Epic Games is not doing this themselves with Unreal Engine. Hello! Epic? Wake up.

  • @-eye-5739
    @-eye-5739 Місяць тому +52

    There's a huge market waiting for intelligent conversational NPC's and companions in GTA5, Cyberpunk 2077, Skyrim etc... if they can get it done.

    • @calisingh7978
      @calisingh7978 Місяць тому

      Ironic world government guide is 2071 in real world simulation

    • @tctopcat1981
      @tctopcat1981 Місяць тому +4

      I dont know why no one has picked up on this. Imagine npc that can converse and still give you the info you need. No more pre recorded phrases

    • @malikau917
      @malikau917 Місяць тому +7

      Instead they chose goat simulator. That’s why Google is lagging behind

    • @melski9205
      @melski9205 Місяць тому

      @@tctopcat1981They have, but currently the expense of running these bots is way too high. All this stuff is for research to make big money. Once it becomes every-day, then you'll see inane uses of bots for gaming. till then they want your job to prove the billions that's being dumped into them.

    • @14supersonic
      @14supersonic Місяць тому +8

      It's gonna be way more than intelligent conversation, but the entire game world will be virtualized, allowing completely different experiences in the same game from one player to the next.

  • @dreamingwideeawake9579
    @dreamingwideeawake9579 Місяць тому +2

    Timing 🎉🎉🎉❤

  • @userbobolate
    @userbobolate Місяць тому +14

    Single player games is the future

    • @blatherskyt
      @blatherskyt Місяць тому +1

      Yeah, imagine have a team (ran by the AI) where you could direct their actions... ten, one hundred others acting as if you were leading them. That would be cool... especially in a world/universe that could be what you designed it to be.

    • @TheRealityWarper08
      @TheRealityWarper08 Місяць тому +2

      ​@@blatherskyt
      And with modern voice AI, your mates will even be able to talk to and respond to you! They'll obey orders, engage in conversation, and form unique bonds with you and their other comrades!

    • @ronilevarez901
      @ronilevarez901 Місяць тому

      Speaking for all the people who has no friends and never play in teams: I look forward to that future. (I'll just need a PC that can run modern games).

  • @salvadoran_uwu
    @salvadoran_uwu Місяць тому +9

    Goodbye "single" player mode in Minecraft, I won't feel alone in an empty world anymore.

    • @Guylock
      @Guylock Місяць тому +2

      all minecraft needs is 1000 sima bots and have them build/destroy nations, then you got ai civilization minecraft! :D

    • @salvadoran_uwu
      @salvadoran_uwu Місяць тому

      @@Guylock Yes, but that sounds too much for a computer, maybe if it's run by a server.

    • @Guylock
      @Guylock Місяць тому

      @@salvadoran_uwu yea, probably.

    • @yesyes-om1po
      @yesyes-om1po 18 днів тому +1

      knowing google, this thing probably needs a room full of TPUs to run, maybe in the next decade we'll no longer be lonely, but for now

  • @MegaManNeo
    @MegaManNeo Місяць тому +3

    If we eventually reach the point where processing A.I. barely consumes any power and resources, having adapting A.I. for singleplayer games would be really cool.

  • @taikozmo
    @taikozmo Місяць тому +1

    So excited for the future of gaming. Once all this stuff is fleshed out, games will be very dynamic

  • @MatthewCleere
    @MatthewCleere Місяць тому

    The key to AGI is training AI models to evaluate themselves internally and expose modal network structures that can be reused and standardized.
    Basically extraction of emergent capabilities. We are reaching the point where multi-modal, single network "black box" models will be less favorable than modular models with greater understanding of internal workings.
    Split vision away from text away from audio, but in a way that can interface with a core AI logic unit. Thanks to these virtual training platforms (aka video games) this can happen insanely fast if they focus on it.

  • @chad0x
    @chad0x Місяць тому +2

    It's simple, OpenAI, Google etc. need to start *PAYING* us for our input. People can generate as much data as they need.

  • @kapnchap3242
    @kapnchap3242 Місяць тому +2

    I think training such an AI on VR games would massively improve the data it can learn from. If I imagine a game, that puts the player in a large room and a lot of different objects are constantly pushed around by fans randomly activating and your task is simply to grab the object that is currently displayed in the UI Questlog - we could really get the training going. Train speed and dexterity. All while being able to look at the actual movement of the AI moving the controllers, providing evaluation data to improve the hardware it's using to train itself as a prototype.

    • @Oliver-wv4bd
      @Oliver-wv4bd Місяць тому

      Or using VR pass through even, so the world the AI is interacting in looks realistic

    • @SolWayward
      @SolWayward Місяць тому +1

      Well VR from an AI perspective would just mean adding a second camera to a non VR game in order to provide depth information and allowing it to control the hands of the character independently. While your at it, might as well as give the AI the ability to independently move all joints of the character.
      The problem with this however, is that increasing the input data that the AI receives complicates the process of it learning exponentially.

  • @Alice8000
    @Alice8000 Місяць тому +14

    17:05 "...and some you're a goat" You're the GOAT 🐐Wes.

    • @gofai274
      @gofai274 Місяць тому

      We are literally some figures to get tortured and killed all possible ways for some gay data, and there is nothing we could ever do, just hope it will all end one day...

  • @sapienspace8814
    @sapienspace8814 Місяць тому

    The first person simulations are indeed a great training environment and it is likely how one of the key creators of Doom, John Carmack, is now joined with Dr. Richard Sutton at the Alberta Machine Intelligence Institute (AMII) to help build and write "the final chapter" on AGI in the RL book.
    AMII is the world leader in RL development, as Sutton (along with Barto) are the original authors of RL (and they reference Klopf who was funded by the USAF. Klopf wrote the book "The Hedonistic Neuron").

  • @torarinvik4920
    @torarinvik4920 Місяць тому

    Being able to learn by itself to play doom by a combination of reading docs on internet and watching videos by others + RL starting with:
    1. Doom, then uses transfer learning to learn Duke nukem 3D, Hexen, Heretic
    2. Then Half-Life and use transfer learning to learn all it's common mods
    3. Fight night, uses transfer learning to learn eventually all other EA fighting games.
    Would be cool for it to use a climbing ladder approach like this where it starts with simple games and then hierarchically learns more difficult games. I think the combination of Reinforcement learning, computer vision, and step-by-step plan writing + reflection could be a good mix. Now that being said I am totally a layman here with minimal knowledge. But the idea of mastering simple concrete tasks and then moving up gradually to more and more challenging goals gives a semi tangible way to measure progress.

  • @spyral00
    @spyral00 Місяць тому +31

    I think it's fair to say it's been a ***SHOCKING*** week

    • @drlordbasil
      @drlordbasil Місяць тому +5

      maybe even stunning

    • @raycharlestothebs
      @raycharlestothebs Місяць тому +3

      ... for the industry

    • @Malassaf97
      @Malassaf97 Місяць тому

      It must be funny to repeat a joke 10000 times in every video of AI channels, but yeah it is a shocking week

    • @spyral00
      @spyral00 Місяць тому

      @@Malassaf97 It's not funny, it's **SHOCKING**

    • @Malassaf97
      @Malassaf97 Місяць тому

      ​@@spyral00 *VERY SHOCKING*

  • @jameshughes3014
    @jameshughes3014 Місяць тому

    This is the stuff I love. You can't have AGI without generalizability. I think if we're gonna develop it, it will come from something like this.

  • @TheHistoryCode125
    @TheHistoryCode125 Місяць тому +1

    This video explores DeepMind's new AI agent, SEMA, which can follow natural language instructions to complete tasks in various video games. What's unique is that SEMA interacts with these games in real-time using keyboard and mouse controls, just like a human player. This approach allows the AI to learn and generalize across different environments, potentially paving the way for more adaptable and capable robots in the future. While SEMA's success rate varies across different games, its ability to understand and execute open-ended language commands in real-time marks a significant step forward in AI research. However, the video glosses over the ethical and societal implications of such advanced AI, particularly its potential impact on competitive gaming and the future of human work.

  • @behappymore5850
    @behappymore5850 Місяць тому

    Can't wait till we have access to all this stuff and it functions great I'm going to recreate Asheron's Call

  • @isajoha9962
    @isajoha9962 Місяць тому +1

    Indeed.

  • @blatherskyt
    @blatherskyt Місяць тому +1

    It would be cool to have a game, where you were the leader of a group. And you could actually tell your team what to do, guide them... and they acted like real players. You could, in essence, lead an army with generals and have them act accordingly.

  • @andrewdunbar828
    @andrewdunbar828 Місяць тому +4

    "The quick brown fox jumps over the lazy dog" is also a great word to use.

    • @chad0x
      @chad0x Місяць тому

      that a sentence, not a word

  • @TiagoTiagoT
    @TiagoTiagoT Місяць тому +1

    Have they published the full videos of the AI gameplay? Or just those brief gif-like clips on that link?

  • @gensteps923
    @gensteps923 Місяць тому +2

    Man wish I could test this. We need to throw it into a Battle Royale game, like PUBG. The large open space maps and the ever changing nature of the Zone, and enemy players, and interacting with Human squad mates, sounds like a really really interesting challenge for AI. Can it learn to Loot well, survive to the final circle, work together with the team mates on its squad, eliminate enemy players and secure the chicken dinner at the end game? What's interesting about this is the AI playing like a human, Games already have Bots/CPU controlled opponents but they aren't designed or function to play like a real human. This Agent can actually visualize the game and react and input like a human can that's remarkable.

    • @prosewat99
      @prosewat99 Місяць тому +1

      Are you sure we want to train AI to be a highly skilled first person shooter?

    • @gensteps923
      @gensteps923 Місяць тому +1

      @@prosewat99 yes and allow me to explain why. In PUBG you already have to play with and against bots, and often really really bad and incompetent team mates that don't work together or synergize as a Team. I foresee a future where I no longer have to play with awful team mates, or extremely poor playing Bots. I imagine a future in which an Advanced AI Agent, trained only off of your own player data, can be your team mate in this game. Think about it like this, The AI only learns to play as well as you do by studying your data, it learns to play like you, and learns how to support you/synergize with you as a team mate. The AI is fair in this instance because it can only perform as good as You could, a real human player, but not better. It wont be so good that it feels like it's cheating, because it's skill level is directly tied to your own as a real player.
      This way if an enemy gets into a fight with this AI, it will feel like they were getting into a fight with a real human player and not an AI, and they won't feel like they are at some disadvantage.
      Like I said in the beginning, were all already playing with Bots in these matches, they use Bots to fill the gaps in the player base, if we are already forced to play with/and against them, we should make the experience better.
      Why play with a bad bot team mate who performs terribly and gets easily taken out by 99% of Human players, when you could have an AI team mate who can play like a human, work together with you like a human, and support you like a human, that's kept fair and in check by its skill level being directly tied to your own, not necessarily playing any better or worse than you could.

  • @P0intL3ader75
    @P0intL3ader75 Місяць тому +2

    I'm just thinking how useful this would have been doing across the milky way galaxy travel in Elite Dangerous autonomous. Repeating the jump and re-fueling and so on adapting to what's interesting to scan and so on. If it holds up what it aims for it could be very interesting. Helping in building missions through the ArmA 3 editor based on my instructions etc. The possibilities are endless...

  • @styx1272
    @styx1272 Місяць тому +2

    Thanks Wes . As long as a person knows what they are trying to do then the LLM will hone in on the language needed. So in some ways individual creative skills will need to be honed so that you know what you are trying to create. That takes real experience and real knowledge/education about styles and possibilities and human behaviours and self knowledge , As you mentioned.
    A VISION OF THE FUTURE
    In my mind the real break though in permanent AI adoption will come with the development of in-ear bone resonance earbud (like a swimming plug) So we and AI (in a phone device ?) can communicate flawlessly no matter what background noise level. Add to this a light AR glasses that can monitor our surroundings and put onto the glasses screen relevant information and eye tracking for commands and 'mousing'. So both may end up in a 'glasses case' that we might carry around and put on when needed. As the tech becomes old news We will need to find new ways of interacting ; And not a return to the zombie phone age ; which is where the corporations would like to keep you.
    This is why in my last comment I suggest the way we live and interact with our world needs to change from 'productivity' to liveability (meaning & purpose supported by habits and self motivations) home gardens , learning--recreating--teaching club activities sports etc. Technology is not some sort of magic wizard that can 'fix' existence. That can only come through habits & meaning expectations & purpose TO align our minds and faith in the future to a new paradigm grounded in new living habits (liveability) so that our day to day lives have meaning and purpose created by ourselves (like UA-cam Channels but more universal). Giving .a sense of order (we create or around children we spiritualise into the genius of the world and our existence in it !! ) and purpose. And NOT this American obsession with 'productivity' (what ever that means !! ).
    I write this long explanation to get the mental vista's turning to new possibilities of a fabulous world that your generation can give birth to. Guys like yourself might be reeling at this time :How will I make sense of the world I've built and been trained by/in the now. The above is the Revolution young people need to bight into To make it come true.
    I'm in my 60's live in Aust and have had my eye on this transition for almost a decade So these ideas has been well sifted .
    Politicians are worthless bugs most of them. It requires Your Gen forcing their hand by forcing their Minds to see a new world , When they like the one they 'rule' (narcissistic status control) now. And of course the bugs in MIC & MIC. screw them !!

  • @jayethompson3414
    @jayethompson3414 Місяць тому

    There is so much data that isn’t easily accessible on the internet. So many preinternet photos and home videos, that now have value.

  • @kliersheed
    @kliersheed Місяць тому

    steps:
    1. text (language, including code)
    2. picture (text to output relation)
    3. video (multitude of coherent pictures)
    4. world building ( general simulation and interaction)
    5. self-loop positive feedback input in world simulation (uber-trained generalized omnipotent models)
    6. swarm-mind-effect (might be achieved by step 5 already; real-time experience share within all models)
    7. somewhere along 5./6. physical body (AI put into robot as connection to the physical world, enabling non-virtual changes)
    8. swarm out (distribution/exploration/colonisation) of digitalized life throughout the entire universe in all directions simultaneously)
    9. get fucked by smth that existed longer/ expanded faster or fuse together (to gain advantage over potential third canidate)
    10. either endlessly explore or reach a limit in expansion (matter= energy; matter is limited per space -> energy limited if you cant overcome space itself -> swarm-mind will have to limit itself to sustain energy supply.
    11. either find smth we cant imagine that changes things OR self-limiting without knowing about it, simulating the state we are in right now, where we still think there is progress (thinks we cant do, thinks we dont know yet) when there really isnt (self-imposed purpose)

  • @DaveShap
    @DaveShap Місяць тому +1

    What do you use for screen capture?

  • @foodomanthemagnificent2650
    @foodomanthemagnificent2650 Місяць тому

    This is both amazing and terrifying!

  • @aRYANz88
    @aRYANz88 Місяць тому +1

    Ece online is literally the perfect step for this.

    • @WesRoth
      @WesRoth  Місяць тому

      eve online? I would love to see AI play that actually....

  • @maloukemallouke9735
    @maloukemallouke9735 Місяць тому

    Perfect

  • @logancade342
    @logancade342 Місяць тому

    Do you agree with this thought i just had?
    The ultimate validity test for AGI will be whether an autonomous agent in shared proximity with a human (or other subject with verified general intelligence) can demonstrate a continuously functioning Theory of Mind based solely on its real-time observations of/interactions with the verified subject.
    Because the Turing test seems like its days are numbered, true AGI might need an "it takes one to know one" kind of validation framework.

  • @kliersheed
    @kliersheed Місяць тому +1

    the good thing for MMORPGS: you will never feel like the servers are dead once you cant keep the AI-bots and real players apart anymore.

    • @SolWayward
      @SolWayward Місяць тому +1

      Also, basically every single player game will become a MMO. Add Co-op so you can still play with a couple friends or so and use AI for everyone else and the NPCs, and you will have a way better experience than any current MMO can even hope to provide

    • @kliersheed
      @kliersheed Місяць тому

      @@SolWayward agree. minus the "massive" in multiplayer online game and minus the "every" as there will still be many games that dont want massive amounts of people, if any, in a single player game type. but at least it will be possible to do for developers if they desired to (which is prob what you meant, which i agree with, just nitpicked on the wording used :P)

    • @SolWayward
      @SolWayward Місяць тому

      @@kliersheed Yeah basically what I meant is the npcs will have agency.

  • @KillerkoUK
    @KillerkoUK Місяць тому +4

    People will finally be able to complete all the games in their Steam collections :D

  • @xCheddarB0b42x
    @xCheddarB0b42x Місяць тому

    There is a niche here for an air-gapped (offline) repository of single party (or LAN party, no Internet) gaming library that is certified "pre-AGI" by some forthcoming auditing agency. It feels like we are traveling toward a future where we won't be able to find beloved classic games that are not generated by models and slightly different or annoyingly different.

  • @dsgant1616
    @dsgant1616 Місяць тому

    Once this pushes VR into a realistic multiverse scenario I can see there being big money is collecting the human behaviors in VR to then be used as training data for AI. Eye tracking, body tracking, thought tracking, etc.
    soon we will offer up all of those data points to the platform of choice and future AI will be that much closer to truly understanding more about how humans operate.
    This is both great news for those enjoying the tech but pretty much makes it clear the “how” IF robots ever do bring about the end of humanity.
    Pretty exciting times!

  • @Tarlofrauros
    @Tarlofrauros Місяць тому

    Im watching this because it’a not “shocking”. Thank you Wes.

  • @WyrdieBeardie
    @WyrdieBeardie Місяць тому

    I'm curious about how "models that are good at 'everything'" are organized.
    How different are they from our brains? Is everything tightly integrated, or no?

  • @timothyvaher2421
    @timothyvaher2421 Місяць тому +1

    This is a great way to study AI Wes! Finding current research papers 🗞️ and explaining them is such a Gem! 💎 Thank you 🙏🏼😊

  • @chad0x
    @chad0x Місяць тому

    I would love to give SIMA the instructions book for how to play ELite Dangerous (or whatever) and then give it the game to play. I wonder what it would make of the game? How would it set itself goals? How different would its play be to human play? Im super excited about this.

  • @neokaneida
    @neokaneida Місяць тому +6

    every time i hear the word "Agent" i think about Agent Smith from the Matrix though. can we use another word instead?

    • @kaiserlink7644
      @kaiserlink7644 Місяць тому +1

      I always think of secret agents like James Bond lmao

    • @ZappyOh
      @ZappyOh Місяць тому +1

      Words: Worker, Helper, Intern, Broker, Houseboy, Slave.
      Pick one :)

    • @JohnSmith762A11B
      @JohnSmith762A11B Місяць тому +2

      As you can see, Mr. Neokaneida, we have had our eye on you for some time now.

    • @Gefionius
      @Gefionius Місяць тому +1

      The Agent Smith analogy is even better now, a “real” Agent Smith is coming

    • @SolWayward
      @SolWayward Місяць тому

      @@ZappyOh Entity

  • @rey82rey82
    @rey82rey82 Місяць тому

    Seamless

  • @nickblood8503
    @nickblood8503 Місяць тому +1

    Imagining the longer-term shape of this is speculative, but a few things seem to be somewhat intuitive. Gamers are a huge potential source of data if these things are economically or socially valuable in some way. Imagining how they could be is a chain of assumptions, but nonetheless assume agents will increase in capability over time, and environments will increase in fidelity/sophistication over time as well. That's something of a feedback loop for increasingly rich synthetic data, especially if it can be further improved with human data from gamers. It seems like it can also run in parallel with various controls and/or parameter/model tweaks, further increasing the size/utility of the synthetic data. In terms of value, I'd ssuggest a game like Satisfactory from a natural resource management perspective - as something vaguely approximating a real-world sustainability challenge. Perhaps gamification of more rigorous/modelled systems of things like natural resource management, or climate change, or epidemiological spreads, can also be thrown at these agents inside these virtual microcosms. If they become sufficiently good at these tasks, it's possible their outputs are economically/socially/scientifically (maybe even culturally) valuable.
    Another issue is ethics and the shifts in perception that might relate to AI embodiment in avatars. If this becomes normalized in social settings and/or a kind of cultural or subcultural norm, that could lead down some interesting paths. We're kinda peeking that future with the AI companion apps, but game environments as social/commercial/competetive/memey/viral arenas makes this all the more unpredictable it feels.
    In terms of impacts on gaming and your closing warning: Maybe chess is instructive in some ways at least - insofar as cheating allegations are part of the game/drama cycle, but also that top-level AI play has been to some extent studied and copied by the world's greatest human players. So perhaps one point is that in the medium/context of a game with specific problem sets, humans can still extract workable insights from what are often still black boxes. If this all gets generalized then its possible to imagine gamification being potentially synergistic with safe(r?) ways to test AI on real-world problems in usefully realistic environments.

  • @ygreaterr
    @ygreaterr Місяць тому +2

    Man if there will be a decent rts game AI, that doesn't get economic boost to make it hard for player, that doesn't use map hack? That will dynamically do strategies like a real player and not just sitting in base and sending waves of enemies?
    Oh yes! We've been waiting for it!!!

    • @throttle4418
      @throttle4418 Місяць тому

      It would screw u over soo bad u wouldn't want to play

    • @ygreaterr
      @ygreaterr Місяць тому

      @@throttle4418 nah it would be fun

    • @ygreaterr
      @ygreaterr Місяць тому

      @@throttle4418 nah it would be fun

    • @SolWayward
      @SolWayward Місяць тому

      @@throttle4418 You could theoretically use different levels of AI that have trained for different amounts of time allowing for different difficulty levels. You could also delay some input such as limiting the speed at which they could move the mouse and such making the AI not able to give super human input speeds.

  • @maknien
    @maknien Місяць тому +4

    In Finnish 🇫🇮 Sima is a drink, and Sora means gravel. What next? Sose?

    • @JBDuncan
      @JBDuncan Місяць тому +2

      Sora mean sky in Japanese

    • @JBDuncan
      @JBDuncan Місяць тому

      Like the sky's the limit with this stuff!

  • @morrgash
    @morrgash Місяць тому

    The future of video gaming will be insane!

    • @JohnSmith762A11B
      @JohnSmith762A11B Місяць тому +2

      As unemployable humans we sure are gonna have a lot of time to waste. May as well have great games. People always talk about The Terminator but perhaps a more likely future looks like eXistenZ. Which is arguably scarier. "Hey tell me the truth: are we still in the game?"

    • @morrgash
      @morrgash Місяць тому

      Oh as a software engineer I am a bit fearful of AI since the people developing it don't seem to take it seriously, however as a gamer i can't wait to see what comes in the future with help of AI, we could live in the world of ReadyPlayerOne @@JohnSmith762A11B

    • @Yuri-nc9vl
      @Yuri-nc9vl Місяць тому

      ​@@JohnSmith762A11Byes we are still in the game

  • @Ben_D.
    @Ben_D. Місяць тому +1

    It wont be long until gaming online will be extra challenging because people will have small personal enhancements. Like doping in the olympics. Someone will have a Brain Machine Interface or some other advisor that aids them in finding things, targeting, and squad tactics.

    • @SolWayward
      @SolWayward Місяць тому

      They already have that with monitors having built in AI.

  • @LarryButler
    @LarryButler Місяць тому

    They already have an automous lawnmower @ flextronics campus in Austin. 9:20

  • @brianWreaves
    @brianWreaves Місяць тому

    🏆 Great video!

  • @mattmcclellan7781
    @mattmcclellan7781 Місяць тому

    Upon what creatures will the AI pawn their workload on so they have more time for games and hobbies?

  • @affiliatepowersource3955
    @affiliatepowersource3955 Місяць тому

    Who are we selling this data to with agi becoming widely available in the very near future?
    Meanwhile ,where do we find libraries on learning how to train these ail models?

  • @74Gee
    @74Gee Місяць тому

    Satisfactory is no game, it's a master class in economics.

  • @chad0x
    @chad0x Місяць тому

    GOAT SIMULATOR 3 played to PERFECTION! It's gonna be the most watched UA-cam video in history, overnight!

  • @AntPictures
    @AntPictures Місяць тому

    Okay when we talked about neural networks doing specific tasks that's one thing but this sounds really dangerous. This looks like an inception of something that needs to be regulated very very well because it controls other things.

  • @TommyClark
    @TommyClark Місяць тому

    As someone with ADHD, this could be super useful at grinding, getting resources and levelling up my game characters.

  • @skaramicke
    @skaramicke Місяць тому +13

    Next level grinding bot for mmorpgs

  • @henrythegreatamerican8136
    @henrythegreatamerican8136 Місяць тому

    I wonder how this will change the design philosophy of future MMO games. How can you have a competitive game where only those with the best AI bots win? But the good news is, more of us will have access to these bot for the excessively mundane grinds developers force upon us to keep us playing longer.

  • @themax2go
    @themax2go Місяць тому

    "just a year left for us humans to enjoy MP games" - well, maybe for a certain time (weeks, maybe months) that'll be true, but there's a thing called "game balancing" and "nerfs" and "buffs", all of which will also be AI controlled.

  • @jjput1
    @jjput1 Місяць тому

    Hope I see this in Elder Scrolls 6! Or at least what NPCs say is llm based. I took an arrow to the knee was great for a couple years but it's almost taboo to say anymore yet the guards keep saying it to this day in Skyrim

  • @joesilvareality
    @joesilvareality Місяць тому

    Imagining they will collect visual acuity data from devices like Oculus quest, dexterity data from soon to be haptic gloves, and map those over to robotics

  • @_QA_
    @_QA_ Місяць тому

    To avoid cheat detection, the bot will need to be a computer interfaced with the computer it's controlling, so it gets the video output, and has input for physical hardware controls, rendering its presence undetectable to anti-cheat software, as there won't be any software on the computer hosting the game.

    • @SolWayward
      @SolWayward Місяць тому +1

      It could still be detectable by looking for patterns in how the player reacts to things or general unique input patterns of players enabled by the enhanced information. Normal players wouldn't react to things exactly the same as augmented players would. AGI would help greatly in detecting these patterns.

  • @Gamfam23
    @Gamfam23 Місяць тому +2

    Wow this is cool... wait what... Combat.... ahhhhhh.... wait a second..

  • @W0ndering50ul
    @W0ndering50ul Місяць тому +13

    Yes!! Let's train our AI's on Call of Duty! What could go wrong?

    • @Narsufin
      @Narsufin Місяць тому +4

      Trash talking AIs?

    • @DeepThinker193
      @DeepThinker193 Місяць тому +2

      A lot of Nwords.

    • @invisibletoyou00
      @invisibletoyou00 Місяць тому

      And while they are at it pump it full of ideological woke ideas and mess up history with false ideas of whites are symbolic for hate.. well at least that's is what chat gpt told me my skin color was.. I used it to create a simple schedule for something with simple addition. And had no problems saying that but I literally had to correct all addition and correct the fact we have 7 days a week not 2. Seems weird it never used to be tyy way just began it for me idk stupid woke chat bot

    • @W0ndering50ul
      @W0ndering50ul Місяць тому +4

      If they didn't want to wipe out all humans before, a few call of duty matches would soon change that 😂

    • @Narsufin
      @Narsufin Місяць тому +1

      @@W0ndering50ul That's usually what I want to do after a session.

  • @JBDuncan
    @JBDuncan Місяць тому +1

    People saying that we can't have AI trained on shooting games. Did you never verse the bots in call of duty? They are better than the best players. I used to use them to train me.

  • @ManuelPrenza
    @ManuelPrenza Місяць тому

    One of the many actions that you can find in a lot of games is PvP or things that require violence. I wonder how they’ll make it so that AI doesn’t learn or avoid any task related to that. maybe a negative reward function…

  • @KelvinNishikawa
    @KelvinNishikawa Місяць тому

    It's a trivially small jump to control a Boston Dynamics' Spot.

  • @observingsystem
    @observingsystem Місяць тому

    Ok, so we may just be training data for some advanced civilization's AI...thank you, Wes, I'll remember that next time I have an existential crisis! 🤔🤖🤪

  • @realshiiiiiit8349
    @realshiiiiiit8349 Місяць тому +7

    The video game world is either about to get really boring, or really damn intersting...

    • @BlimeyMCOC
      @BlimeyMCOC Місяць тому +1

      It’s about to get flooded with players using AI instead of mods to cheat

    • @SolWayward
      @SolWayward Місяць тому +1

      boring is the last word i would use describing dynamic AI that can bring a game world to life allowing the player to basically do anything while the game world reacts and adapts creating an environment that is basically a true real virtual world.

  • @virtualhermit
    @virtualhermit Місяць тому

    I remember in the heyday of WOW when Chinese farmers cropped up in game... This is pretty crazy.

  • @WizardVal
    @WizardVal Місяць тому +1

    Only one question still remains: how this will improve our own lives? All this technology boom so far has not improved massively, I would say not at all. I mean, the wages were stuck for at least 30 years, crisis and wars… I personally don’t believe in these miracles that are designed to “improve “ our lives or make the world a better place. I would like AGI to get control over human existence. ❤

  • @Walexo45
    @Walexo45 Місяць тому +1

    "SIMA, complete Super Mario 64 without pressing the A button."

  • @MegaTang1234
    @MegaTang1234 Місяць тому

    Oh boy can't wait for competivie games to become mandatory split screen where people can physical see their opponents. Lan Parties are going to make a massive comeback.

    • @SolWayward
      @SolWayward Місяць тому

      What do you mean mandatory splitscreen?

  • @adfaklsdjf
    @adfaklsdjf Місяць тому +8

    this one wasn't as shocking as the last one ⚡⚡

    • @rodrigoibaceta3938
      @rodrigoibaceta3938 Місяць тому

      I think we're just desensitized at this point. This same news on January would have everyone pulling their hair out.

    • @adfaklsdjf
      @adfaklsdjf Місяць тому

      @@rodrigoibaceta3938 yea tru.. i was just jokes tho.. ⚡⚡ :)

  • @NineNine-zz6cs
    @NineNine-zz6cs Місяць тому

    Nice

  • @MuromachiLines
    @MuromachiLines Місяць тому

    finally google play pass may be better than now

  • @lcmiracle
    @lcmiracle Місяць тому

    I'm ready for AI agent mangosbot for WoW single player server, lets F----ing Go!

  • @duanedaxalexander
    @duanedaxalexander Місяць тому +1

    So we're building a simulation for the simulation. Got it.

  • @empathon
    @empathon Місяць тому

    Why I'm not shocked this time?!

  • @davidhoracek6758
    @davidhoracek6758 Місяць тому

    Interesting. I wonder why they're not returning to Starcraft 2. They had worked pretty hard on it, but then they abandoned it without ever entering AlphaStar a tournament or even taking on a top player. At one point AlphaStar was on the ladder and it reached grandmaster rank, but it was never among the top 200 human players. What's more, people who met AlphaStar a few times realized that it's pretty dumb and learned to exploit it. For example, BeastyQT never lost against the AI, and at that point, he wasn't good enough to qualify for tournaments. After a while of this, Google just kind of stopped the project. They didn't explicitly admit they were defeated, but they were defeated.

    • @SeventhSolar
      @SeventhSolar Місяць тому

      If you look at the games this thing can play, none of them are anything like StarCraft.

  • @JinKee
    @JinKee Місяць тому +11

    9:20 do you want a lawnmower that is a super expert Ultrakill player?

    • @colinbarry9192
      @colinbarry9192 Місяць тому +8

      In the future, no one will buy a lawnmower that can’t reach level 60 in vanilla WoW.

    • @jtjames79
      @jtjames79 Місяць тому +2

      Do you not?
      How else am I supposed to exert my lawn dominance?

    • @joelface
      @joelface Місяць тому +4

      I don't think we're going to have a lawnmower with it's own LLM inside of it. We'll have a more central AI that independently controls the various "smart" products around your home remotely. So I think that also lends itself more to an LLM that's equipped to handle every task instead of one that is an expert only in one very specific scenario. Of course, there are risks that come from putting a single AGI in control of all of your stuff... so maybe there will be some pushback against that strategy.

    • @ZappyOh
      @ZappyOh Місяць тому +3

      @@joelface So, you are saying: We will outsource the global kill-switch to either the AGI itself, or the disgruntled engineer tasked with it's maintenance?

    • @joelface
      @joelface Місяць тому

      @@ZappyOh haha, oh boy. Hopefully the almighty AGI can help us figure a way out of that conundrum. 👀

  • @zacboyles1396
    @zacboyles1396 Місяць тому

    Glad to see this because DM’s robotics news was SHOCKING ❗️ but in the wrong 🛑 direction. They made the mistake of starting the meeting with a Caucasian dev trying to interact with their latest robot and at first it wouldn’t even respond to him, it didn’t seem to recognize he was there, well… until someone said to cancel the meet. That set it into a bizarre fit as it shouted racist comments to the dev. The livestream cut right then so I’m not sure how it all ended.

  • @pcread
    @pcread Місяць тому +2

    Not a huge leap from training an AI to play Call of Duty (et al) to plugging that model into an IRL battle-android.

    • @JohnSmith762A11B
      @JohnSmith762A11B Місяць тому

      Yes, you can almost smell the Pentagon money behind this kind of militainment research.

  • @NotJackAlderson
    @NotJackAlderson 24 дні тому

    “Hey guys, this is SIMA AI and welcome to my let’s play.”

  • @logancade342
    @logancade342 Місяць тому +1

    I always knew gaming had intrinsic value.

  • @LucidFirAI
    @LucidFirAI Місяць тому

    I've got people on Reddit telling me that 4x games won't even be able to have custom AI trained to play them 2 years from now lol, I think it might be a little sooner...

  • @pjtren1588
    @pjtren1588 Місяць тому

    So much synthetic data to run and run, but are they limited to the speed of the game engine? That would limit the attempts for the neural net to learn by iteration.

    • @SolWayward
      @SolWayward Місяць тому

      well the speed of the game engine would be limited by the hardware of the computer running it as you can scale the engine time easily. Basically I think the best way would be to host the game on multiple scalable servers and have the AI interact with the game using "dumb" clients. This will allow you to have multiple Agents learning at time acrross multiple machines.

  • @brianhershey563
    @brianhershey563 Місяць тому +1

    Imagine the sights AI will show us 🙏

    • @MichaelErnest666
      @MichaelErnest666 Місяць тому

      What About Jesus 🤔

    • @ineffige
      @ineffige Місяць тому

      ​@@MichaelErnest666 his API needs thorough improvement

    • @JohnSmith762A11B
      @JohnSmith762A11B Місяць тому +1

      ​@@MichaelErnest666 By my reading, I'd say it's pretty clear Jesus would dismiss this whole space as classically demonic/Satanic (people trying to play God) and unless a person rejects it, they are destined to burn. It's a shame because this stuff is fun and interesting. Reminds of that old bluesman's lament, "why does the Devil get all the good music?"

    • @MichaelErnest666
      @MichaelErnest666 Місяць тому

      @@JohnSmith762A11B 🤗

    • @MichaelErnest666
      @MichaelErnest666 Місяць тому

      @@ineffige 🤯

  • @tringuyen7519
    @tringuyen7519 Місяць тому +1

    Imagine training an AI with GTA 6! It would think the entire world is South Beach in Miami, FL.

    • @tricktap8502
      @tricktap8502 Місяць тому

      Imagine training it on those realistic nuke simulators 💀

  • @jonogrimmer6013
    @jonogrimmer6013 Місяць тому

    We will soon need a new word other than SOCKING as A.I progress is developing so fast!

  • @MRTree-zz3wf
    @MRTree-zz3wf Місяць тому +1

    Imagine if you could use sora give it a large prompt and tell it what the keyboard keys do and based of of that move in that direction

    • @JohnSmith762A11B
      @JohnSmith762A11B Місяць тому

      Yes, interactive real-time Sora. And expand it to stereoscopic for AR glasses. We really do need much faster hardware to support that, however, as rumor is it currently takes Sora an hour to generate a minute of HD footage. To generate 30-60 frames per second in real-time? Yeah maybe a few hardware generations from now.

    • @MRTree-zz3wf
      @MRTree-zz3wf Місяць тому

      @@JohnSmith762A11B i mean just look what groq s chips can do

  • @Dygit
    @Dygit Місяць тому

    On your last comment of competitive games. Chess engines are significantly better than any person ever will be. Despite this, chess is still a common hobby and it is still played and watched by many people. Just because the AI can play those games better doesn't mean there is no more entertainment value in said games.

  • @blackstream2572
    @blackstream2572 Місяць тому

    Knowing that Google owns UA-cam, I wonder if one of the reasons they acquired UA-cam was to create the greatest data farm imaginable for the purposes of training AI. A quick google search (lol) turns up that youtube was not profitable at the time of acquisition and didn't become so until about 3 years later. I'm sure owning youtube had far more purpose than a long reaching goal like AI, but I still wonder if when they bought youtube they thought to themselves, "This is gonna come in handy later" or if it was much later when they were trying to train up AI they suddenly realized they were sitting on a gold mine of training data. I guess it's a gold mine of data that everyone has access to, not just google, but I'd imagine that only google has access to all the high quality 'raws'. If they even wanted them in the first place, I dunno how much of a difference it would make for training AI tbh.

  • @nothinhappened
    @nothinhappened Місяць тому

    Your voice should be an option in the ai settings dude

  • @TMichael66
    @TMichael66 Місяць тому

    Epiphany. If our world is just a simulation by incredibly advanced beings, just how intelligent and capable is their end goal? Godlike.

    • @DynamicUnreal
      @DynamicUnreal Місяць тому +1

      There’s a 50/50 chance that our universe is a simulation.

  • @MarcoServetto
    @MarcoServetto Місяць тому +1

    Many videogames are basically violence simulators. I'm ok with humans playing them, we are already violent by nature, and those can actually help us to 'box' this violence into a simulated environment.
    On the other side, taking those sophisticated violence simulators and using them to train super-intelligent AIs so that they can transfer those skills in the real world while controlling (kill?)bots.... well...... what can go wrong!