AlphaStar: The inside story

Поділитися
Вставка
  • Опубліковано 23 січ 2019
  • In recent years, StarCraft, considered to be one of the most challenging Real-Time Strategy (RTS) games and one of the longest-played esports of all time, has emerged by consensus as a “grand challenge” for AI research.
    Our StarCraft II program AlphaStar is the first Artificial Intelligence to defeat a top professional player. In a series of test matches held on 19 December 2018, AlphaStar decisively beat Team Liquid’s Grzegorz "MaNa" Komincz, one of the world’s strongest professional StarCraft players, 5-0, following a successful benchmark match against his team-mate Dario “TLO” Wünsch. The matches took place under professional match conditions on a competitive ladder map and without any game restrictions.
    Read more on our blog: deepmind.com/blog/alphastar-ma...
  • Наука та технологія

КОМЕНТАРІ • 749

  • @wdai03
    @wdai03 4 роки тому +461

    The alpha go documentary was pretty good, this would make a nice sequel

    • @robotec0007
      @robotec0007 4 роки тому

      there is already a documentation about alphastar

    • @xv179
      @xv179 3 роки тому +1

      @@robotec0007 whats the link?

    • @alexhp26
      @alexhp26 3 роки тому

      @@robotec0007 Where indeed?

    • @Demon-vq3pr
      @Demon-vq3pr 3 роки тому

      That was a AI vs whole country thing

    • @pmcg534
      @pmcg534 2 роки тому

      Is there? What’s it on?

  • @russellthorburn9297
    @russellthorburn9297 5 років тому +317

    I was gratified to see how gracious the players were in the face of such a defeat.

    • @edwardyoung8241
      @edwardyoung8241 5 років тому +14

      That really impressed me too. Although, maybe they edited out all the swearing!!! Hahah

    • @benjaminlavigne2272
      @benjaminlavigne2272 5 років тому +2

      "professionnal players"

    • @Unbiased321
      @Unbiased321 5 років тому +5

      Idra would have rage quit game 1

    • @SnOrfus
      @SnOrfus 5 років тому +4

      These guys got to be some of the best in the world on the backs of hundreds of losses. If course they would be pros about it.

    • @clickpwn
      @clickpwn 5 років тому +16

      in a game of starcraft, you learn more in games that you lose.

  • @TheAIEpiphany
    @TheAIEpiphany 3 роки тому +67

    We need a game called Alpha so that DeepMind can create AlphaAlpha in a truly alphaic way.

    • @xordux7
      @xordux7 2 роки тому +1

      or a game called BetaGamma

    • @marneninagavenkat7149
      @marneninagavenkat7149 2 роки тому

      You're there now, expecting that from you 😃😃

  • @elimurphy-trotzky1231
    @elimurphy-trotzky1231 5 років тому +204

    Being able to se the whole map at once is an incredibly massive advantage.

    • @loremipsum7513
      @loremipsum7513 4 роки тому +28

      They do cap it when it play vs pros

    • @dannygjk
      @dannygjk 4 роки тому +3

      Yes but it had fog of war iirc.

    • @ZLO_FAF
      @ZLO_FAF 4 роки тому +31

      @@dannygjk yes, but it can still see cloaked units. at least in the early versions. (there was review or a replay that showed AlphaStart instantly queuing an observer after it has seen a DT for like only a 1 second in it vision range. and APM for early versions was very hight. as much as 1500 apm with stalker micro is deadly, and it can select units any amount of units in whatever way it wants in very non-human-like way. in games vs TLO it selected only parts of army to target-fire TLO's units (carriers?) and it selected absolutely random units (can't do that with box selection) and selected perfectly enought units to one-shot TLO's carriers.

    • @dontgetmadgetwise4271
      @dontgetmadgetwise4271 4 роки тому +9

      @@ZLO_FAF Yes. Imagine how good it would be if the human constraints were lifted?! One second of visibility is a lifetime for a CPU.

    • @jessiejanson1528
      @jessiejanson1528 4 роки тому +21

      @@ZLO_FAF If their goal is to be the best StarCraft player, they failed miserably because they essentially are cheating. if their goal is to use StarCraft to make a better AI... only they could know if its happening. But increasing the difficulty to be more human like would certainly push the systems limits and force it to become better at playing. Hard to be impressed with it when its playing on easy mode.

  • @dr_flunks
    @dr_flunks 5 років тому +90

    Congrats DeepMind. You're an impressive team.

    • @ClipCourt
      @ClipCourt 4 роки тому +4

      True that really impressive indeed.

  • @ManjulaBandara
    @ManjulaBandara 4 роки тому +3

    Came here after the AlphaGo Full Documentary. Impressive stuff!

  • @AG-dj6bc
    @AG-dj6bc 5 років тому +31

    For the sake of us, i only hope that your ia safety team is the strongest of all.

  • @drconflict629
    @drconflict629 2 роки тому

    Please make this a full docu as well. Alphago was one of the best docus of the past years.

  • @marianpazdzioch6632
    @marianpazdzioch6632 5 років тому +5

    I like how Alphastar worked around APM limitation basically by saving up his available APMs for when they are needed most and then use them in bursts :)

  • @TheNightmoose
    @TheNightmoose 5 років тому

    I can't wait to see the progression! Sooner or later it should be able to play any race, against any race. It would be interesting to see if it prefers playing a certain race, or if it perhaps chooses dependent on certain maps or opponents etc

  • @tomchrysostomou4895
    @tomchrysostomou4895 3 роки тому +1

    Brilliant, brilliant, brilliant, Deep Mind has done it again! Well done, very impressive!

  • @sibyjoseplathottam4828
    @sibyjoseplathottam4828 5 років тому +2

    Great work. I think this will have applications in power system optimization.

  • @userNo31909580
    @userNo31909580 5 років тому +585

    I'm not yet completely satisfied in Alphastar.
    1) The APM cap has to be changed. Alphastar had lower mean APM than the human pros but in engagements its APM shot up to 1500's. That equals 25 actions in a second. No human player is capable of doing this with great precision. The APM should be capped in two ways. Firstly, the mean averge per minute as they did in this demonstration but more importantly, Alphastar should be restricted in such a way that the huge spikes are not possible. Perhaps a limit on how many actions it is allowed to do within a second?
    2) Especially in the games against Mana, Alphastar demonstrated inhumane ability to control its units. It won game 4 because of how clean its micro was, not because it outplayed Mana. Good army control is impressive and clearly requires a certain level of intelligence but this kind of perfect blink stalker micro doesn't really exist within the game. Deepmind should differentiate between the agents intent and execution. Perfect micro is more than just speed. Precision is much more important. Human pros missclick all the time. There needs to be a random element in how Alphastar controls its units.
    3) The agents seemed to be stuck on the strategies that they had trained in. I'm not entirely sure if this is the case but I think there was zero tech switches from Alphastar. It seemed to be stuck on the army compositions it initially chose. In a few games the composition was clearly sub-optimal considering what the human player had. Reacting to the scouted information and actually being able to flexibly adjust strategy on-the-fly is exactly the kind of intelligence that Deepmind should strive towards.
    While Alphastar is impressive and Deepmind limited its mechanical ability a little it was still very clear to someone familiar with Starcraft that it won mostly because of its superhuman mechanical ability. It could perceive all of its own units at the same time, it had superhuman mouse precision and macro abilities.
    TL;DR Cool but not quite there yet. Alphastar won because of superhuman mechanical abilities. I want to see a bot that plays as slow and as sloppy as the average pro player and still be able to achieve >50% winrate against the best in the World.

    • @ChristianSpliid
      @ChristianSpliid 5 років тому +29

      great observations. thanks!

    • @neoqueto
      @neoqueto 5 років тому +40

      I think that still the #1 thing that makes it not as impressive to me is the fact that the AI didn't have a visual input, or seeing what's displayed on the monitor, interacting with the UI - they basically modded the game so that the agent controls some triggers and reads a bunch of variables.

    • @userNo31909580
      @userNo31909580 5 років тому +55

      They will most likely never train an agent using only the unmodified visual input because the game simply can not run fast enough. These agents needed the equivalent of 200 years of gameplay. Playing SC2 in realtime just takes too long.

    • @diradosveta
      @diradosveta 5 років тому +21

      I wonder if Alphastar would put its tl dr to the end of its comment

    • @MusicPerusal
      @MusicPerusal 5 років тому +5

      @@neoqueto Well yeah... It's a computer.

  • @raidiniom22
    @raidiniom22 5 років тому +235

    Alphastar vs OpenAI

    • @martiddy
      @martiddy 5 років тому +19

      That would be great to watch

    • @AdityaSingh-lp5rp
      @AdityaSingh-lp5rp 4 роки тому

      With unlimited power

    • @tonglu3699
      @tonglu3699 4 роки тому +12

      Don't you give them ideas! If they end up learning from each other, that would be the end of us.

    • @ivoriankoua3916
      @ivoriankoua3916 4 роки тому

      @DarkGrisen if you really think so you're funny , you do think serously Google is going to invest $500Million on a company just to play game ....think a little , I could give you clue if you want but try to think deeply about it.

    • @dsm091
      @dsm091 4 роки тому

      @DarkGrisen I am thinking the machines they are using is their quantum beast letting it learn all it can. It needs to make them money. Micro targeted ads to a single person is their goal.

  • @dosomething6975
    @dosomething6975 Рік тому

    Keep up the good work! You have no idea the smile you bring to the faces of those who love to see technology advance! Thank you for all the hard work! Love it!

  • @lucaslopesf
    @lucaslopesf 5 років тому

    I love this videos, keep updating us of the backstage

  • @rodrigoserafim8834
    @rodrigoserafim8834 5 років тому +92

    I am glad our AI overlords are learning so quickly to defeat our puny human armies. I also hope they learn to read youtube comments so they know how much us loyal subjects love them.
    bº*r#i+n$g h)e]l&p
    sorry for that, must have pressed my elbow against the keyboard.

    • @OsvaldoBayerista
      @OsvaldoBayerista 4 роки тому

      X2.

    • @t-.-t.
      @t-.-t. 4 роки тому

      XD

    • @zissler1
      @zissler1 3 роки тому

      I can’t wait for them to take over I’m sure they’re intelligent and will let me be an ambassador.

  • @clementfouquet2483
    @clementfouquet2483 5 років тому +3

    Congratulation on that achievement DeepMind team. Can't wait to read more about your model when you'll release a paper later.
    I wonder if you developped a macro strategy policy that gives short-term objectives to a micro policy ? or if you have only one policy network coupled to a LSTM for memory ?

  • @rodney7150
    @rodney7150 5 років тому +1

    Oh my god, this video gave me the shivers. Awesome

  • @bigchunk1
    @bigchunk1 5 років тому +21

    This work inspires me to get into computer science.

    • @Oscar-if6lq
      @Oscar-if6lq 4 роки тому +8

      Getting into mathematics first is probably more important than Computer Science if you want to do something like this.

  • @kwanarchive
    @kwanarchive 3 роки тому +3

    The thing about AI that people underestimate is that the volume of automated training can quickly help an AI to overcome the mistakes in its learning.
    With humans, it's very hard to convince someone they're wrong, let alone change someone's mind, and often you just have to breed new humans and hope the old ones die off fast enough so that their mistakes don't get meaningfully passed on to the next generation.

  • @Loppy2345
    @Loppy2345 5 років тому +79

    Vote up if you want to watch AlphaStar vs Serral

    • @o0NeoTDN0o
      @o0NeoTDN0o 5 років тому +2

      The AI doesn't play against Terran or Zerg yet.

    • @soulclean1983
      @soulclean1983 5 років тому

      February 15 2019 is the day.. for this great battle

    • @AdityaSingh-lp5rp
      @AdityaSingh-lp5rp 4 роки тому

      There is one

    • @AdityaSingh-lp5rp
      @AdityaSingh-lp5rp 4 роки тому +1

      ua-cam.com/video/_BOp10v8kuM/v-deo.html

  • @ClipCourt
    @ClipCourt 4 роки тому +1

    Major Fan of AlphaStar overcoming programming complexities for a better future.

  • @triplea657aaa
    @triplea657aaa 5 років тому +6

    I know it had superhuman micro, but let's talk about how amazing it is that it plays human strategies so well, and plays like a human.

    • @calgar42k
      @calgar42k 4 роки тому

      Let s just hope AI never do moral judgment like humans are doing! Because your value could very well be considered 0.

    • @PereCatou
      @PereCatou 3 роки тому

      @@calgar42k lovely...

  • @rosscof3660
    @rosscof3660 5 років тому +5

    Amazing and scary at the same time...

  • @rodafy9110
    @rodafy9110 3 роки тому

    absolutely incredible work. would love to see this taken to a team-based game like dota 2, and see if a machine learning bot can climb to the highest rank in the solo queue of that game too. presents a new challenge with the addition of having to cooperate with unpredictable and unreliable human teammates to achieve victory, in five different possible roles with hundreds of heroes and millions of unique team configurations and items and so on.

  • @seventeendegree
    @seventeendegree 5 років тому

    Fascinating!

  • @akamezo
    @akamezo 5 років тому +2

    Now it is the time to see the clash of A.I : OpenAI Five VS DeepMind AlphaStar .

  • @baileyhallfilms
    @baileyhallfilms 9 місяців тому

    so fascinating

  • @nicoladube4175
    @nicoladube4175 3 роки тому

    the best training coach for the pros out there in my honest opinion. Give them few weeks of fighting the A.i and let them loose against humans after; i predict a win for those who trained and fought with A.i

  • @xabashdog
    @xabashdog 5 років тому

    I love Reinforcement Learning and its variants, hopefully would be working with you guys or somewhere else if not, creating agents that surpass humans by far! 😊

  • @RepsUp100
    @RepsUp100 5 років тому +1

    They are coming!

  • @thejuiceweasel
    @thejuiceweasel 4 роки тому +2

    Imagine a grand tournament held each year where the best players in each e-sport try to beat such an AI. I'm sure that would sell some tickets.

  • @AzOuLs
    @AzOuLs 5 років тому

    To many nerds together.I am afraid of what they can create next. Keep doin a good job

  • @Alex-qn9og
    @Alex-qn9og 5 років тому

    Very interesting, I hope you can perfect SC2

  • @krallis123
    @krallis123 5 років тому +47

    I think it's extremely cool what you're doing but I'd be interested in knowing exactly what reaction time you used for AlphaStar and also I think you said it was performing at 500APM, I think it would be interesting to see how it changes and adapt when you turn down the APM.
    How does it behaves at 450? 400? 300? I think there are a lot of extremely cool observation that can be done by looking at AlphaStar and especially kind of see where the victories come from, of course it will be a mix of strategy and mechanics, I'm curious to see what heppens when gruadually limiting more and more the "mechanical" skills (APM) of the machine.
    Anyway really solid work, keep it up!

    • @synchronium24
      @synchronium24 5 років тому +6

      @1Alino"APM is not a configurable parameter for this AI. " They said in the video multiple times that there is a cap on AlphaStar's APM.

    • @solidpain9098
      @solidpain9098 5 років тому +1

      They have limited (or trained) it to have 300 APM overall (it can peak if it needs to, but it has to get an overall APM of about 300). Without any APM limitation it would beat ass a lot more.

    • @benjaminlavigne2272
      @benjaminlavigne2272 5 років тому

      300 average apm

  • @juno1483
    @juno1483 5 років тому

    They're going to be everywhere!

  • @JohnMcCullough97
    @JohnMcCullough97 4 роки тому

    Fascinating!! Looking forward to where this type of AI leads us.

  • @TahaNasser
    @TahaNasser 4 роки тому

    A remarkable feat no doubt, but it would have been great to see AlphaGo face the top 5 in the world including Serral with their own mice and keyboards etc. It makes a big difference.

  • @webcrawler9782
    @webcrawler9782 5 років тому +5

    maybe worth mentioning: Mana beat AlphaStar on the live stream match afterwards

  • @VramsGamingChannel
    @VramsGamingChannel 5 років тому +7

    It's amazing how calm these pros are when they lose. I get flustered and upset and if I lost 5-0 I'd feel humiliated. They let it slide off like water to a duck's back.

    • @dannygjk
      @dannygjk 5 років тому +2

      It's exciting to them to compete. You cannot reach your full potential if the most important thing is winning.

    • @nahblue
      @nahblue 5 років тому

      @@dannygjk I love that they don't give up when they are down either. They have a strong mental game, and they really want to win (just look at Mana going at it in the showmatch), but handle the losses too.

    • @B1gLupu
      @B1gLupu 5 років тому +2

      It's almost like they do it for a living and are used to losing to top players

    • @deadwingdomain
      @deadwingdomain 4 роки тому

      Have you ever played the AI in star craft? It always been brutal.

  • @jonathanwalther
    @jonathanwalther 5 років тому +8

    Model human decision making. Model an army. Model a map. Use enough time and computing power. The military is already knocking.

  • @cjfletcher325
    @cjfletcher325 5 років тому +3

    It can see the whole map? That has to be the most important and difficult
    Challenge to over come IMO.

  • @pmcg534
    @pmcg534 2 роки тому

    The alpha go movie was one of the best documentaries I have seen.

  • @nkdms.2031
    @nkdms.2031 5 років тому

    Are you planning to do the same for Warcraft 3? There is defo a need for fresh strategies in the game so it might be a no brainer :)
    Great job!

  • @madmotorcyclist
    @madmotorcyclist 5 років тому

    Interesting video. Reminds me of the old early days of AI back in the early 80s with LISP machines.

  • @PurpleBraveGiraffe
    @PurpleBraveGiraffe 4 роки тому

    You guys have the best job ever...

  • @william_8844
    @william_8844 4 роки тому

    Getting gouse bumps of excitement watching this

  • @zillboy
    @zillboy 5 років тому

    Wow!😃 I got a really big simple during the match and when AlphaStar won the matches

  • @abliviax
    @abliviax 5 років тому

    Impressive deep mind team, this is very cool and exciting! I think the improvement between TLO games and Mana games were improving the mechanics to beyond-human levels. Do you plan to scale back the "effective APM" to more human levels now that it is hitting like 1200-1500 apm (mostly effective, I assume?) in one reply I watched.

  • @leematthews6812
    @leematthews6812 3 роки тому

    I've been running Fold@Home on my PC for years, and AlphaFold has leapfrogged over any previous efforts by a wide margin. As with any technology, the applications have good and bad prospects. Let's hope the good outweighs the bad in future.

  • @crypto_div
    @crypto_div 3 роки тому +7

    This is like watching the scientists in Jurassic Park hold a baby T-Rex and not realizing that one day it’s going to grow up and eat them.

  • @yorkshire_tea_innit8097
    @yorkshire_tea_innit8097 3 роки тому +1

    Alphastar definitely plays to his strengths. Which are micro and multitasking.

  • @xiangyizhang1849
    @xiangyizhang1849 5 років тому +6

    After watching the games, I think the limitation should be imposed on EPM not APM. As a fan who has watched starcraft games since 2009, I would say no one ever could do the micro-control like AlphaStar did to Phenix and Stalkers. For a human player, select more than three target units instantly is very tricky. When human players tried to do control like this, they might be failing to select any unit, where the action is counted into "APM" not "EPM". Numerous useless actions always happen during a game for human players.
    My conclusion is DeepMind considers the fairness in terms of APM's quantity, but they should have introduced another aspect which is the quality of "APM".
    The solution is simple, either switching to EPM or gives a probability (close to human players) of mis-operation.

  • @caulijutsu1575
    @caulijutsu1575 5 років тому +18

    They shouldn’t allow the computer to see more than what a player can. Make the computers only input the output of the screen.

  • @desven123
    @desven123 5 років тому +8

    I would love to see some games AI vs AI, just to see what happens

  • @williamgoo7621
    @williamgoo7621 5 років тому +33

    If only TotalBiscuit is still alive today to cast this match.

  • @zengamer321
    @zengamer321 5 років тому +3

    The two big things are APM spikes that look normal but are completely impossible because of the precision and camera.

    • @kethmarhkfy7luf.263
      @kethmarhkfy7luf.263 5 років тому

      naw it spiked to 1500, that isn't even normal. Nobody clicks 30 times a second.

  • @cybervice1125
    @cybervice1125 5 років тому +2

    Guys I watched the live stream and on the oversaturation on probes, maybe the tought process of the agent was that the enemy will attack me with a few units> I loose X numbers of probes> hence I make more probes. We saw that the agent was at 24 probes when TLO attacked with 2 adepts and after the attack the agent had 17 probes in main and another 3-4 going for the expansion...

    • @danielbigham
      @danielbigham 5 років тому +1

      I wondered the same thing. Good thought. Another: Once you do expand, you can immediately jump to having 7 probes at it.

    • @elmohead
      @elmohead 5 років тому

      haha you can see MaNa oversaturating his minerals from game 2 onwards as well. Seems like oversaturation will be a thing in the future. It prevents your income from dipping when getting harassed.

    • @LyubomirIko
      @LyubomirIko 5 років тому

      And it brings slightly more minerals too!

    • @pliskenmovie
      @pliskenmovie 5 років тому

      Artosis did a full stream analyzing the games, and really zeroed in on the oversaturation of probes. It's about a 10% boost in income, and makes mineral line harassment less effective. It does however limit a few early options. Also, MaNa did a stream analyzing his gameplay against Alphastar, and was a little annoyed at the insane precision displayed by the AI. In his last game that he actually did win (when the agent wasn't allowed to see the entire map at once), him and TLO strategized that they could never match Alpha in micro, so they figured an army of brute strength would win. Not only did strength carry the game, but MaNa was definitely able to confuse Alphastar and exploit its lack of understanding.

    • @elmohead
      @elmohead 5 років тому

      @@pliskenmovie I watched MaNa's commentary, haven't watched Artosis'. But what you mentioned makes sense about the extra workers. It's good if you wanna play macro and have set builds (AlphaStar).

  • @ronaldronald8819
    @ronaldronald8819 3 роки тому

    This is Amazing! Whats next?

  • @alexanderyell4693
    @alexanderyell4693 5 років тому

    The only issue is yes the actions per minute are human like but it if go to effective actions per min during engagements the alphastar reached numbers of 600-800 per minute while mana was at about 400. Effective actions per minute ate the ones that matter.

  • @frederikspitra7832
    @frederikspitra7832 5 років тому

    Well, you forgot that Mana won against the Agent who was not allowed to be everywhere on the map at the same time, although more to it glitching out than that.
    Still, good work. Lets see where this will go.

  • @anilkumarsharma8901
    @anilkumarsharma8901 Рік тому

    Are you able to differentiate any equation🔔 upto infinity???

  • @wildwest1832
    @wildwest1832 5 років тому

    needs to play all matchups and on all maps. Needs to move camera and have same apm and reaction as person. It needs to prove it can outplay a person on a level playing field. That is the true test of AI. I am already impressed though it plays very human like

    • @davidwuhrer6704
      @davidwuhrer6704 5 років тому

      That is what they will try next: Have it need to move the camera. They already restricted reaction time and APM, though maybe they didn't restrict it in the right way.
      As they said: They didn't expect it to win already.

  • @fg786
    @fg786 3 роки тому

    Can this AI be used for developers to balance their game before relase and for future expansions, or would the players and AI ability be so different, that the balance for the AI would in the end lead to unfair plays players would use?

  • @gembocobo9484
    @gembocobo9484 3 роки тому

    Imagine if they Dev a tilt focused build for alpha star or whatever variant they make for dota 2 or lol or maybe even csgo valorant etc

  • @infinitejest9978
    @infinitejest9978 5 років тому

    Nice to see humans that outsmarted other spicies with their tools are now been outsmarted by that tools.

  • @achyuthvishwamithra
    @achyuthvishwamithra 2 роки тому

    David Silver is an inspiration to many 🙌

  • @michaelbradley7447
    @michaelbradley7447 4 роки тому

    Good job you'll do great for the world

  • @vantagepoint6344
    @vantagepoint6344 5 років тому

    There needs to be a clear APM cap basing on average APM sort of hides it's APM spikes during fights. We know it's super precise I have no issues with that. Just keep the APM max respectable maybe 500-600 peaks given its precision and make it move the camera . If these 2 things are sorted we'll have a damn fair fight

  • @typhoon320i
    @typhoon320i 3 роки тому +1

    I can't wait for it to be tasked with material science innovation. i.e. "We need a material that has 1000x the tensile strength of steel, but flexible like fabric...."

  • @quentinlauterbach
    @quentinlauterbach 5 років тому

    The Pros looked somewhat misstreated, since they kind of know that right now they got outplayed more by mechanical precicion and efficiency rather than straight up strategy. So if they can balance for example the APM in engagements to somewhat match the physical capabilities of a human being it would be more comparable.
    Nevertheless its needlessly to say that the AI already is very impressive and I´m looking forward on keeping an eye on Deeplearning for RTS and other types of games!!

  • @XOPOIIIO
    @XOPOIIIO 3 роки тому +1

    Even if you can make the same amount of clicks, you're still have an advantage by being able to think 1000 times faster. It's not the amount of clicks that matters in Starcraft, it's how valuable and precise they are.

    • @kvazau8444
      @kvazau8444 3 роки тому

      that just shows the intelligence is better, which is the goal.

    • @bighands69
      @bighands69 2 роки тому

      @ХОРОШО
      The processors are working thousands of times faster but not the decision making which is at human levels.

    • @XOPOIIIO
      @XOPOIIIO 2 роки тому

      ​@@bighands69 No, it's not. It's still superhuman in speed. Neural Network doesn't learn to be fast, in fact from it's subjective point of view the game doesn't run at all, it just wait's for it's decision.

    • @bighands69
      @bighands69 2 роки тому

      @@XOPOIIIO
      The ai works by using search algorithms and those were at human levels of search. DO not confuse the cycles of the hardware with the actual decision making of the ai.
      Humans because we have a visual cortex can search large numbers of visual patterns and add weight to various parts of the search the ai does not have that advantage.

    • @XOPOIIIO
      @XOPOIIIO 2 роки тому

      ​@@bighands69What do you mean by human levels of search? Is it human level to you to play 200 thousand ingame years in couple of hours? Because that is what they actually did. AI have visual cortext too, it's called Convolutional Neural Networks, just not this particular AI, because in this game it's useless to see units in all their animation instead of a single point on the map, so they simplified it.

  • @user-ss7il9ph6s
    @user-ss7il9ph6s 5 років тому

    Awesome

  • @jaidenrichard99
    @jaidenrichard99 5 років тому

    I can see overfitting problem of undetermined (hidden) situation on every replay game. How can solve this.

  • @pororo5249
    @pororo5249 4 роки тому +5

    DeepMind had to consider Korean players with Starcraft 1 (remastered).

    • @kwanarchive
      @kwanarchive 3 роки тому +1

      Korea has suffered enough at the hands of DeepMind already :)

  • @Xinvoker
    @Xinvoker 5 років тому

    10/10.

  • @AngelLestat2
    @AngelLestat2 5 років тому +3

    *Do not call victory yet* Alphastar needs to wind using the same information input and control output than players use, that should not be hard to achieve using different neural networks for visual recognition and interface to what alphastar knows and another neural network to link proper mouse movements to what alphastar expect to do.
    Without that, we never know how many action by minute is alphago saving or if still doing some kind of cheat by map focus knowledge or minimap.
    You can use all the processing power you need (it would not be much even with this addoms and you can keep training without these ANN interfaces).
    This will allow alphastar to play a normal version of starcraft 2. *Challenge Accepted?*

    • @MsHojat
      @MsHojat 5 років тому

      I don't think that's going to happen, especially if it involves using a physical keyboard and mouse rather than simulating mouse and keyboard inputs. Although the visual recognition would probably be the worst/most-challenging thing to deal with.

    • @AngelLestat2
      @AngelLestat2 5 років тому

      @@MsHojat it is easy to achieve, there are already thousands of neural networks that recognize image and even context in those images, and they add a description in text like "2 kids playing with his dog with a ball", and this was accomplish in 2015, here is way more easier, the neural networks just need an interface to link what it already knows, like units, buildings and terrain features. Trust me, that is super easy for them in real time, check in youtube image recognition in real time.
      The keyboard mechanics is just a link to the actions, and the mouse mechanics should use another neural network to link the action with proper movements.
      Of course that for learning and training the main strategic neural network should do it in their special software in which it can play thousands of games by day.
      But what I am suggesting are just neural networks that it would act as interface.
      The first old games that deep mind learned to play, they receive each pixel of information and the controls and figure out all from there, which is more complex of what I am suggesting.
      Check this channel:
      ua-cam.com/users/keeroyzvideos
      In fact, the thing it would be a pain of the ass to design and build for them, is the mouse external mechanism,

    • @kethmarhkfy7luf.263
      @kethmarhkfy7luf.263 5 років тому

      Uhh no, the best end here is you put it into a completely separate game and it wins the first match against pros.
      That is the end goal, general AI.

  • @beasthundred4709
    @beasthundred4709 5 років тому +2

    Come to Korea. Revenge match in Starcraft for Lee Sedol!!!

  • @penguinista
    @penguinista 5 років тому +2

    It will be interesting to impose human-like limitations on an AI, like clicks per second limitation, innate imprecision, etc. We could find out if the AI 'brain' was beating the human brain or if it was winning based on speed, precision, multi tasking, etc. But we won't impose those restrictions on AIs we employ to address real world problems, so I am also interested in how unrestricted AI does against the best humans.

  • @bebop417
    @bebop417 5 років тому

    1:58 thats obviously not true from gameplay footage. It's average apm is lower for good reason but it still spikes absurdly high during crucial moments like combat micro. Also players use actions differently than a perfect ai, like spamming keys for example, so a lower apm for the AI would seem to happen naturally.

  • @bigdaddyrazor
    @bigdaddyrazor 3 роки тому

    This Documentary is gonna be BIG! (Am I the only one hyped?)

  • @eddiegohwj
    @eddiegohwj 5 років тому +8

    So many ways the game could be rigged to the AI's favour. This is not Go or Chess, whereby reaction time and visual perceptions weights so much in real-time strategy game.
    Use BostonDynamics and build some arms & eyes, and play on the fair ground & same inputs (mouse and keyboard) as human players. Dont even have to limit the robot's mechanical capabilities (APMs and response time), and i will be convinced.

    • @davidwuhrer6704
      @davidwuhrer6704 5 років тому

      They certainly would have to limit the robot's mechanical capabilities. Robot actuators are much faster, stronger, and very much more precise than human motor control. Plus, reaction time: Human reaction time is on the order of 200 ms. Robot reaction time is below 1 ms.

    • @ZLO_FAF
      @ZLO_FAF 4 роки тому

      @@davidwuhrer6704 Robot will still have to check what are those dots on minimap. and will not be able to spot cloaked units while his screen is elsewhere

  • @abinsharaf8305
    @abinsharaf8305 2 роки тому

    well fog of war is one of the main criterias in these games.. if computer has full knowledge then there is no fight here.. kudos to the pro players for accepting such a challenge. these guys needs to get a new standard for testing their AI

  • @socrates_the_great6209
    @socrates_the_great6209 3 роки тому

    Where can we see the replays?

  • @icedanilzation
    @icedanilzation 5 років тому

    What game would be next level up for ai?

  • @ReasonMakes
    @ReasonMakes 5 років тому +47

    Alphastar appears to have won because of its superhuman mechanical ability to see and control its units at all times rather than a superhuman mind.
    Mouse movement speed, visible units on-screen, Actions per SECOND, precision, reaction time - all of these mechanical abilities need to be taken into consideration much more seriously/restrictively if we want to develop a Deep MIND rather than a technique impossible for humans to execute. For me, the excitement around AI is the intelligence, not the aimbot.
    Lovely project and clearly a lot of excellent work so far but personally it looked very unfair to the pros.

    • @bobedwards8896
      @bobedwards8896 5 років тому +1

      Agreed. And I think it's pointless to compete an ai v human. If course the ai will win, the game itself only has so many viable styles and ways to win. It's not hard to find out those ways. Especially if you can do hundreds of thousands of games to learn

    • @Moonz97
      @Moonz97 5 років тому +1

      AlphaGO achieved the deep MIND part, where mechanical skill isn't part of the equation, but I agree its not fun playing against an aimbot

    • @ReasonMakes
      @ReasonMakes 5 років тому

      @@bobedwards8896 I think playing against AI is an amazing opportunity. The fastest way to learn is to play against people better than you, but for the pros there is no one better than them. Could you imagine how beneficial it would be if you got used to playing against AI that is to pros as pros are to mid-tier human players? You would become superhuman in your strategy. But only if the AI is playing by the same rules of our world. In real-life you cannot move your hands and fingers fast enough to achieve the 1000+ APM that Alphastar exercised at some points, so the AI can use that unfairly and it can also enable the AI to be lazy with its builds. It would be very educational for human pros to see what an AI would do with the same limits that humans have in terms of strategy rather than relying on things like flawless micro

    • @ReasonMakes
      @ReasonMakes 5 років тому

      @@bobedwards8896 I would also like to add that SC2 is similar to Chess and Go in that although the rules are finite and relatively easy to understand, actual strategies are endless. Perhaps there is an OP strategy that we simply have yet to realize. AI could pioneer those for us since it is able to play hundreds of games simultaneously and gain more experience - and insight - than a human ever could

    • @AlfalfaQc
      @AlfalfaQc 5 років тому +5

      @@user-yd6qk6nk2i It sees the complete map but only what's actually visible to its units and building. It doesn't see through the Fog of War. I agree it's still a slight advantage to be able to see the whole map but it's still incomplete information as in it doesn't know what the opponent is doing.

  • @christopherarmstrong2710
    @christopherarmstrong2710 4 роки тому +5

    1:40 “Alcohol is not just to defeat these players. Alcohol is to do it in the right way.” Wait, there was drinking involved?

  • @vadimbakaev2099
    @vadimbakaev2099 5 років тому

    When we can see Zerg?

  • @s.czerniawski789
    @s.czerniawski789 5 років тому +16

    The comments about unrealistic APM/micro are missing the big picture. Once there's a system that can reliably beat pro human players (by "cheating" or otherwise) they can use it as a BENCHMARK to compare to. A benchmark which is much more convenient to use than inviting individual players. You can't get 100 pro players to show up on 3 second's notice and have them play consistently 24/7 for a week...
    Once they have that they can work on adding more human like constraints, if they find it useful.
    Also the idea that the AI has to be as constrained as humans are is just as silly as objecting that the first planes were allowed to be much bigger than birds and ran on gasoline instead of seeds.
    We're not trying to replicate birds or human players. We're trying to build something that does not exist yet.

    • @ericnathanstucky246
      @ericnathanstucky246 5 років тому +1

      S A Y I T L O U D E R F O R U S I N T H E B A C K

    • @illarionbykov7401
      @illarionbykov7401 4 роки тому

      Nope. It's cheating to grab headlines by big corporate/university teams. The same BS happened with chess. It took another decade for small, independent AI people to get fair wins against top humans in chess (compared to IBM Deep Blue's rigged so-called "win" over Kasparov)
      In the Japanese chess (shogi) world, the professional shogi association made strict rules to prevent this kind of BS, barring pro players from accepting rigged matches vs. AI, and forcing fair matches only, so it took AI an extra 2 decades to declare "victory" over top pros in shogi compared to chess. The difference of a fair contest can be that big.

    • @dannygjk
      @dannygjk 4 роки тому

      @@illarionbykov7401 Incorrect, I have been following computer chess since 1981 and your claims are false.

  • @trumpsama3510
    @trumpsama3510 5 років тому +27

    I'd like to see the AI try to play a team of pros at the same time

    • @o0NeoTDN0o
      @o0NeoTDN0o 5 років тому +1

      AI vs 4+ pro players?

    • @bobcat5844
      @bobcat5844 5 років тому

      Id like to see them play top Korean Protoss players

    • @HidingOverHere
      @HidingOverHere 5 років тому +2

      Id like to see a single AI with different strategies instead of 10 different AIs like they did in this demonstration

    • @skrrpapa2936
      @skrrpapa2936 5 років тому

      2falconpunch There is a huge difference between MaNa (Top 3 foreign protoss) and a player like Stats (best protoss in the world) (or sOs/Zest).
      I guess you arent into the sc2 pro scene but the difference in skill is actually massive especally between these 2 (MaNa - Stats)

    • @skrrpapa2936
      @skrrpapa2936 5 років тому

      2falconpunch What does this Change about Mana not being even Close to the Level of Stats??? Like i didnt even say it's Micro was human lmaooo

  • @cute64627732
    @cute64627732 5 років тому

    Please invite Maru, Serral, Stats, Rogue!!

  • @jelofsson
    @jelofsson 5 років тому +1

    I think that they should try to make Alphastar win against human while using as low APM as possible, in my opinion I would be awesomely cool if they set that as the goal condition for Alphastar. Imagine to see it beat a human while its mean APM are at 60.

  • @ralfanari8854
    @ralfanari8854 5 років тому

    They should do this again without switching agents and having multiple races playable. That would better showcase decision making over unit control and flexibility against being metagamed, also would showcase more of the situation that happened in the game it lost, where the human found an exploit. I know that letting people mine for exploits is less likely to give them headline material, but if their work could withstand all that, they could make the claims the headlines are making with a clean conscience.
    (edit) the headlines say "ai beats top humans 10-0" which is true and VERY impressive, but it seems to also give the vibe(to laymen at least) of them having solved the game in the same sense they have with chess and go and I don't think that is the case.

  • @adubizon2243
    @adubizon2243 4 роки тому

    But can it defend a cannon rush in 2v2 with a teammate unwilling to do anything but get BCs?

  • @rantallion5032
    @rantallion5032 5 років тому

    I would love a real discussion about how the Alpha star played by the developers. also i think it is interesting that AS overbuilds drones - is this the emergence of "superstitious" behavior in AI?

    • @davidwuhrer6704
      @davidwuhrer6704 5 років тому +1

      It doesn't overbuild drones.
      It loses a few of them when it's first attacked, and has the optimal number afterwards.

    • @rantallion5032
      @rantallion5032 5 років тому

      @@davidwuhrer6704 it overbuilds according to current strategy. just like superstition sometimes it works.

    • @davidwuhrer6704
      @davidwuhrer6704 5 років тому +1

      @@rantallion5032 AI can certainly be superstitious, and you'd find numerous examples (though not always called superstition). I don't think this is an example of it. I could be wrong.

    • @rantallion5032
      @rantallion5032 5 років тому

      @@davidwuhrer6704 a superstition is a reaction to a stimulus but not understanding its cause. see skinner's pigeons. i think it is pretty close. this is also the start of religion IMO

    • @davidwuhrer6704
      @davidwuhrer6704 5 років тому

      @@rantallion5032 Yes, it's acting on a correlation that may or may not be a relation. As I said, AI is in principle susceptible to that. For religion you also need paranoia, which can be reproduced easily with neural networks by increasing the duration for which the neurons stay activated. You would not add that to a productive system unless you specifically want to study paranoia.

  • @karstafarius
    @karstafarius 5 років тому

    I want to see Serral vs AlphaStar

  • @mariaveenema4337
    @mariaveenema4337 5 років тому

    They should have picked Zerg as a main race. Fits better thematically I feel. DeepMind being the Overmind. The hive itself.

    • @pliskenmovie
      @pliskenmovie 5 років тому +1

      I don't even want to think about Alphastar micro'ing a horde of zerglings with absolutely perfect surrounds.

  • @abcdxx1059
    @abcdxx1059 5 років тому

    0:04 ?? Not tensorflow or sonnet what are you guys up to ?

    • @parskatt2971
      @parskatt2971 5 років тому

      What language is that? I don't recognize it.

  • @icc7459
    @icc7459 3 роки тому

    Please come to Korea !! just like alphago with sedol Lee. There are numerous pro star players in Korea such as yohan Lim, Hong Jin-ho. If you do, it will be mega hit just like alphago~