EA’s New AI: Next-Level Games Are Coming!
Вставка
- Опубліковано 25 лют 2023
- ❤️ Check out Weights & Biases and sign up for a free demo here: wandb.com/papers
📝 The paper "Learning Soccer Juggling Skills with Layer-wise Mixture-of-Experts" is available here:
www.cs.ubc.ca/~van/papers/202...
My latest paper on simulations that look almost like reality is available for free here:
rdcu.be/cWPfD
Or this is the orig. Nature Physics link with clickable citations:
www.nature.com/articles/s4156...
🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Aleksandr Mashrabov, Alex Balfanz, Alex Haro, Andrew Melnychuk, Benji Rabhan, Bryan Learn, B Shang, Christian Ahlin, Edward Unthank, Eric Martel, Geronimo Moralez, Gordon Child, Jace O'Brien, Jack Lukic, John Le, Jonas, Jonathan, Kenneth Davis, Klaus Busse, Kyle Davis, Lorin Atzberger, Lukas Biewald, Matthew Allen Fisher, Matthew Valle, Michael Albrecht, Michael Tedder, Nevin Spoljaric, Nikhil Velpanur, Owen Campbell-Moore, Owen Skarpness, Rajarshi Nigam, Ramsey Elbasheer, Richard Sundvall, Steef, Taras Bobrovytsky, Ted Johnson, Thomas Krcmar, Timothy Sum Hon Mun, Torsten Reil, Tybie Fitzhugh, Ueli Gallizzi.
If you wish to appear here or pick up other perks, click here: / twominutepapers
Thumbnail background design: Felícia Zsolnai-Fehér - felicia.hu
Károly Zsolnai-Fehér's links:
Twitter: / twominutepapers
Web: cg.tuwien.ac.at/~zsolnai/ - Наука та технологія
This is just amazing, I can foresee amazing applications of this paper. What a time to be alive.
What a time indeed..like being witness to the birth of humanity's anti-christ.
@@Substance2020 Wth why are you quoting that.
$20 to unlock this feature.
They'd never allow something like this for a one time purchase. They'd make it a subscription for sure.
Monthly
😂🤔💸
*$40
I’m coming back to tell you EA has laid off 200 testers over a Zoom call.
It's probably ea's second project, the first is an ai capable of creating the most despisable and profitable microtransaction model, along with all possible solutions to press developers to publish unfinished games.
They don't need AI for that, it is in their nature
I remember that Red Dead Redemption 2 tried to implement some of these techniques to make the animation look more real. But this is really impressive. Imagine a game where no movements are scripted, but purely generated by the brain of the character. We have all seen how characters have to position themselves to e.g. operate a door handle and the whole sequence is scripted once the character is in the correct position. Would be awesome if future games just had fluent motion and manipulated the world without having to stand and a perfect spot to do its things.
I think you're thinking of Euphoria, a tech that Rockstar has been using since GTA4. It is not based on machine learning but rather is based on contraints and basic Ai scripting. Euphoria based characters have much more self-preservation than this but has a much smaller animation dataset. Look Force Unleashed 2007 tech demo for great examples of what Euphoria could do even 15 years ago.
Oh yeah it is a more compelling example than football jungling actually
Rockstar Games didn't used AI for the animations. They just scripted a way to blend many different animations together. So to be able to not just start & stop an animation. Instead the bones are transitioning to the new position they supposed to go to before actually playing the animation. It's a common way in modern AAA games to do that. But what makes RDR2 so realistic there is the huge amount of different animations and accurate recordings of those from real fitting motion capture data.
@@MrGTAmodsgerman Mmm no... They used the Euphoria middleware for character animations, look it up on YT.
@@guillermojperea6355 I know what Euphoria is. But that have nothing do with what i said. You can kick out a lot of realism if you have a huge amount of animations. You better watch the documentation of RDR2 on YT
As an animator and soccer player, the animation of the previous technique looked better, because it was taken straight from the motion capture, while the AI-driven physics-based one has some really unnatural poses and upper body movement. But the technique is amazing and, as a game developer, I can't wait to see where it goes two papers down the line.
I think what's amazing here is how it can learn to manipulate the physics in the simulated world. Mix that with some beautiful handmade or motioncaptured animations with some leniency to allow the AI the freedom to control the ball and you'd get the most accurate simulation ever.
@@neoshenlong up!
@@neoshenlong I think there's no need for hand made animation. You just need to tell it how the body parts should work. I think it's a matter of simulation.
That's why motion capture will have no place in this. I think motion capture is used for simpler workflow but AI should be able to handle it when you simulate the body.
I also noticed that the foot moves unnatural and in a repetitive way. It moves slightly then a bit more. The movement doesn't also seem to affect the posture etc. It's also likely the top of the foot/shoe itself isn't modeled in its exact 3d shape so the ball isn't affected by the foot as it should be. But these are all problems that can be solved easily.
This is exactly what I was anticipating since deep learning AI has been a thing. This technique will benefit so many games and 3D simulations altogether.
So, I prefer the previous motions derided at the beginning. The new method's motions seem very stiff and not lifelike at all. I usually am blown away by the progress, what am I not seeing in this one?
Absolutely agree with you here. The previous animations are deemed more life-like by me. Maybe the mentioned measures (transitions and foot-ground contact) are better done by the AI, but the overall impression is worse.
Exactly, the current EA stuff is not perfect but still looks much better.
The camera is what's jerking a bit at some moments. Still, Karoly put it like it was terrible and the new one was oh so much better while it was obvious that it's not the case at all, though we can acknowledge what the new system is achieving.
That's because Karoly doesn't actually seem to understand what they did in the paper, which unfortunately seems to be the norm nowadays (might be why he doesn't even try explaining anything any more, just showing flashy visuals).
The main difference (which is *huge*) is that in the new method, the character and the ball are physically simulated, while in the EA footage they are kinematic. This is like the difference between having an animator handcraft a specific animation (including the motion of the ball), and having a literal robot try to perform these acrobatic motions while remaining balanced, keeping track of the ball, moving the leg such that the ball perfectly balances on the foot, applying just enough force to not kick it too far away, etc.
You all don't understand the core of this ai, it was never told to animate something football-related, it got various motions captures from any kind of sport, and not a lot of them, then it automatically understood how to apply it's new knowledge of movements into ones it never received (data wise), and to apply them to different types of object while responding to laws of physics. It's something COMPLETELY different from what is shown at the beginning, which is all scripted, the ball starts here and ends there, with the same animation. Now imagine if you motion capture football skills done by the greatest players and feed that to this AI, it will be incredible
Two things I noticed about the AI:
It has jerky movements.Physically possible, yes. Accurate to how real people move? Not really.
It doesn't have to look at the ball to do repeated headers. That's very unsettling, watching it bounce the ball repeatedly when it shouldn't even be able to see.
It is amazing to see AI progress :)
I think we are no longer in a state of progress, but an explosion
It's human progress first, but yes, it's amazing!
In Breath Of The Wild there was neither landscape step stutter nor foot sliding in 2017. Good animators, good programmers. Seeing those problems in most AAA tiles after BotW is just painful.
I think what is most incredible is that the motion synthesized is not just moving around bones - the character itself is using physically simulated joint actuation like a robot would in the real world.
@Creative When GTA 4 came out, we had euphoria. I think that is the first commercial application of this tech I've seen, but it was limited to reflex-like behaviours. Not sure how long before then it would have been around unseen by the general public.
Man, this voice is killing me 😂
Especially these intonation.
👨⚖️ This video has broken the:
📜 *1st RULE OF PAPERS !*
The thing I don’t like about this approach is that it can’t predict what the player is actually planning ahead of time before the movements. It’s hard to explain but in soccer for example, if you’re dribbling a ball and getting ready to take a shot, there are certain movements you take leading up to the shot that cannot be inputted by a controller and would require a higher level of prediction
I imagine a good application of something like this would be in improving real world player performance by uploading mocap of the training player and having the system analyse their performance and provide feedback on how they could improve.
That's actually a good idea. AI could help develop more ergonomic or efficient movements.
I thought foot sliding issue was dealt with 3 or so papers ago.
I still hope that the can use Voice AI for better commentators. Especially for career mode.
I can see something like an architecture similar to ControlNet being used with this as the base to train a functional motor cortex for complex movement in real life.
i don't want to detract from the paper, but going "wow, such realistic!" is overselling it. it's so juddery and stiff that it's actually worse than the "bad" example of animation. it's way more impressive because it's more physically accurate and is not scripted, but the end result still looks worse. nothing an extra year can't fix.
now we just need an AI that can grab a story from chatGPT, art and character designs from midjourney and these animations and throw it all into unreal engine 5 and have it code its own game. lol
Midjourney? I would recommend stable diffusion.
@@krishanSharma.69.69f Okay
AI will help game developers create games sooner or later.
Regarding sports games. AI could collect data (faces, skills, body parameters) about all soccer players in the world and immediately create these players.
Not so fast yet.
@@assincrono5872 You are underestimating people.
3 more papers down the line and it should be decent. Right now it still accelerates too fast, jerk movements and there is a tiny amount of ice skating
It’s crazy how AI advanced this much in our lives.
Sci fi movies I grew up watching is literally happening to me right now and Im terrified and excites at the same time.
"I can not wait to try the videogames of the future where we will be able to control this characters using this paper!" What a time to be alive!!!!
AI animation papers are the best for videos, so much cool footage
Every time I hear him say "What would you use this for?" I immediately remember the Time Traveler video by Rayan George when the 90s TV guys ask the future reporter "what do future people use all this amazing technology for?" and he answers "P0rn.. A whole lot of p0rn"... so yeah I'm pretty sure this will also be used for that too 😩
I'm not surprised this would be linked EA/FIFA but still impressed. I'm so glad AI like these are becoming viable for games. Our future Tomb Raiders are going to be insane.
Finally! I like graphics stuff but physics just ties everything together!
This is going to help with vr game avatars and making physic based sports game even better
Now it's just our VR technology that is behind. If we can play against these kinds of AI in VR, it would be a lot more immersive than just controlling them using a joystick or some buttons.
Impressive. They should make an IA to improve the gameplay too.
wow AI is progressing so fast
It's definitely not an improvement, but a step in a different, and in the long run better direction.
Emotes will be a thing of the past and will just be raw talent of the AI. I love using AI in my work, looking forward to the future!
This visually looks so much worse than the MMA/Basketball examples and the actual video game example it is supposed to be better than, they should have spent a bit more time to polish it up
I would use it for creating niche sport simulations like quidditch
What about the weights and the animation settings?
If the movements could appear more life-like, this would be HUGE for sports games! Imagine future games training each individual player and having them play and move like their human counterparts!
It would be interesting as well for team balancing, as if the real player is prone to mistakes, that could be represented by the AI agent. Like I wouldn't pass to the player who statistically failed passes during the real season.
Don't get me started on match simulations! If all players could be simulated to a relatively accurately degree, then you could run scrimmages virtually to predict real upcoming matches! So cool.
Is anybody working on an AI to remove those pesky sponsored ads within UA-cam videos? I'm not talking about those ads overlaying the video which are easily blocked by ad blockers, but those sponsored ads which are actually part of the video itself, which companies pay UA-camrs to include in their video. I always skip over them manually, but I hope AI can automate the process.
4:27 - Joke's on who? 🤨 Did Károly just forget the 1st law of papers? 🤦
Loved the human vs AI counter lol
Sebastian Starke has done it again !
how you will run neural network on your pc? Even smaller ones have huge perfomance strike.
I think EA would prefer adding more FUT cards to the game to improving the actual gameplay or in-game physics
In a way it's even more impressive that it can drop the toilet paper accidentally
If this guy, with this voice, can have more than a million subs, abything is possible
So, future soccer games will be programmed not by designing ways in which the AI can do stuff but by limiting how powerful it is. I imagine AI should be able to accurately calculate how to aim the ball in any direction and stuff like that.
I wonder when we will implement these new physics in games
Fast forward to gta7. All animations are realtime physics based simulations, all npcs have chatGPT as their AI, and each have unique parameters and lives. You could meet an npc walking down the street in your first hour of the game, and that same character will run up to you and say hi in your 30th hour when they recognize you in another location on the other side of the map.
I feel dedicated AI chips will become the main killer features of PS6 and next Xbox.
I’ve given up believing that AAA studios will ever implement this technology. They are more interested in copy paste year after year.
This is really amazing, but I'm not sure why the arms are left out from the animation, the soccer player has his arms "stuck", probably solved in the next paper? :)
I don’t know the leg motion looks almost weightless especially given the speed. It doesn’t look right having it spin the leg around the ball that fast with so little effort
I would love to see actual volleyball game including this level of animation. That would be a beautie 😍
Imagine zelda or elden ring with this system. You can basically create any enviroment and any character and then train it. Imagine a dragon with adapted physics and animation. Or your character trying to aim but he is nervous so the pulse feels different... the posibilities are endless!
I once knew a guy who said he doesn't play games anymore, he got so lazy and now just watches let's plays.
With the current progress of AI, it leads to the question: are players even needed anymore or does AI create let's plays?
And another paper down the line: AI creates games, plays them, and we got to watch their let's plays.
And next up: AI creates videos that look like let's plays but they are fictionary, the actual game doesn't exist.
Does anybody have the link to the paper discussed in 5:04? Thanks in advance!
OK. There was nothing believable about the new soccer guy. If I saw someone move like that, I’d assume someone drugged me.
I saw that Unreal 5 game engine want 2 use this procedual animations. The future will be so amazing for games
So videogames of the future are going to have realistic injuries...? Can't wait for the Fifa '27: Surgeon Simulator DLC! What a time to be alive :)
Can't wait for AI Toribash animations xD
Skate 4 should've used this
Does someone know what I could make a of huge collection of 3d meshes representing various well known objects ? Any paper to recommend?
Finally, a spiderman game with amazing swinging is on the horizon
I wonder... If they are able to integrate this technology with real life robotics, then that could be game-changing
I think I have read about some companies that are doing this already. I don't remember which ones though. Probably Google
Have you guys seen the forrest gump scene where he has to use support rails for his legs?
Jugglers are supposed to be rendered by a ray tracer. You know, for historical reasons.
Other than that - impressive technology.
Now put this data on the boston dynamics biped
The AI be like:
"What he can do with a ball, I can do with a black box shape"
*read in Zlatan voice*
EA is probably gonna charge you for improved animations
Could you build like a fully working eco-system with ai animals that only know they need to eat drink and sleep and not die. They can do everything animals can already do but don't know how to use it. Like can a bear learn to bear from ai or something
Xie et al. 2022 [NewTechnice]
it looks unnatural when transitioning happens the feet ankle deforms and moves faster while in transistion. The Charakter is for example also not breathing in simulation so thats the reason why it can balance "still"...
i would love to work with sebastion to fixing that.
they're not sliding on the grass again, kinda trippy
I can see a time where FIFA players will not be rated, but rather simulated based on video footage that is consumed by some kind of learning algorithm.
4:30 was the most impressive part. It shows the AI failing in a very human-like way. It also shows that the animation is truly physics-based and the AI was actually juggling the object the whole time.
I wonder when can we see these systems on game engines
I know this wasn't the focus at all but the hands are way too stiff.
I kinda think the "best" version of this is where the body is *also* physics-based. That might not be feasible for use in actual games though. So instead, you could do a relatively expensive, complicated muscle-based body simulation that simultaneously tries to fulfill all these tasks, use the resulting entirely physics-based data to massively augment existing motion capture libraries, and then train a much more lightweight model to reproduce that.
I think they have to precalculate all possible and impossible body moves.
Lets see how EA still makes a broken unplayable game filled with microtransactions
From a person that loves inverse kinematics, this have so much pottencial
Moves are really good. BUT not perfect yet. Hopefully soon we can't tell the difference between a real match and a videogame!
If zombies played football
The biggest problem with the results here is that the AI is handling the ball in extremely difficult ways that humans wouldn't do. i.e. it keeps bouncing the ball with the spin instead of trying to stop the spin of the ball as it bounces it up. Humans generally aren't skilled enough to do this.
did it train on steven segal's hand gestures whilst running?
Wow, AI could replicate a human player too I guess, their strength and flaws, and simulate them in matches
As a soccer player, something about the movements even in the new animations is just... off. Kind of uncanny valley where even though it looks like a human it doesn't look human.
Does anyone know of any research attempting to transfer an AI's learnings to human in some way? If we could delegate learning to an AI and teach just the result to a human, we could speed up the teaching of many skills.
Why teach skills to humans if there is an Ai where you can pull them from when needed.
@@UnknownDino To do things AI is still unable to do, which is still a whole lot of things. I think at the moment, humans can piggy back on AI systems to achieve more.
@@Kevin-jc1fx I might not be grasping your vision but it seems online tutorials in general fill that function
@@UnknownDino I am referring to some form of accelerated learning. To acquire a skill through traditional learning methods takes lots of time and practice. Because the human lifespan is short, this limits a lot what an individual can achieve. On the other hand, AI systems can go through the equivalent of years of learning and practice in a few hours. If the result of that process could be transferred to humans, you could acquire in a few years the level that took masters their entire lives and thus, you will be able to make groundbreaking breakthrough in said field which would hove required hundreds or thousands of years with current pedagogy.
Like the Matrix where Morpheus and Neo upload Kung Fu into their heads and proceed to spar like 9th-degree black belts?
I have a question
How does such an AI see? It does not see with the characters eyes right? Then how? Is it just reading code? Does it see the football player in the 3rd person?
@@leeroyjenkins0 Thank you!
We should probably point out that EA no longer has the FIFA license.
I will not be impressed until the AI can simulate injury and pain,dropping to the floor holding it's leg after being touched on the shoulder. Simulate simulating
Am I misunderstanding? The AI movement seems to be dodgy with limbs stretched and sometimes spazzing lol. When the ball is being blown forwards away from the player, his standing foot hops unnaturally too. Is this video just showing the basics and then more smoothed out AI animation will be coming in the future?
you guys know ea isnt gonna open source this right? they're gonna keep it to themselves and sue anyone that tries to do anything remotely similar?!
Is it just me or I didn't notice any ball physics issue with the first animation and the new one with the leg movement looks completely ridiculous?
I understand that the difference is manual vs AI labour, but the old ones look very fine, and new ones are very off. And when you add those forces it's stuttering and unrealistically dragging on the ground with the leg.
Don't get me wrong, I think it's a great achievement, and has a lot of future potential, but it just felt like commentary and the background video didn't go together well.
AI wearing powerswerves? Ai got good taste
It would be cool to see it running in humanoid robot
Zhang is on fire
EA used animations just to mask their scripted games, it would be lovely to see AI actually make better decisions in game, we don't want teams or characters behaving in non realistic ways just to give an advantage to score
Still lots of foot sliding going on though.
Don't worry guys this will come in DLCs, Season Passes or Monthly Subscriptions. You flex everywhere you want 😂
Thank you Two Minute Papers. Welcome to Walmart. I love you.
Which AI is used for the narration?
and their Microtransaction AI is even more advanced 😅
FIFA with this in 3rd person with 22 players :D