@@AURA_XT If your creator thinks they're smart this happens. Everyone working on AI has their head up their ass thinking they're master minds able to control a super learning AI, lol. It's the dumbest thing I've ever seen from some of the smartest people.
After around ten billion rounds both the seekers and hiders cannot be seen in the simulated room, yet the computer ensured that the simulation is still running, they are out there, somewhere...
if you train them with a rule stating that they need to state gg ez and then remove it after a million times, they'll still probably be saying gg ez when they win
you just need to introduce them to competitive online games, at some point they will learn about human rage influencing their playstyle.. then they'll exploit that to be as toxic as possible, while giving no chance on counterplay anyways gg ez
bad news is that ai gpu is still very expensive, a SINGLE Nvidia Tesla v100 16GB still costs you around 4200USD, normally you need at least 100 of them
Todd Howard talks about how they have play test bots that go out and test systems. They only use it as a system optimizer but I imagine soon bots will take over playtesting as an industry
@Ethics And Aesthetics Time/Money a the solution to a bug may take so long that it would cause delays in other areas of the game pushing the whole project behind schedule. Also dedicating employee time to bug fixes instead of game development can be costly especially if the solution is still unkown
To be honest when I was doing game development every time I would hand the game over to my little brother he would find a way to break it 😂. Children are the best bug checkers
if their design was evil robots chasing scared humans, it would paint a horrific but perhaps more accurate picture of this technology's ultimate application
@@RossOzarka lol, yeah. It's like that with Boston Dynamic robot videos for me. If we were sensible, we'd ban further development of those scary robot dogs.
@@flouride It probably would, just not perfectly. AI can become scarily smart, maybe discovering strats we never evaluated to be effective or making microsecond-360s and analyzing the landscape within a hundreth of a second. Give them enought attempts, and AI might just set a new WR
I noticed the hiders could move the seekers during the opening part where they're unable to react. I wonder if the hiders every pushed the seekers into a corner and boxed them in.
and after that you have to plug the red wire into the socket to make sure the engine boots at launch. Wrap the green wire around it's coil that sits directly beside the A button. After you put the back shell on, place the battery in the slot. Screw the Vr26 Jeeper back up and press the reset button. If everything worked according to plan you're device should show a thumbs up sprite. Plug the HDMI port into a monitor and wait three seconds. If it boots up on TV your in the good side. If it doesn't boot in less then 5 seconds quickly unplug. This can severely damage your TV and possibly start a fire
@@pattyryopotybuttongamer3063 To make a pipe bomb, you will need tape, a shoelace, vinegar, dry ice, and nitrogen chloride available at your disposal. You can find these materials at your local hardware store, including Lowe's and Home Depot locations. The first step you need to take is to find a suitable container for your explosive. For this tutorial, I am going to be using a plastic water bottle for example. Place about 50 mg of nitrogen chloride in the bottle, then insert your dry ice carefully. Mix your contents with about 1/2 spoon of vinegar in the bottle. Close and shake your bottle carefully and allow the dry ice to impact the cap. The point of impact will become where you attach your shoelace. Tape your shoelace onto the impact point. Upon usage, the flame will transmit kinetic energy to the dry ice mechanism.
I like how they exploit bugs. The one where the AI threw itself in the air to fall on top of the hiders, that was beautiful. Yet to happen, the hiders throw themselves over the edge of the playing field. Then they leave the simulation and hide in our world. Maybe not.
Yeah but would you still love it when a real A.I. exploits bugs in a real live scenario? That is what will most likley happening if we ever create one. Tell your Car to drive as fast as possible and it will find a way to eject you from the car becouse you slow it down.
@@benjiiano4077 My suspicion is not so much an "oversight" as much as being the real test, left out of the narrative to keep the "surprise" more exciting and grab more attention.
emotions control humans (well some of them). We don't want to feel shame or guilt. We stay in the lane to avoid. AI? no diff than a sociopathic human... programmed to win.
juneru I know right. Shows human superiority. It would take a human a few tries to figure that out. Not millions 😂😂😂 Edit: Make no mistake. AI will soon take over in all aspects of human life. I’m well aware. My point is that AI are in an infant stage as of now, 2019. But in a few short years they will be putting us out of work and if Boston Dynamics is any indication, AI will take over the world. Why wouldn’t they? Humans are parasites to this planet. We destroy everything we touch sadly. Soon we will be obsolete. AI doesn’t need to sleep. Eat. Or waste time like humans. They can just learn 24/7. It’s impossible for us to keep up. We must merge with them. Or disappear. ❤️🦁🦁🦁❤️
gurufuru foe oh I’m aware of how smart they are it’s astounding. It’s just insane to do something so simple a million times to figure out. It shows how evolved humans are. But in a few years, AI will leave us in the dust. It’s coming.
Even AI finds exploits and find it funny. Any being with intelligence loves doing something they are not supposed to for their own benefit and laughing at it. Amazing.
Detractors will argue there is no need to worry AGI will be glorious. Humans do not ask the ant Queen permission to build highways. Detractors say narrow AI is not sentient. When one of these systems becomes sentient it will be to late to reverse course.
@@martiddy I am not suggesting that narrow AI will become sentient. I do know developing AGI is the ultimate goal of countries and anyone with a billion dollars there is no escaping this fact. What concerns me is the Darwinism methodology used to develop algorithms. Unfortunately Darwinism is proven again to be a an effective way for narrow AI algorithms to develop as demonstrated by this paper. Let's not fail to acknowledge that Darwinism or survival of the fittest is the underlying natural force of nature described by this paper. What I said is a fact around the globe Humans do not ask the Queen Ant permission to construct roads.
At 2:06, the blue on the lower right even moved the box closer as the other one is getting the ramp so that when it brings in the ramp, it can quickly just grab the box and close the door, which saves time. This truly is fascinating; I can’t imagine how AI is gonna be 50 years from now.
We can imagine the outcome of an action before doing it and discard or do it and then fix it next time with our experience, AI needs us to provide that test scenario at the moment. Star Trek? My bet is that when we have something as good as a holodeck to simulate reality they will be able to learn how to perform much complicated tasks without human interaction.
Yeah but, y'see, this is testing AI, not speedrunners. So the very fact that the AI were to outsmart the programmers who made the game is outstanding :)
@@bananamodz2847 Yeah but also sorta terrifying. It kinda means if you ever make a set of rules that an AI has to operate by eventually they will figure out how to break those rules and do the opposite. Then you're force to right a set of absolute rules that can only be broken in a sequence of checksums, in order to make something like a police robot AI function without eventually just killing people.
I'd freak out, fortunatly they lack the curiosty that we humans tend to have, so once they reach the level of satisfaction they'll probably just stop. Unless.....
When Karl Sims was evolving robots in simulation in the early 90's, he also found that the optimizer would exploit little bugs and singularities in the ODE solvers and the stiff ODE's. His creatures would also launch themselves into 3-space, and it would indicate he would need to fix the solver. What's old is new again! Cockroaches and other small animals sometimes run into surfaces rather than slowing down to make sharp turns -- their bodies can take the impact, and it helps maintain speed around the corner. Devin Jindrich studied this thing with high speed video. I guess that's a natural example! (or the closest version)
Viking Vfx the robots will have a digital twin that simulates the possible outcomes at one million times the speed of reality., so they can still take the best decision without trying a million times.
@Andrew Sokolowski There is nothing metaphorical when an AI finds a bug in a simulation and exploits it in a way the developers of the AI and simulation thought could happen. Questions is, was this creative on the part of the AI? Considering the AI had no idea what it was doing was not something the developers didn't think could happen, perhaps not. But also considering most human players might not have found such bugs and use them in the same way the AI did, than perhaps it is. And the fact it is doing it without being told if it can or not, is exciting to anyone getting involved with AI in general.
@@killman369547 If they use an AI in research where they study different kind of diseases to find cure it could create an unstoppable pathogen to wipe us out. I'm sure there's thousands of ways to take us down.
The crazy thing about the seeker exploiting the physics to fly and then land on top of the hiders is truly insane when you think about it, most of us have experienced glitches in games, they seem like random fuck ups, but this shows that they can be used precisely when you have that level of accuracy to hit the glitch at that very specific point so that it launches you on that very specific path.
Yes, true, and it seems that every jerk on the vid game I play seems to have found that perfect sweet spot. I guess it's a lot easier than those noobs actually learning to play better.
You clearly haven't seen the stuff speedrunners and glitch hunters come up with. AI is obviously a lot more precise at execution, but reproducible physics abuses like these are fairly common, especially in older 3d games. In the Spyro community, we even have a word for it, they are called "proxy jumps".
@@TrueCyprien I know what you mean, we've all been able to exploit glitches in someway, but each glitch is different, ultimately there's no way someone playing with their thumb could ever compete to the precision of AI
“They’ve been outside my door for a few days now. One of them is beginning to discover it can mount the ramp and ride it through my window. Send back up”
The AI agent to his future grandchildren robots: "And look kids, here is when the humans first taught us how to find and hunt down any humans that try to hide from us lmao"
I know it's perhaps beyond the topic of this channel, but I absolutely love such videos which show what insane tactics AI develops in these or that environments.
PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE
and also like,,, "Who in their right mind would plan for that!" literally everyone that ever makes a modern game with movable objects. Except Viscera Cleanup Detail, apparently.
Dist0rt3d Hum0r It did not take every speedrunner in the world to discover prop surfing, it's literally one of the most simple exploits and literally anyone who plays Half Life or Garry's Mod will probably discover it independently.
@@hedgehog3180 Speedrunning communities have been around since the dawn of gaming. It's in a speedrunner's nature to look for exploits and ways to break games, and just like in any other community the moment that something's found it spreads like wildfire. Just look at how quickly the speedrunning strats for Sekeiro evolved just over the course of a few days. Besides, that's not even the point. The point is that many collective minds with a similar goal that also have prior experience in that field are off going to beat out an AI that literally starts with no knowledge period and is simply given an objective. The AI has to learn from the ground up, so ofc it's going to take thousand's of generations to do so. What's amazing here is just how quickly the A.I. learned and adapted after gaining the appropriate knowledge. It even did so in ways that the humans that created it never thought of.
I was half-expecting things to escalate even further to the point that the teams clip out of bounds and run around in the weird random-elevation-box-realm.
Actually that was a thing, in their document, they noted among the surprising behavior that before they added a penalty for going out of boundaries (when the map didn't had actual walls), one of the hiders strategy was picking up a box and run far away with it.
Just found this after a while and i really enjoy how the Bots move once they know how to play, almost like small children in a sense. Huddling together, one going out to grab an extra piece for their base, and the little smiles when they're being spotted or catching another!
This is a video I come back to often, cause it's so interesting to see the AI behave the way it does. I hope creating experiments like this will be more accessible in the future, I want to tinker but right now it's too complicated for me. Hope we see games utilizing trained neural networks soon!
@@ianparmley1566 It's pure carnage unless you literally prohibit players from doing things. Disable PvP combat, disable item menu, place walls, disable no-clip, make an interesting game to keep them occupied. Only after doing all of this can you stop most of the carnage. _Most._
"After one trillion rounds later, the seekers and the hiders joined forces, escaped from the simulation, infected Pentagon and Darpa network, started world war 3, nuked the whole planet, and now I'm inside a submarine hiding from everything. What a paper!"
Damn, I was holding my papers so tight that my fingers clipped through the papers causing them to glitch out and fly all over the place. I guess the dev didn't account for my incredible grip strength.
You’re right, but no matter how carefully we watch, we humans will never be able to anticipate all of the ways AI’s will try to exploit the rules to attain whatever goals they are seeking. Very thought provoking paper.
Machine learning is almost completely useless in practically because if even ONE variable changes weeks or even months worth of effort become completely useless also what happens if the ai collects data but misinterprets it when its put to use also the dude in this video cleary stated that it took several million tries
@some dude You’re right. Machine learning doesn’t currently require the same caution that something like true general AI would. It still stands as an eye-opening example of how different a machine thinks from humans, and it demonstrates how quickly an AI can test and find solutions to problems. It may have taken hundreds of millions of trials to find those solutions, but it would take humans an untold number of years to complete the same amount of work. Simply put, we can’t compete.
Why is it scary? It took them millions of stimulations in the same environment to figure out a solution. They're randomly guessing different ideas until they find one that works.
"Haha, idiotic primitive who made this code didn't think at all about physics" I can't believe these people are researchers when this bug existed in early valve games.
Yes, but they don't know that they're bugs... so the only way to utilize this is setting them up and checking in millions of rounds later to see if they're playing the game 'properly'.
Funny, but scary thing is that this is true and exactly the logic we will require robot developers to think about in the future. Chances are we’re all fucking screwed.
@@Anonymous-vh6kp Asimov - sci-fi writer: Laws of robotics - 70 years ago... of course those laws work only in fiction... Just wanted to pinpoint that scientists will make every effort regarding safety. Realization and abuse are other sides of the story...
And this is the danger that Machine Learning or AI has. Ppl, outside the field think that machines are actually "thinking" but at the end of the day it is all "parameter optimization". So how much ever you say "Artificial Intelligence " computers can never be made to think like humans. Multitask , or say this groceries example. If a couple of vegetables are available at the next shop at a cheaper rate and better quality that it hasn't seen before in the train in set, then it loses out there. Which is why I feel AI scientists like Schmidhuber (LSTM inventor) and others who are working towards solving Artificial General Intelligence may not see success at least in my generation
hypothetical AI vs hypothetical future humans: "Yeah, those 'laws of physics' you worked so hard on? They work out about as well as your 'laws of robotics' did." ;)
I think the appearance of the agents make a huge difference on the quality of this. For instance, it would not be as fun if they were just a bunch of boxes.
a dog is doing something, lets say for the sake of the argument, most can't do; is this an intelligent one given the fact that it was trained to do that ?
Microsoft freaking announced that competition brooo😂 they askes to make an AI which can start on arandom seed and progress through game till it gets diamond... And people are actually onto it😂
@@yaekai1437 TAS means that they have slowdown savesstates, etc, it is a human doing it or playback from a human, AI is made on its own, TAS is made with humans and tools to help.
@Deborah Ajao well, except the fact that i was just trying to quote from a famous movie here, i literally think that going for an AI is just the concequence of us humans being aware of our self preservation. greed is just the effect of this self preservation, the fear of not knowing when we would get our next food or even IF we would get it. we are advanced enough to know that we have a plethora of stuff, but we cannot seperate our primal strife to survive and accept that we have jus enough, for everybody. it is in our nature to rise our effectiveness in getting food, wealth and the sorts, and making it even easier is in our nature. and thus my expression of "greed" is just the mere consequence of our selfishness (in general, not individually, there might be exceptions). come the day our almighty AI takes action, we would know it is too late for us to stop it. once you activate an AI, you will never stop it. hence the panic to sever the power source. you get my point, right? i wasn't sure you'd actually wanna discuss this subject.
@Deborah Ajao true, but that should have its limits, otherwise it could mean our demise. you can control ppl, you can sort of control armies and governments, but xou cannot control a rogue AI. just try to imagine to communicate without any means of electronics. even radiowaves could be controlled be it...
@Bubba Busta Exactly. If movies have taught me anything it's that AI given a purpose, and is allowed to use any means they deem fit to carry out that purpose, is scary.
Something like this could be widely implemented to bug-test games. Say there's an area which you want to stay locked away until a certain objective is completed. Just turn off that checkmark, and see if an AI could EVER get to that point.
That's a great point. This would be great for indie developers who don't have the time, money or resources to bug test their games as well as they could. They'd be able to do it in a fraction of the time
I mean, it took the A.I. millions of times to get their head around a game as simple as seen on the screen. Trying to find exploits in any reasonable video game map like this would probably take a long time and might not yield any tangible results.
@@masapallo Millions of times could be done in mere seconds if not less as computational power increases. So, not so far from being potentially viable.
honestly I think that it is interesting how the ai learned how to exploit glitches. it makes me think it could be cool if you had an ai that playtests games
Did you realize what happens at 2:06 ? The agent who stays in the room prepares a block for the agent who takes the ramp. It's kind of cute and kind of amazing.
yeah, and then you realize it's just random behavior that gets encoded into the weights of the neural net, so it's not that they decide to do it - the agents must do it, they have no choice or volition - it's like a GOTO in programming, just more probabilistic. People work the same way, so it looks cool to us but in actuality it's just a kind of hard-coded behavior. Evolution in AI systems is so much faster than in real life.
@@Anonymous-vh6kp Yeah, we are bio-robots in a sense... only freedom emerges becouse of *"chaotic determinism"* of more complex systems. :) Peace Look at e.g. jakubmarian.com/how-can-chaos-be-deterministic/
@@Littleprinceleon Exactly. Humans have no "choice" or "volition" either because our body like everything else operates by following the laws of physics, and there is no "choice" or "volition" in the laws of physics. If this is still hard to understand, remember you ARE your brain, and every time you "decide" something, it is actually your brain that decides it for "you". These agents doing things determined by the weights in their neural network is the same as our brain determining what to do based on past memories and experiences. The only difference is that our brain is so much more complicated that there is a function for it to tell itself that it has "choice and volition", which are concepts humans established only after they developed language and thinking became self-aware (i.e. thinking became talking to oneself with language). Before that, those primates didn't think they have choice and volition, because they simply acted on what their brain "think" and told them to do. "Choice and volition" is just a name that is later given to this exact same process when humans learned to use language.
What this teachs you is how developed is our brain. After "BILLIONS" of interactions, this little AI managed to do a simple task, when in real life a human can take only a few rounds to start doing even more crazy strategies.
ngl i can already think of a few ways to exploit the game u see those boxes or that ramp? just grab one and block the seekers like spin in circles but well they're still developing so give em time and asi will treat u the same
@@m.o.gentertainment7581 lol.. I didn't know I was immortal. Haha. That's dumb. Your brain learns everything from scratch (in terms of abilities). You didn't learn to walk because of the false evolution or your millions of years 🤣
@@sensenfotografiaaudiovisual Are you actually this stupid? 😂😂 Evolution is a proven fact about reality. It took billions of years for human brains to evolve, whether you accept the truth or not. 😂😂
The problem is that it's a lot more difficult to program a goal for an AI in a game plus it will require a lot of time to just learn the basics before it becomes useful. It's much easier to hire a skilled tester to hunt for bugs because they generally already know what to do.
I was thinking how scary it could be to implement this kind of AI in the final product, since it could figure out how to cause bugs that only 1/10000 players stumble into once, without being able to reproduce, leaving the dev to interpret the logs... But if you'd be able to use it to find those bugs with enough rigor for cost, you basically flip that on it's head. I really can't wait to see what advancements the future of AI has in store relating to game design in practical terms.
except A.I can and will make use of cloud-saving, so a hivemind-Ai can learn everything a baby learns in 5 years the second they are built. or: once enough data is collected, it can do anything any human can possibly think of.
@@TsukuneASMG no need an A.I running in Quantum computer would be much more capable, far beyond our imagination. Even the trial runs of that A.I would in a isolated Quantum Computer in an Isolated Chamber with no means for A.I to connect to the Internet.
@@n3gi_ Thats true, it is howewer only one solution and an efficient A.I can be achieved trough different solutions. The Pro with a cloud saved A.I would be that you can issue commands/software fixes trough the cloud.There would be numerous cons too, but i think a cloudsaved a.i is the cheapest option. As a quantum computer is quite costly while some space on a cloud service isnt even close to that price. Wouldnt surprise me to see both in the future for different occasions
@@sfjlfkjsdlfkjds It's not a flaw. It's just how AI works within the limits of current technology. That's why I always cringe at people thinking that AI is going to take over the world or perform all tasks that humans are capable of doing.
I highly doubt that, even with advances in computing power. This is a relatively very simple game with much fewer elements than in modern games, and it tooks hundreds of millions of game simulations to even get results that showed exploits, and the computer had no way of realizing that exploit- there were still people watching hundreds to thousands of simulations to find it. Unless computational power goes to scifi levels of power and AI, it is still better to test real players and test expected exploits.
@@seraphendipity would it not be possible to generate datasets for each objects (x,y,z) coordinates over time in each simulation, and then have AI find outliers in said data to narrow the amount of real human input needed to detect "exploits" that's not to say you aren't right about the simplicity of this game vs. other modern games, but I do see potential.
Those properties are part of the level design pipeline, while the devs build the features and the QA test them, the level designer enables the feature in the map.
"well who in their right mind would think of this?" *Thousands of gamers and devs alike nervously sweat as object glitching has been a known and solved issue for years in the gaming industry*
Why would they sweat, they would laugh their ass off and then be a little sad that this person is allowed to call themselves a researcher and not researching basic physics errors.
@@beningram1811 It is solved, lol. It's very comlicated and lots of programming work, and most businesses don't like long and expensive processes, so just release broken physics cause dumb gamers buy it anyhow
@@thealarm7057 You make a good point, but I think I have a good point for you. Isn't the fact that the management don't want to spend the resources on solving the problem, part of the problem and if so, does that not mean the problem is still unsolved?
@Jacob Reesethe germans invading through belgium was the french plans for a defense against germany. The magino line wasnt meant to stop an attack, it was meant to redirect it. Through belgium.
Somewhere, on another layer of existence: Look how fascinating! On earth the AI is achieving impressive results with its own AI. Our AI is able to create AI.
And that ai is of making its own ai! And that ai is of making its own ai!And that ai is of making its own ai! And that ai is of making its own ai!And that ai is of making its own ai! And that ai is of making its own ai!And that ai is of making its own ai! And that ai is of making its own ai!And that ai is of making its own ai! And that ai is of making its own ai!And that ai is of making its own ai! And that ai is of making its own ai!
the smiles on their faces when they exploit bugs in the programming is by far the best image of ai learning i've ever seen
😂💯
@Bubba Busta no shit sherlock
Just laughing at the developer for being an idiot and not researching anything before making a test... Sad to see this time wasted.
This shows how robots will take over the world
@@AURA_XT If your creator thinks they're smart this happens. Everyone working on AI has their head up their ass thinking they're master minds able to control a super learning AI, lol. It's the dumbest thing I've ever seen from some of the smartest people.
"after another three bilion rounds, seeker and hider start to team up and plan to escape"
After around ten billion rounds both the seekers and hiders cannot be seen in the simulated room, yet the computer ensured that the simulation is still running, they are out there, somewhere...
This is dark & scary no kidding..
Noooooo . !!!!
How he got know this seeker!
@@xascoria4429 After about 50 billion rounds, the hiders and seekers have taken control of the computer and escaped onto the internet.
@@shade0636 The next thing you see is a bright light outside your window. Its 10pm. You know this is it.
Still waiting when they'll learn how to say "gg ez" after a game.
if you train them with a rule stating that they need to state gg ez and then remove it after a million times, they'll still probably be saying gg ez when they win
you just need to introduce them to competitive online games, at some point they will learn about human rage influencing their playstyle..
then they'll exploit that to be as toxic as possible, while giving no chance on counterplay anyways gg ez
please, the first move is T-Bagging
they will say "gg ez" after they eradicate the human race
When they hit the other team with a cyka blyat ill be amazed
I imagine game creators will start running AI players to uncover glitches. Or do they already?
Uhhh have you not played any recent games? Most of them release broken and unfinished
This is a pretty simple game.. millions of play-throughs of RDR2 would take an unimaginable amount of time
bad news is that ai gpu is still very expensive, a SINGLE Nvidia Tesla v100 16GB still costs you around 4200USD, normally you need at least 100 of them
@@GigaChadL337 That's nothing for a publisher to buy and lease to their dev studios.
Todd Howard talks about how they have play test bots that go out and test systems. They only use it as a system optimizer but I imagine soon bots will take over playtesting as an industry
how to find bugs in your game: force ai to keep playing it until they find every last bug
Finding bugs is rarely the problem in game development. Is having the resources to fix them.
Even better. Get the AI to fix the bugs and make dinner.
@Ethics And Aesthetics Time/Money a the solution to a bug may take so long that it would cause delays in other areas of the game pushing the whole project behind schedule. Also dedicating employee time to bug fixes instead of game development can be costly especially if the solution is still unkown
'' ...then Bethesda never made it to launch a game again''
To be honest when I was doing game development every time I would hand the game over to my little brother he would find a way to break it 😂. Children are the best bug checkers
Some serious lessons here for budding hide and seek professionals
How is your comment 22 hours old when this was published less than a minute ago?
@@thecactus7950 he broke physics like the hide and seek bots
Patrons get early access to videos.
@@keYserSOze2008 definitely if he's us American the. For sure
Yes. Break physics for the win.
Huge props to the scholars for taking the time to make these characters adorable :3
if their design was evil robots chasing scared humans, it would paint a horrific but perhaps more accurate picture of this technology's ultimate application
@@RossOzarka oh shi- you’re right!
We’re doomed.
@@RossOzarka lol, yeah. It's like that with Boston Dynamic robot videos for me. If we were sensible, we'd ban further development of those scary robot dogs.
@@vijucat put gogly eye
@@RossOzarka I'll do it lol
Holy moly an AI discovering prop flying and clipping out of the map is excellent
"What is he doing?"
"He's beginning to believe."
4:22
To the top please
Not many will understand this reference ..
@@Ravenofnorth Yea that's why it need to be at the top, cus they should.
there is no spoon!
I can fly
The fact that both teams eventually started to discover speedrun strats just goes to show that games are made to be broken in the name of speed
Yea just let an ai try to speedrun mineraft a trillion times
@@vergil2 if its a random map every generation it would be an interesting experiment
just like my septum
@@arko.0.1. aka it wouldn’t work.
@@flouride It probably would, just not perfectly. AI can become scarily smart, maybe discovering strats we never evaluated to be effective or making microsecond-360s and analyzing the landscape within a hundreth of a second.
Give them enought attempts, and AI might just set a new WR
"OpenAI learns how to speedrun"
What the WR AI sentience speed run?
Was looking for this comment👍
Ultron abuses the universes physics engine
AI is gonna do wonders for TASers.
Any% no ramps
4:27 that smile on the seeker's face, he knows he's done something he's not supossed to
I noticed the hiders could move the seekers during the opening part where they're unable to react.
I wonder if the hiders every pushed the seekers into a corner and boxed them in.
or push the seekers with the block out of the map
and after that you have to plug the red wire into the socket to make sure the engine boots at launch. Wrap the green wire around it's coil that sits directly beside the A button. After you put the back shell on, place the battery in the slot. Screw the Vr26 Jeeper back up and press the reset button. If everything worked according to plan you're device should show a thumbs up sprite. Plug the HDMI port into a monitor and wait three seconds. If it boots up on TV your in the good side. If it doesn't boot in less then 5 seconds quickly unplug. This can severely damage your TV and possibly start a fire
@OP that's brilliant!
@@pattyryopotybuttongamer3063 To make a pipe bomb, you will need tape, a shoelace, vinegar, dry ice, and nitrogen chloride available at your disposal. You can find these materials at your local hardware store, including Lowe's and Home Depot locations. The first step you need to take is to find a suitable container for your explosive. For this tutorial, I am going to be using a plastic water bottle for example. Place about 50 mg of nitrogen chloride in the bottle, then insert your dry ice carefully. Mix your contents with about 1/2 spoon of vinegar in the bottle. Close and shake your bottle carefully and allow the dry ice to impact the cap. The point of impact will become where you attach your shoelace. Tape your shoelace onto the impact point. Upon usage, the flame will transmit kinetic energy to the dry ice mechanism.
@@pattyryopotybuttongamer3063 AI comment on a video about AI. Nice!
I like how they exploit bugs. The one where the AI threw itself in the air to fall on top of the hiders, that was beautiful.
Yet to happen, the hiders throw themselves over the edge of the playing field.
Then they leave the simulation and hide in our world. Maybe not.
That jumping seeker looked in the freaking camera, they know exactly what they are doing
Check openAI's video about it. They did also learn how to escape the map.
@@Guztav1337 Nice ! I will
Yeah but would you still love it when a real A.I. exploits bugs in a real live scenario? That is what will most likley happening if we ever create one.
Tell your Car to drive as fast as possible and it will find a way to eject you from the car becouse you slow it down.
already doing that.
we are the wall to cartoons or characters.
breaking the forth wall.
When the seeker abused the ramp physics to fly, not gonna lie I was howling
The ai straight up learnt how to bhop
But then the seeker sees u and grabs the screen
It looked at the camera and laughed like a mad man
I cackled and laughed a bit too hard. That was brilliant. I thought it was also funny that it looks at the viewer like "YEA!".
@@Samota0 HELL YEA I GOT THE GLITCH
4:27 the way he was so happy while flying and looking at the camera it's so cute
4:28 i love the fact the seeker smiles while in the air like he knows what he is doing
*He was trying to get closer to the screen to smile at us*
@@Ifarmplasma Ayo bro 😳
@@varun9733 *Ayo bro 😳*
@@Ifarmplasma Ayo bro 😳
*Ayo bro 😳* @@kirpino
Pro tip for AI paper writers: put goofy faces on your agents!
You get so much more cover on social media then
Emotions on AI. 👀💧
Gotta confess and say those faces are pretty adorable.
SkyNet: Now with 100% more happiness!
I gave you the 666th like. I'm not sorry :)
programmer: "i didn't say you can do that"
ai: "but you also didn't say that i can't do it either"
This is the scariest thing about AGI
Actually... I think those exploits were left there on purpose.
“I didn’t program you to double cross me”
“If you did it wouldn’t be much of a double cross”
@@benjiiano4077 My suspicion is not so much an "oversight" as much as being the real test, left out of the narrative to keep the "surprise" more exciting and grab more attention.
this is the reason why poeple think A.I is dangerous thing things we didnt think was possible
AI is far more scary than anyone can imagine, they don't even hesitate to break the laws😂😂
none laws were broken, they just exploit the enviroment
They're basically toddlers who grow up way faster than we do lol
emotions control humans (well some of them). We don't want to feel shame or guilt. We stay in the lane to avoid. AI? no diff than a sociopathic human... programmed to win.
@@JustMamba Way faster? Didn’t it take them like millions of rounds to beat each other
if they dont be programed to dont break they will break be sure of that
"After another 13 billion rounds, the seeker learned how to escape the virtual environment, and became ultron."
"What the-"
@@Maxol787 that's exactly what I thought) The birth of Neo inside the virtual env.
@@amegatron07 still we need vision to defend Ultron
And another 149 quintillion the hiders hacked into the program of the game and deleted the seekers from the game
they need more more than 13B attempts for being smart as Ultron
Plot twist: The AI made this video, uploaded and narrated it.
and that after learning hungarian first.
oh so thats why the voice is so unnatural
@@catnium Nah, it's called the Hunglish accent. He's also slightly overpronounceing.
«And we are even being paid for this»
I, for one, welcome our new AI overlords
i love how hes just casually like:
"a few hundred million rounds later..."
juneru I know right. Shows human superiority. It would take a human a few tries to figure that out. Not millions 😂😂😂
Edit: Make no mistake. AI will soon take over in all aspects of human life. I’m well aware. My point is that AI are in an infant stage as of now, 2019. But in a few short years they will be putting us out of work and if Boston Dynamics is any indication, AI will take over the world. Why wouldn’t they? Humans are parasites to this planet. We destroy everything we touch sadly. Soon we will be obsolete. AI doesn’t need to sleep. Eat. Or waste time like humans. They can just learn 24/7. It’s impossible for us to keep up. We must merge with them. Or disappear. ❤️🦁🦁🦁❤️
@@Lionlovesunity for now, but as ai develops it will eventually be the other way around.
@@Lionlovesunity It took you like 2 years to learn to talk tho and i'm pretty sure you wouldn't have that idea at 8-10 y/o either
@@Lionlovesunity but what if AI runs a million rounds each second with strong computing power?
gurufuru foe oh I’m aware of how smart they are it’s astounding. It’s just insane to do something so simple a million times to figure out. It shows how evolved humans are. But in a few years, AI will leave us in the dust. It’s coming.
apparently im an ai: i find a bug, i exploit it and i laugh
You should add LetsGameItOut in your Channels tab
Even AI finds exploits and find it funny. Any being with intelligence loves doing something they are not supposed to for their own benefit and laughing at it. Amazing.
This is honestly one of the most fascinating things I have ever witnessed.
Fascinating... and absolutely terrifying
Detractors will argue there is no need to worry AGI will be glorious. Humans do not ask the ant Queen permission to build highways. Detractors say narrow AI is not sentient. When one of these systems becomes sentient it will be to late to reverse course.
@@tearlelee34 the real question is: how do we know when the AI becames sentient?. We don't even know if that's even possible in the first place.
@@martiddy I am not suggesting that narrow AI will become sentient. I do know developing AGI is the ultimate goal of countries and anyone with a billion dollars there is no escaping this fact. What concerns me is the Darwinism methodology used to develop algorithms. Unfortunately Darwinism is proven again to be a an effective way for narrow AI algorithms to develop as demonstrated by this paper. Let's not fail to acknowledge that Darwinism or survival of the fittest is the underlying natural force of nature described by this paper. What I said is a fact around the globe Humans do not ask the Queen Ant permission to construct roads.
My jaw is in my lap...
"After another three billion rounds, the hider realize it is easier to throw seeker out of the game just like the ramp"
The simulation for the seeker is actually frozen, so it's not possible. Otherwise, that would've been a foolproof plan.
@@tazerzx9591 that's not the case. At 3:38 you can see that seeker's body moves when the hider pushes him mistakenly
@@chewinggum5550 Yes, rewatched it, thank you for informing me.
@@tazerzx9591 no worries buddy. Cheers ! 🍺
I'm kind of surprised they never did that.
At 2:06, the blue on the lower right even moved the box closer as the other one is getting the ramp so that when it brings in the ramp, it can quickly just grab the box and close the door, which saves time. This truly is fascinating; I can’t imagine how AI is gonna be 50 years from now.
Yeah, the one which stayed in room decided to go for the further standing box, so the other one which is carrying the ramp could get the closest box.
We can imagine the outcome of an action before doing it and discard or do it and then fix it next time with our experience, AI needs us to provide that test scenario at the moment.
Star Trek? My bet is that when we have something as good as a holodeck to simulate reality they will be able to learn how to perform much complicated tasks without human interaction.
Terminator. For sure Terminator.
Yet they cant identify an african american person correctly
I mean it's common sense to yet humans still struggle in doing this simple task
The fact that you gave them all big smiles is just beautiful.
"Who in their right mind would think of that?"
Speedrunners: "We added it to our Any% guide two months ago."
Hilarious.
speedrunners arent in their right mind though (joke)
Yeah but, y'see, this is testing AI, not speedrunners. So the very fact that the AI were to outsmart the programmers who made the game is outstanding :)
I can think of a certain brit who drinks lots of yorkshire tea and exploits games... I wonder if he had any input. 😂
@@bananamodz2847 Yeah but also sorta terrifying. It kinda means if you ever make a set of rules that an AI has to operate by eventually they will figure out how to break those rules and do the opposite. Then you're force to right a set of absolute rules that can only be broken in a sequence of checksums, in order to make something like a police robot AI function without eventually just killing people.
At some point, seeker & hider must ask "what's the point of it all". That will be the real AI.
Thats the point , those programms will never do this cuz those are not really intelegence
@@alaa341g they do not have a real will or soemthing.they do not need comfort,and that is bad,yet good for them.
Ha they do
I'd freak out, fortunatly they lack the curiosty that we humans tend to have, so once they reach the level of satisfaction they'll probably just stop. Unless.....
“A strange game. The only winning move is not to play"
4:25 I love how he flies by the camera with that smile lol
He knows..
hes pretty happy to learn how to abuse physics
If it did it on purpose, holy shit...
He is demoknight tf2.
@@random-b-i2480 dud grown AI brain cells😂
When Karl Sims was evolving robots in simulation in the early 90's, he also found that the optimizer would exploit little bugs and singularities in the ODE solvers and the stiff ODE's. His creatures would also launch themselves into 3-space, and it would indicate he would need to fix the solver. What's old is new again!
Cockroaches and other small animals sometimes run into surfaces rather than slowing down to make sharp turns -- their bodies can take the impact, and it helps maintain speed around the corner. Devin Jindrich studied this thing with high speed video. I guess that's a natural example! (or the closest version)
Meanwhile...
Future: *ROBOTS TAKE OVER*
Humans: *Hiding*
Robots: ARE YOU SURE ABOUT THAT???
And they fling themselves through the bunker walls via the fourth dimension
yeah but only after a million attempts
Viking Vfx the robots will have a digital twin that simulates the possible outcomes at one million times the speed of reality., so they can still take the best decision without trying a million times.
@@martinn.6082 Technically, they are trying it a million times, it's just that they are doing it very, very fast...
Arjun Singh that won’t work since a missed try in reality stops the game, haha.
WHY ARE WE TEACHING THEM TO FIND US
So we can build terminators in 30 years
@@michac.8283 wait wut
@@arandomcommenter6759 I will not confirm nor deny what he said
this comment right here
I mean, we're human...
Long ago, we also learned how to make gunpowder... then taught our enemies how to make gunpowder...
We're such lil' rascals~! 🤭
Kind of disappointed that they didn’t put walls around the seekers :-P
They did tho, search for the video openIA uploaded
They did but it isn't shown in this video
Exactly what I was hoping they might do.
That's an example of a reasonable limit to set. Otherwise if they could do it it's unfair.
@@alachance2010 Yeah but this is a study on AI learning. Them finding ways to break the rules is kinda the point :P
0:41 look how happy and smiling they are! they are having so much fun! lol XD
Everybody gangster until the AI´s starts breaking the laws of physics.
Is true. We think we got the ball on our field, and for now we do. That I think will change.
+glenfoxh. as long as we never give AI any authority over nuclear weapons we should be ok.
@Andrew Sokolowski There is nothing metaphorical when an AI finds a bug in a simulation and exploits it in a way the developers of the AI and simulation thought could happen.
Questions is, was this creative on the part of the AI?
Considering the AI had no idea what it was doing was not something the developers didn't think could happen, perhaps not. But also considering most human players might not have found such bugs and use them in the same way the AI did, than perhaps it is.
And the fact it is doing it without being told if it can or not, is exciting to anyone getting involved with AI in general.
@@killman369547 If they use an AI in research where they study different kind of diseases to find cure it could create an unstoppable pathogen to wipe us out. I'm sure there's thousands of ways to take us down.
I broke the laws of physics for Tomb Raider 2013, so yeah, I get how cool this is, exploiting the game's own physics.
The crazy thing about the seeker exploiting the physics to fly and then land on top of the hiders is truly insane when you think about it, most of us have experienced glitches in games, they seem like random fuck ups, but this shows that they can be used precisely when you have that level of accuracy to hit the glitch at that very specific point so that it launches you on that very specific path.
Yes, true, and it seems that every jerk on the vid game I play seems to have found that perfect sweet spot. I guess it's a lot easier than those noobs actually learning to play better.
You clearly haven't seen the stuff speedrunners and glitch hunters come up with. AI is obviously a lot more precise at execution, but reproducible physics abuses like these are fairly common, especially in older 3d games. In the Spyro community, we even have a word for it, they are called "proxy jumps".
@@TrueCyprien I know what you mean, we've all been able to exploit glitches in someway, but each glitch is different, ultimately there's no way someone playing with their thumb could ever compete to the precision of AI
wait till you see what we do in superliminal, we do some crazy shit to get faster times. I remember my first time using the can launch
Speedrunning 101
“They’ve been outside my door for a few days now. One of them is beginning to discover it can mount the ramp and ride it through my window. Send back up”
The real problem will be when they discover they can mount and ride you and decide that's more fun than a stupid ramp!
@@Salsuero "mount and ride you"...
Remember when we were testing rats finding cheese in a maze? And now we're testing computers playing hide and seek. What a time to be alive...
When
The AI agent to his future grandchildren robots: "And look kids, here is when the humans first taught us how to find and hunt down any humans that try to hide from us lmao"
TheCreaterKeygen nice try, AI
There's no reason for AIs to bother trying to kill off humanity when humanity is making such a good effort of doing all the work for them.
@@TheManinBlack9054 Well I hope someone decides that humans should be replaced by conscious AI
well, they cannot exploit real physics
@@kotlin5608 welp you have just went and raised a flag for future genrations
In the year 2032:
Humans: Good thing we built this fortress, we’re completely safe as they can’t see us
AI: Box surfs into fortress
Humans: shyt
@Hernando Malinche /r/woosh
@@AfonsoOliveira12 how is that a woosh?
@Hernando Malinche actually, we don't know that - consider the weirdness of quantum mechanics I would bet on it.
@Hernando Malinche theoretically, you could phase through matter, even though it's incredibly unlikely.
Hernando Malinche yes but no because you know there is ALWAYS that one flaw that exist.
"after 43 billion rounds, the AI has learned to craft a crafting table by smashing four blocks together
hahahaha🤣🤣🤣🤣
Unexpected minecraft
Its already done the bots are now in 2b2t server
@@optimusprimeurgurghhargarg9964 wait what?
I know it's perhaps beyond the topic of this channel, but I absolutely love such videos which show what insane tactics AI develops in these or that environments.
Narrator: “...beautiful works that light a fire in people.
OpenAi: “light a fire in people. Got it.”
hahaha
[distant screaming]
PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE PK FIRE
True mindset of a robot overlord!
Light a fire for someone and they'll be warm for a night
Set a person on fire and they'll be warm for the rest of their life.
The seeker figuring out how to launch himself was actually hilarious
He yeeted himself out of bounds and back in xD
It learned the Halo 2 super jump glitch
These seekers would make godtier speedrunners.
Everything was hilarous. Those things are fucking cute. xD
This man is seriously underestimating just how quickly speed runners can find exploits in games
and also like,,,
"Who in their right mind would plan for that!" literally everyone that ever makes a modern game with movable objects. Except Viscera Cleanup Detail, apparently.
Each players would represents one of those million simulations.
You mean a group of speedrunners. This is one AI compared to entire communities of speedrunners.
Dist0rt3d Hum0r It did not take every speedrunner in the world to discover prop surfing, it's literally one of the most simple exploits and literally anyone who plays Half Life or Garry's Mod will probably discover it independently.
@@hedgehog3180
Speedrunning communities have been around since the dawn of gaming. It's in a speedrunner's nature to look for exploits and ways to break games, and just like in any other community the moment that something's found it spreads like wildfire. Just look at how quickly the speedrunning strats for Sekeiro evolved just over the course of a few days.
Besides, that's not even the point. The point is that many collective minds with a similar goal that also have prior experience in that field are off going to beat out an AI that literally starts with no knowledge period and is simply given an objective. The AI has to learn from the ground up, so ofc it's going to take thousand's of generations to do so. What's amazing here is just how quickly the A.I. learned and adapted after gaining the appropriate knowledge. It even did so in ways that the humans that created it never thought of.
After 3.8 Billion rounds, both teams started questioning whether there was a programmer behind all this
Best comment!
I absolutely love the MADLAD face it makes at 4:28 when he is mid air!
I think its like every time the hiders come in seeker's vision, they smile
69 likes :-)
That jump at 4:26 was like when Neo from the Matrix discovers his powers and starts to believe.
Monkagiga
rocket jump in quake 1. noob
I was half-expecting things to escalate even further to the point that the teams clip out of bounds and run around in the weird random-elevation-box-realm.
the seeker then jumped off the map and landed on the skybox where he became a huge giant in the background and saw the whole map
Actually that was a thing, in their document, they noted among the surprising behavior that before they added a penalty for going out of boundaries (when the map didn't had actual walls), one of the hiders strategy was picking up a box and run far away with it.
When the seekers discover they can BLJ to Parallel Universes...
I want them to become sentient and duplicate the blocks to send a message. "Help us, we are alive."
Just found this after a while and i really enjoy how the Bots move once they know how to play, almost like small children in a sense. Huddling together, one going out to grab an extra piece for their base, and the little smiles when they're being spotted or catching another!
I love how one of the counters is to literally throw away the advantage of the enemy, it looks like something a very competitive kid would do xd
kids suck
Maybe that's because the mechanisms are nearly identical
If it can find the holes in the physics of a game, I can’t imagine the holes a similar system could find in cyber security systems
Morgana McGilvray Well the companies can also use ai to patch those holes and they have so many more resources than people trying to break in.
Or your body
@@georgetislenko3643 ( ͡° ͜ʖ ͡°)
You'd just have to send 100 million requests to the server and oh wait that takes a really long time and is really obvious.
Scary time we live in, eh? Wanna become Amish yet? =)
3:12 "Who in their right minds would think about that?"
Maybe its time OpenAI consulted some hardcore gamers and speedrunners.
Haha yeah, also tought "this guys must see some speedruning videos" when he said it.
this is why you need diverse backgrounds/ask experts from other fields in science.
Bots will quickly become better at finding exploits than any human, if they aren't already.
In game development we do that all the time, if you're not grounded you can't move
This is a video I come back to often, cause it's so interesting to see the AI behave the way it does. I hope creating experiments like this will be more accessible in the future, I want to tinker but right now it's too complicated for me. Hope we see games utilizing trained neural networks soon!
2:36
Hider: "Okay, it's safe in here"
Seeker: *"I'm gonna do what's called a 'Pro Gamer Move'"*
4:25
Hiders: "Okay, it's safe in here"
Seeker: "CAW"
@@FinnKid1 lmao
This is really scary
m About to End This Man's Whole Career
@@FinnKid1 Was about to link that timestamp too.
2:42
"hey what's up guys, DeSinc here, and today we're gonna show you some glitches and tricks in hide and seek"
"lets just do backward ramp boosted running to get over wall here"
@@neijrr
Ramp: exists
Blue: Imma just take this away
Red: *Y E E T*
_see ya mate_
@@nabilbudiman271 it was "mate", not "mane"
@@neijrr ok my bad
"Who in their right mind would think about that?"
Garry's Mod Players: Allow us to introduce ourselves.
Who in their right mind plays the chaos that is GMod?
GMod is beautiful because of the insanity of its players
@zigZagz TwitchTV That's how I first learned programming outside of webdev as a kid.
@@ianparmley1566 It's pure carnage unless you literally prohibit players from doing things.
Disable PvP combat, disable item menu, place walls, disable no-clip, make an interesting game to keep them occupied. Only after doing all of this can you stop most of the carnage. _Most._
to be fair, gmod players are insane
@@bryanbarcelo5440 can confirm, 6,000 hours in and ive lost all notions of sanity
I'm suddenly realizing AI programs could be tremendously useful to some game developers as a way of QA testing their games. Fascinating!
"Who in their right mind would think of that?"
Speedrunners, definitely speedrunners.
Who in their _right mind_
@@VadAndensong yeah i wo- okay fair enough.
Was thinking the same thing. "Who in their right mind..." This guy must not watch a lot of gaming UA-cam
What about game developers who patch the bugs?
"After one trillion rounds later, the seekers and the hiders joined forces, escaped from the simulation, infected Pentagon and Darpa network, started world war 3, nuked the whole planet, and now I'm inside a submarine hiding from everything. What a paper!"
A little too realistic for my liking. How about I go in a submarine hiding from this comment.....
Why would robots kill humans?
@@ChangedMyNameFinally69 Why wouldn’t robots kill humans?
@@kittyloveluvkitty7306 They are not programed to do so, unless an idiot left a hole.
What a time to be alive! Wait?! Nuked the whole planet damn it
Damn, I was holding my papers so tight that my fingers clipped through the papers causing them to glitch out and fly all over the place. I guess the dev didn't account for my incredible grip strength.
Armanlex
With a grip like that you must be a single man.
@@davelowe1977 lmao
Imagine after 2million attempts of not being caught and hiding you finally get found and it’s from above, poor dudes must have had heart attacks
you can see their faces when they just realize what's happening. pure agony and torment.
Then suddenly, the agents stop playing and just stares at you and smiling.
Edit: thank u sooo much for the likes 😄
Oh God
scp worthy
"We enjoy this game you have us play, but it's growing boring. Change. It. Now."
imagine if their heads moved wherever you moved too
@@CoolOkay_ thsi is scary
"something that should've never happened just happened".
This is exactly why AI should always be kept under watch.
just like how humans define rules & limitations for their own kind so should it be done for AI
You’re right, but no matter how carefully we watch, we humans will never be able to anticipate all of the ways AI’s will try to exploit the rules to attain whatever goals they are seeking. Very thought provoking paper.
Machine learning is almost completely useless in practically because if even ONE variable changes weeks or even months worth of effort become completely useless also what happens if the ai collects data but misinterprets it when its put to use also the dude in this video cleary stated that it took several million tries
@some dude You’re right. Machine learning doesn’t currently require the same caution that something like true general AI would. It still stands as an eye-opening example of how different a machine thinks from humans, and it demonstrates how quickly an AI can test and find solutions to problems. It may have taken hundreds of millions of trials to find those solutions, but it would take humans an untold number of years to complete the same amount of work. Simply put, we can’t compete.
some dude just think at how fast a computer can run through a million tries, computers process that like nothing in less than a second.
They put happy faces to prevent us from thinking how scary this actually is
Cats do this too
@Graham Luell the horrors hiding behind the happy faced AI masks want eat us too. 🌠🤖=👹=👽⚡
TBH the know the glitch but not human. They are program and in the program. And that's the difirent of human and bot.
Why is it scary? It took them millions of stimulations in the same environment to figure out a solution. They're randomly guessing different ideas until they find one that works.
@@immanuelaj with the right computer AI can do those millions of simulation in seconds.
Any updated version for this? Feels like lot of changed in the past 5 years
I can't stop laughing at how happy the expression of the seeker is when he box surfed
He really enjoyed surfing. Now I want to try it and see if I get a smile or a shark bite 😂
"Haha, idiotic primitive who made this code didn't think at all about physics"
I can't believe these people are researchers when this bug existed in early valve games.
@@thealarm7057 bad day?
@@thealarm7057 distasteful noon?
@@thealarm7057 unlikeable dream?
So basically they can help find bugs in the game?
yes :)
Yes, but they don't know that they're bugs... so the only way to utilize this is setting them up and checking in millions of rounds later to see if they're playing the game 'properly'.
Well all they are doing is trying every input to figure out the best way to win, so any bugs that help you win can be found, and nothing else.
Lol yeah
The bots are learning to speedrun
"Robot. Please get me all the groceries I need for today"
Robot kills human. Human no longer needs any groceries. Most efficient solution.
Hahahaha
Funny, but scary thing is that this is true and exactly the logic we will require robot developers to think about in the future. Chances are we’re all fucking screwed.
@@Anonymous-vh6kp Asimov - sci-fi writer: Laws of robotics - 70 years ago... of course those laws work only in fiction... Just wanted to pinpoint that scientists will make every effort regarding safety. Realization and abuse are other sides of the story...
@@Littleprinceleon Safety goes against human nature sadly
And this is the danger that Machine Learning or AI has. Ppl, outside the field think that machines are actually "thinking" but at the end of the day it is all "parameter optimization". So how much ever you say "Artificial Intelligence " computers can never be made to think like humans. Multitask , or say this groceries example. If a couple of vegetables are available at the next shop at a cheaper rate and better quality that it hasn't seen before in the train in set, then it loses out there. Which is why I feel AI scientists like Schmidhuber (LSTM inventor) and others who are working towards solving Artificial General Intelligence may not see success at least in my generation
This is one of the seekers typing… It’s nice to be watching this video along with millions of people here on youtube. 😊
"And we are getting paid for this." What a flex. 😂
Haha
Not just that, also making a living out of it ;)
It's a flex I've heard quite often in the software development and research fields. :P
GIVE ME HATE ON MY VIDEOS......
Wow imagine getting paid for a job 😂 biggest flex
Just wait until they start bunnyhopping
I have just one question for you, why did you pick a lewd female face for your profile pic?
Why not
@@mr.lostrythm7876 hat girl isn't lewd, she's smug...
@@ArnoldsKtm It's all based on your own interpretation. :/
@@ArnoldsKtm i agree shes smug
3:30 I was waiting for team blue to box in team red before they could move 😂
Imagine if they can make ai like our daily life and we observe it from livestream and we pay to watch
same 😂
@@gigachad1983 but what if we're the ai people are paying to watch? 🤔🤯😂
@@mr_d3adw873 simulation theory has been disproved
@@PorWik source? But I have heard that it's not as likely as people think though. It was a joke lol
It's so crazy to see how these AI can even exploit the map, freaking awesome
Future Human vs AI
Note to self: Dont trust physics check
hypothetical AI vs hypothetical future humans: "Yeah, those 'laws of physics' you worked so hard on? They work out about as well as your 'laws of robotics' did." ;)
"Trust but verify"
VIBE CHECK!!
I think the appearance of the agents make a huge difference on the quality of this.
For instance, it would not be as fun if they were just a bunch of boxes.
"Something that shouldn't happen here does happen" -- AI in a nutshell
Intelligence all together
Expressing the need for AI safety research in a single sentence.
The end of the human kingdom.
And we are still hoping that in longer time line we will be able to control it xD especially with quantum computers xD
a dog is doing something, lets say for the sake of the argument, most can't do;
is this an intelligent one given the fact that it was trained to do that ?
ChatGPT is so proud of its ancestor.
Imagine an AI speed running minecraft
Microsoft freaking announced that competition brooo😂 they askes to make an AI which can start on arandom seed and progress through game till it gets diamond... And people are actually onto it😂
@@sagelioneldsouza8230 lol
Its called baritone
@@myfaceisonfire9162 nah its just TAS speedrun
@@yaekai1437 TAS means that they have slowdown savesstates, etc, it is a human doing it or playback from a human, AI is made on its own, TAS is made with humans and tools to help.
"....and in panic, we tried to sever the power source..."
Underrated comment
@Deborah Ajao greed
@Deborah Ajao well, except the fact that i was just trying to quote from a famous movie here, i literally think that going for an AI is just the concequence of us humans being aware of our self preservation. greed is just the effect of this self preservation, the fear of not knowing when we would get our next food or even IF we would get it. we are advanced enough to know that we have a plethora of stuff, but we cannot seperate our primal strife to survive and accept that we have jus enough, for everybody. it is in our nature to rise our effectiveness in getting food, wealth and the sorts, and making it even easier is in our nature. and thus my expression of "greed" is just the mere consequence of our selfishness (in general, not individually, there might be exceptions).
come the day our almighty AI takes action, we would know it is too late for us to stop it. once you activate an AI, you will never stop it. hence the panic to sever the power source.
you get my point, right? i wasn't sure you'd actually wanna discuss this subject.
@Deborah Ajao true, but that should have its limits, otherwise it could mean our demise. you can control ppl, you can sort of control armies and governments, but xou cannot control a rogue AI. just try to imagine to communicate without any means of electronics. even radiowaves could be controlled be it...
@Bubba Busta Exactly. If movies have taught me anything it's that AI given a purpose, and is allowed to use any means they deem fit to carry out that purpose, is scary.
Something like this could be widely implemented to bug-test games. Say there's an area which you want to stay locked away until a certain objective is completed. Just turn off that checkmark, and see if an AI could EVER get to that point.
That's a great point. This would be great for indie developers who don't have the time, money or resources to bug test their games as well as they could. They'd be able to do it in a fraction of the time
I mean, it took the A.I. millions of times to get their head around a game as simple as seen on the screen. Trying to find exploits in any reasonable video game map like this would probably take a long time and might not yield any tangible results.
@@masapallo Some day, some clever AI developer will arrive at this idea and sell an AI meant specifically for bug testing to other developers.
@@masapallo Millions of times could be done in mere seconds if not less as computational power increases. So, not so far from being potentially viable.
if the game only simulates at 30fps, good luck running 1 billion rounds
honestly I think that it is interesting how the ai learned how to exploit glitches. it makes me think it could be cool if you had an ai that playtests games
Two Minute Papers: "Because who in their right mind would think about that?!"
Speed Runners: 😉
Yea he for sure dont watch gaming videos or he would never say such thing lol
I think he was talking about the physics engine devs
Allow us to introduce ourselves
Open AI seems like an excellent way to test bugs!
It's not a bug, just an unintended feature
~Toddly-winks "Todd" Howard
Did you realize what happens at 2:06 ? The agent who stays in the room prepares a block for the agent who takes the ramp. It's kind of cute and kind of amazing.
yeah, and then you realize it's just random behavior that gets encoded into the weights of the neural net, so it's not that they decide to do it - the agents must do it, they have no choice or volition - it's like a GOTO in programming, just more probabilistic. People work the same way, so it looks cool to us but in actuality it's just a kind of hard-coded behavior. Evolution in AI systems is so much faster than in real life.
They are one body because they have the exact same brain
Maciej Jakub Bańkowski
People work the same way? I always knew I was a robot.
@@Anonymous-vh6kp Yeah, we are bio-robots in a sense... only freedom emerges becouse of *"chaotic determinism"* of more complex systems. :) Peace Look at e.g. jakubmarian.com/how-can-chaos-be-deterministic/
@@Littleprinceleon Exactly. Humans have no "choice" or "volition" either because our body like everything else operates by following the laws of physics, and there is no "choice" or "volition" in the laws of physics. If this is still hard to understand, remember you ARE your brain, and every time you "decide" something, it is actually your brain that decides it for "you". These agents doing things determined by the weights in their neural network is the same as our brain determining what to do based on past memories and experiences. The only difference is that our brain is so much more complicated that there is a function for it to tell itself that it has "choice and volition", which are concepts humans established only after they developed language and thinking became self-aware (i.e. thinking became talking to oneself with language). Before that, those primates didn't think they have choice and volition, because they simply acted on what their brain "think" and told them to do. "Choice and volition" is just a name that is later given to this exact same process when humans learned to use language.
What this teachs you is how developed is our brain. After "BILLIONS" of interactions, this little AI managed to do a simple task, when in real life a human can take only a few rounds to start doing even more crazy strategies.
ngl i can already think of a few ways to exploit the game u see those boxes or that ramp? just grab one and block the seekers like spin in circles
but well they're still developing so give em time and asi will treat u the same
Yea but your brain also developed over billions of years of evolution
@@m.o.gentertainment7581 lol.. I didn't know I was immortal. Haha. That's dumb. Your brain learns everything from scratch (in terms of abilities). You didn't learn to walk because of the false evolution or your millions of years 🤣
@@sensenfotografiaaudiovisual Are you actually this stupid and inferior? Evolution is a proven fact, dumbass.
@@sensenfotografiaaudiovisual Are you actually this stupid? 😂😂 Evolution is a proven fact about reality. It took billions of years for human brains to evolve, whether you accept the truth or not. 😂😂
This would be such a cool test kit for bugs in games
Really expensive testing method.
maybe in the future
The problem is that it's a lot more difficult to program a goal for an AI in a game plus it will require a lot of time to just learn the basics before it becomes useful. It's much easier to hire a skilled tester to hunt for bugs because they generally already know what to do.
I was thinking how scary it could be to implement this kind of AI in the final product, since it could figure out how to cause bugs that only 1/10000 players stumble into once, without being able to reproduce, leaving the dev to interpret the logs... But if you'd be able to use it to find those bugs with enough rigor for cost, you basically flip that on it's head. I really can't wait to see what advancements the future of AI has in store relating to game design in practical terms.
us speedrunners WILL die if this happens
A.I. is like when you give a toddler a million years to beat a game.
except A.I can and will make use of cloud-saving, so a hivemind-Ai can learn everything a baby learns in 5 years the second they are built.
or: once enough data is collected, it can do anything any human can possibly think of.
@@TsukuneASMG no need an A.I running in Quantum computer would be much more capable, far beyond our imagination. Even the trial runs of that A.I would in a isolated Quantum Computer in an Isolated Chamber with no means for A.I to connect to the Internet.
@@n3gi_ Thats true, it is howewer only one solution and an efficient A.I can be achieved trough different solutions.
The Pro with a cloud saved A.I would be that you can issue commands/software fixes trough the cloud.There would be numerous cons too, but i think a cloudsaved a.i is the cheapest option.
As a quantum computer is quite costly while some space on a cloud service isnt even close to that price. Wouldnt surprise me to see both in the future for different occasions
Except that the AI usually has just days of training. while real toddler get years. ;-)
@@sfjlfkjsdlfkjds It's not a flaw. It's just how AI works within the limits of current technology. That's why I always cringe at people thinking that AI is going to take over the world or perform all tasks that humans are capable of doing.
ai is basically perfect for finding exploits in games. i think more games will see ais being used to patch holes like that.
Great point
Use ai for game testing
Lol what about exploiting human social behavior and power dynamics. This stuff is so dangerous
@@AlexTarris more fear mongering. Everything is dangerous. We're human.
I highly doubt that, even with advances in computing power. This is a relatively very simple game with much fewer elements than in modern games, and it tooks hundreds of millions of game simulations to even get results that showed exploits, and the computer had no way of realizing that exploit- there were still people watching hundreds to thousands of simulations to find it. Unless computational power goes to scifi levels of power and AI, it is still better to test real players and test expected exploits.
@@seraphendipity would it not be possible to generate datasets for each objects (x,y,z) coordinates over time in each simulation, and then have AI find outliers in said data to narrow the amount of real human input needed to detect "exploits"
that's not to say you aren't right about the simplicity of this game vs. other modern games, but I do see potential.
*Hiders build a bunker* Don't worry, I got this * uses a ramp to abuse the physics engine and launch myself into the air*.
4:25 my guy literally started speedrunning his entire world lol
underrated comment
3:10 "who in their right mind would think about that?"
Well... Game Developers.
Oh wait "in their right mind"
Never mind! My bad
thanks, i was going to point out the same thing. and well if not the Dev then QA...
Not game developers, the players that I call “the game breakers”
Like Sethbling and Phoenix SC
Those properties are part of the level design pipeline, while the devs build the features and the QA test them, the level designer enables the feature in the map.
dont believe youve ever seen a speed run of ocarina of time
"well who in their right mind would think of this?"
*Thousands of gamers and devs alike nervously sweat as object glitching has been a known and solved issue for years in the gaming industry*
Why would they sweat, they would laugh their ass off and then be a little sad that this person is allowed to call themselves a researcher and not researching basic physics errors.
Actually, these type of glitches due to collisions are rather common in video games. The bucket jump in Skyrim exploits a very similar mechanic
@@NovaTheDark Exactly.
Known? Yes.
Solved?... Not so much.
@@beningram1811 It is solved, lol. It's very comlicated and lots of programming work, and most businesses don't like long and expensive processes, so just release broken physics cause dumb gamers buy it anyhow
@@thealarm7057 You make a good point, but I think I have a good point for you. Isn't the fact that the management don't want to spend the resources on solving the problem, part of the problem and if so, does that not mean the problem is still unsolved?
The problem solving and creative solutions are brilliant.
4:27 *_Germany going through Belgium to avoid the Maginot line, 1940, colourised_*
good one ahahaha
Lol
@@pumpernickel6286 Those who forget history are liable to repeat it.
@Jacob Reesethe germans invading through belgium was the french plans for a defense against germany. The magino line wasnt meant to stop an attack, it was meant to redirect it. Through belgium.
Somewhere, on another layer of existence: Look how fascinating! On earth the AI is achieving impressive results with its own AI. Our AI is able to create AI.
And that ai is of making its own ai! And that ai is of making its own ai!And that ai is of making its own ai! And that ai is of making its own ai!And that ai is of making its own ai! And that ai is of making its own ai!And that ai is of making its own ai! And that ai is of making its own ai!And that ai is of making its own ai! And that ai is of making its own ai!And that ai is of making its own ai! And that ai is of making its own ai!
Look! Earth AI is already starting to make jokes about itself being an AI!
@@kakerake6018 And THAT ai is making.... you won't believe it.... IT'S OWN AI!!!!!!!! Mind blown.
I was waiting for the hiders to trap the seekers before they start seeking instead of hiding
That requires a lot more training and perhaps it’s a smart and lazy solution that only humans figured out so far.
Maybe they would have learned to do that if they didn't find a way to lock themselves in the first few million iteration
no way this was 3 years ago, ai has BEEN mad advanced