Creating a Self-Aware Lara Croft that Plays Tomb Raider
Вставка
- Опубліковано 18 тра 2024
- This video may be inaccurate and is made for entertainment.
The other levels of Tomb Raider 1 are here : • Creating a Self-Aware ...
The other levels of Tomb Raider 2 are here : • Self-Aware Lara Croft ...
It sums the process of creating an AI that plays Tomb Raider like Lara Croft would.
For those that only watch the result you must know this isn't a live-result, I explain it in the video, the game is paused everytime there is a comment generating, the result you see here is all the parts merged together, and there are a lot. It means you couldn't have a normal conversation with Lara Croft because each comment takes many minutes to generates.
Lara is still an AI trying to make us believe she is aware, this AI is just good at it because I asked it to take into consideration Lara's personality, it knows her personality because I told it all I knew about Lara Croft. It sounds realistic because of the voice and the "live-effect", but if you only focus on the comments you'll notice it's still a robot, everything it says or does can be explained.
This video shows what happens when you use multiple free AI to make something, this is an example to make people realize the potential of these technologies combine, of couse I didn't made these technologies, they are availbable and you can try them.
Our human brain is still more efficient and having a normal conversation in real life is way more impressive than this demo, we must take time to appreciate it because the fact we are all self-aware is more fascinating than anything, enjoy this crazy capacity and use the AI for good.
00:00 - Intro
02:01 - Identification
03:20 - Localization
05:00 - Vision
08:36 - Motion
10:58 - Personality
15:00 - Voice
16:16 - Audition
18:23 - Memory
19:21 - Result
37:44 - Debriefing
42:28 - Outro
If you want to know more secrets check out my playlist about Tomb Raider Weird Facts : • Tomb Raider Weird Fact...
Soundtracks :
Thanks to LEMMiNO for most of the OST, you can support his work there : / lemmino
List of the musics used :
- Aloft : • LEMMiNO - Aloft (BGM)
- Blackout : • LEMMiNO - Blackout (BGM)
- Cosmic Solitude : • LEMMiNO - Cosmic Solit...
- Encounters : • LEMMiNO - Encounters (...
- Melancholy : • LEMMiNO - Melancholy (...
- Triangular : • LEMMiNO - Triangular (...
Tomb Raider is a game developed by Core Design.
Sources of data : www.captain-alban.com/solution...
3D view of the levels : popov72.github.io/TRN2/
The render of this video was a pain, many clips to merge, many bugs, it's still not perfect with some lags by moments. - Ігри
The fact that she is aware of the music cues is hilarious
"dun dun" 36:20
The fact the it became aware that it was in a video game is frightening. It talks about the devs and the game design.
Edit: I'm now aware he did it on purpose
@@justanotherone9685 Cool thanks, I missed that.
@@thomaspeck430Because the man who did this experiment told Lara she is a video game character in a videogame.
That AI realized really quickly it was in a videogame fascinating...
Honestly, she's more enterntaining than IRL Streamers.
Given how immersed she is in her own character, the commentary feels soo genuine, it's so true to her (artificail) personality traits.
Do you know this NPC TikTok trend? AI is imitating humans and the real humans are imitating NPS's.
Is this the so called transhumanism? 😅
weird...
I'm sure they will get these things to work instantaneously, and also be aware of comments from people watching and even respond to them.
Yeah, the most streamers acts like robots from the same factory. Ironic.
I always loved original Lara. Now I love her even more.
One of the reasons i sometimes watch Neuro-sama. She´s a pretty schizo AI, but damn if that doesnt make for very funny situations, especially when collabing with other streamers.
Im super tired of every single miniscule YT/Twitch channel trying to be its own brand, peddling the same, boring merch with different logo and promoting it at every turn.
Sometimes, the people are genuinely entertaining but they just have to do this, so i leave.
Neuro-sama just does her thing, talk nonsense and be very rude to her creator, honestly the only Twitch streamer i watch anymore.
I love the fact that Lara uses the compass, despite it not having any gameplay purpose.
Alright, the result is so incredibly good that it's suspicious. If this is legit take that as a compliment. Somebody peer review this guy's work!
i was thinking the exact same thing.
It's fake.
It’s fake dude.
Yeah I don't buy it.
I did observe some odd comments said/conducted actions by the A.I , so that helped me feel convinced that it's actually great A.I because it's still very much prone to some very unhuman-like commentary/output.. @@Tariguz1990
I love how she slowly becomes more and more self-aware of being in a game.
Kinda creepy
@@toprak3479 still i feel a bit sympathy.
Viva La Dirt Legue has made an entire series about an NPC becoming self aware.
@@Conta_Minated Thats ultimately what Undertale is about
thats because the ai was programed to do so.
There is something really endearing about this Lara and I love how careful and non-violent she is.
Take the Turing test
Falling in love with an AI. 😍🤖
"die beast diediedie" but she did kiss the bats first
She's a lady, woh woh woh
I'm afraid that is due to her personality description consisting from only the positive traits. Or maybe she just has had the luxury of staying good - with the mansion and stuff.
Lara : 1
Arrows: 0
"What kind of person leaves their trash in a place like this?"
"Die you filthy beast!"
I love this, please keep doing more. Her commentary is as entertaining as playing the game
12:56 I gotta say, Lara having a backpack is definitely one of my top 10 favorite Lara Croft personality traits.
I like her melons
Now we seriously need a longer video where she plays each level for the commentary alone.
She is the Markiplier of video game AIs
we NEED this. i would pay money for it.
I love how it instantly went from "I love bats! I'm your friend, cute little creature!" to "OW IT BIT ME DIEDIEDIEDIEDIE"
She needs to play Animal Crossing to heal traumatic experience
@@genybror she could play Pokemon and seek revenge upon batkind
Probably how I thought the first time I played it as a kid too. 😆
Its like it will be: I love humans! Oh... You dont use the digitsl curency, you dont comply to the world government? Die, die, die!
I also love the leave me alone I am busy part! :D AI Lara is quoting Bernard from AOD. :D
also imagine playing co-op with an AI player like Lara, that would be so much fun
you can do that in skyrim with herika ai mod
Love the role play of the AI, but still creative enough to wonder if they are in a game or dream. And their archaeology knowledge driving their curiosity to the point that they consider taking risks just to see a mummy, but don't just blatantly kill the wolves. They prioritise based on morals, wants and needs.
Awesome!
"I know there is a medipack, but I already have several and it's heavy" then promptly IGNORES THE LARGE MEDIPACK
I laughed so hard
Little too realistic 😂
Meanwhile every player making her carry an arsenal of weapons: 😐🤔
Woo i didnt notice ! Awesome haha
Makes me wonder how she's gonna deal with carrying medipacks, pistols, uzis, shotgun and other items all at the same time 😂 Girl will be exhausted
@@MayModnar
She is certainly questioning why she isn't exhausted after constantly running.
36:29 AI being aware enough to point out that clipping through things isn't normal made me smile the most during this video
It shocked the pants off me.. was not expecting that!
for me that smiling already started shortly beforehand with the random "dumdum" 🤣
That's how it gets when you design even a remotely diverse distributed, coherent AI system
It just starts acting unpredictably
When i saw that , i ask my self if it is scripted.. it's impressive how the system use his knowledg of real world to interpret this, incredible.
@@Amenophis42 It isn't fully scripted, but some basic things are
Though they aren't as dumb and straightforward like GTA train either
12:51 "She can get angry. She is empathetic, as she regrets not being able to save the guide. She has a backpack".
Gotta love Lara's multi-faceted personality.
That is one personality trait that I sadly don't have 🥲
Carrying a backpack even outside of intrepid adventures is a personality trait once you're out of college.
or rather asymptom of being "well prepared"
Getting her backpack is very important to "the last revelation"
"She is not afraid to destroy infrastructure."
"she has a backpack"
definitely my favourite personality trait
She’s dangerously smart. Somebody review this guy😂
I would unironically watch hours of AI gameplay footage
Hope this one come true!
please make this series where we can just watch lara play the levels, her comments were spot on! hahah
There’s a very fun series of ChatGPT playing Detroit Become Human. I recommend it.
Yes please ❤❤❤❤
you dont know that
@@luks1207so y games are basically movies. Get out of here with that trash.
agreed
I'm a senior software engineer and have two (and a half) university degrees related to data and "AI". I've done various kinds of machine learning, including reinforcement learning. This is a hoax. Any one piece of this project would be quite the achievement in and of itself (hooking the unnamed RL framework into the game + the RL algorithm itself; the pipeline for screenshots to google images to result scraping to chat gpt to "personality-appropriate" comments; anything related to the "hearing" system), yet the author curiously fails to provide any code or screenshots of code in the video, a repository iink, names for all the "free" technologies used, or _any_ relevant information that a remotely technical person would be interested in and asking about.
In short, pics or it didn't happen. Yeah, voice generation was used for Lara's remarks, and for this video's narration, and some of the scripts might have been written using ChatGPT, but it's quite likely that nothing else here has been AI generated, and certainly no automated end-to-end process exists. (Otherwise this man would have posted a link to his repo and would have likely been getting some very lucrative job offers right now.)
My brother, if you wanted to do a "Lara's Mind" playthrough with voice-generated comments, you should have just done that. You'd still get your clicks and attention. Why the deception?
Thank you for this ! My thoughts exactly...
Makes sense.. if that was real we would already have 100% real time speech recognition and translation, 100% real time GPT, conscious robots, 100% Ai generated games, and things of that nature
thanks for your comment i thought honestly its real, shows how easy i believe things
Thanks 🙏
Thank you for exposing him.
Any comments video creator? 🤔
I feel like this guy recorded his own playthrough & then used the AI voice tool to make the AI read a script that he wrote.
ikr, how slow must a feedback loop be reverse searching an image via google, passing it into chat gpt and then filtering it, and then act upon it ingame. It's funny tho.
Yeah initially I was blown away but there are too many things that he didn't explain at all that the AI can seemingly execute perfectly. Still an entertaining video but I'm not buying it
@@RoyRope I don't know if this is real, so I'll still be skeptical. But for the processing speed that you are talking about, he said in the video that the entire playthrough took 3 hours to make and we're just seeing the completed version on video. So this could still be real, but not used for live gameplay or streams.
I hope it's real. And if it's not, I hope someone else makes it real. I'm not that good with AI to make it myself XD
@@DLTechy yeah but these numbers don't add up, would take a hell of a lot more time than 3 hours. Imagine every new item is a lookup to act upon, that would mean multiple thousands of lookups in this short fragment alone.
@@RoyRope You're overestimating the ammount of different textures / items that are contained within this Playstation 1 classic. All you need is a memory file (that can be achieved with the newer versions of ChatGPT, like the personallity filter). With a "if this then that" process loop, it's really not unrealistic based on current technology.
22:34 I love how robo-lara's attitude toward bats swiftly turns from "how adorable :D" to "KILL IT!" in a span of a few seconds lol
well they did bite her right on her face
FILTHY
Cuteness aggression!
What a difference an Ouch makes :D
“Die you filthy Beast!”
I could easily watch an entire play-through like this, so fascinating.
If it was real it would be easy to generate hundreds of playthroughs and also use it on other similar games. But this was made for youtube monetisation. Even if it was mostly real there would be an immense temptation to record the controller input and optimise it so it is smooth and then let ChatGPT generate the comments but rewrite them to be more interesting and then apply the text to voice. Or you just play the game yourself and write the comments so they are entertaining and just as viewers like them. Or risk it not being smooth and interesting and not make as much money.
Yeah. Let's plays are very entertaining when authors don't lie and make up stories about creating AIs
I really hope this happens
@@claudemartin5907 did you even watch the same video?
@@claudemartin5907 uhhhh, the guy literally spent half the video explaining how to do the process, in the contrary, the process of doing this is quite difficult, if it was easy, as you mentioned, UA-cam would be full of videos like this, and there is no reason to fake this video.
Well, my conclusion about this videos was that A.I. was not strong enough to play such a complex game by itself. What I really believed was the play-though was actually played and recorded by human, then the A.I. analyzed the video and generated the dialogues, to make her "Self-Aware".
More likely the script was written by the creator themselves, fed to a text-to-voice AI, and edited on top of the gameplay. I'm not sure how an A.I. would analyze the entire video and generate a script with such accuracy by itself.
@@tomekkobialka Yeah, that's closer to the correct answer. For example when Lara approached a ledge and said it looked too dangerous and then backed away to find another path, or when she was talking about being affected by gravity and then jumped several times to prove it. How would the video-analyzing AI know to make the comment about gravity and how would the game-playing AI know to jump several times? It's all created by human, that's how.
This is why i scrolled down all the comments. To see how many comments would have the same conclusion as mine.
However, it is still entertaining to watch and a tremendous and impressive effort to build such a video, respect ^^
Well you're all wrong, it's now been confirmed already it's real, if you actually watched all the playthroughs, you'd see how many glitches and tricks she uses no normal player would figure out.
@@NebolYes exactly. The explanation shows using separate AI systems but the gameplay itself shows a unified AI. In reality ChatGPT can say “I’ll go explore over here” but the movement AI is totally separate and would do something else.
The process you described in the first half of the video could not possibly generate such smooth gameplay and such thoughtful commentary. What a disappointment.
I love how she sometimes tries to rationalize the video game logic. Also I love the line "Also I know what I'm talking about because I live in a mansion"
I laughed when she said that, also “Lara 1, Arrow 0” and how she’s questioning how she hasn’t run out of ammo and tests it out by shooting then goes, “maybe I am in a video game.”
I liked that she noticed that she never ran out of breath when she's been running & talking for an extended period of time, maybe when she encounters a body of water she's make a comment on that! 😀
I like how as she grows aware it's a simulation that she feels the need to prove that gravity affects her to seemingly no one
"to seemingly no one"? The bot mentions that somebody probably is watching it, and it has teaching skills and a drive to do so. This combined, that behaviour makes total sense to me.
That was honestly a smart observation, I didn't noticed that the arrows lacked an arc given the slow speed at which they were moving.
@@martinklug5713 my point still stands.
She cannot prove it And there was no indication that she was making those statements for another person that she was fully aware of
the jumps are for positioning. the thing about proving gravity is after the fact justification for it by ChatGPT.
That was the most realistic trick I've been fooled by, bravo.
Same. I feel embarrassed that it took me so long to realize everything faked (i.e. done by a human, other than the AI voice and maybe some of the script). Maybe I shouldn't be embarrassed, given how many other people were fooled. I guess I'll just take it as a lesson in skepticism.
@@41-Haiku Yeah, I wonder if maybe ONE day something like this will be possible. But I doubt I would live to see it.
What about this isn't real? The dev explained it well enough to be recreated I think. He even adds the limitations of the technique in the description. The only thing that makes this not ready for market is the time it takes to generate her speech. But we can see the same tech is already being used in other games. So you've not seen the ai NPC mod in Skyrim or people experimenting with the ai in the replica demo?
@@anthonymark2516 lol, it's hilarious you call him "the dev". He has said he has no previous knowledge of Ai or programming. He didn't even answer what programming languages he supposedly used in this project. And we've seen exactly 0 lines of code. Compare him to channels that FOCUS on AI and have years of experience. They're doing "AI plays simple 2D game" videos! And they share either full projects or at least show the code multiple times in their videos.
@@Rapora9 Can you show me where you get this info from? No channel has years of experience as this is new. And yes I have noticed others using the same tech and getting the same result. Are you saying Skyrim ai are fake?
*This video may be inaccurate and is made for entertainment. *
How could such a genius as FoxMaster not be able to make an accurate UA-cam video of his own genius creation? Makes totally complete sense.......
This is fascinating. Her detached curiosity with a dash of whimsy is surprisingly close to how I'd imagine Lara Croft's internal monologue. "Hello, Mr. Bear! How did you get here, and what do you eat to survive? Give me answers!"
I thought that was very Let's-Play-like...
@@silkwesir1444that is a let's play. The robot part is a hoax.
@@virusdellayou sure about that bro?
@@Morsmalleo read the description and the youtuber's vague replies, at most the commentary is generated but with heavy guidance and editing
And I love how her voice still has the low sampling rate effect like in the original sound samples. It makes this "art piece" feel more authentic in a way!
But the original is of much better quality, you need better speakers or headphones mister. It is compressed but not muffled like the AI, c’mon
@@BeatlesOasisFan yeah sounds a bit analogue, but eh, could have been much much worse still.
This is an ai experiment but I assume permission from the original voice actor is still required to use her original voice samples to create new dialogue?
You got me in the first half, not gonna lie. Entertaining video. You fooled a lot of people.
Why would he spend all that time to create something fake and try to fool people ?
It makes no sense. You and other non believers are simply just struggling to accept things you can't explain.
explain
@@PsychoBackflip Do you really want an explanation or have you already decided for yourself? Because otherwise I can't convince you of the opposite anyway.
I LOVE how lara immediately takes her weapons because of the action music at 00:35:52 XD I love that!
This is just.... WOW! I love how Lara's personality has been potrayed!
Classic Lara is flawless 🥰 Except for the sun maybe 🤣
As someone who played this game all throughout the late 90s, this is fascinating. I hardly questioned ANYTHING Lara faced. But now I'm like "wait, that sure doesn't make sense. Why didn't I question that?". Anyway, I love this game so much and loved hearing Lara speak of her challenges in her own words.
Because you're closer to Dude from Postal or Doomguy. So we need to compare this with another AI setup to prove that you're not a Lara. And Lara is not you.
One of the problems with the game that I remember is that you couldn't tell just by looking at the blocky textures which walls and ceilings were climbable which meant for a long time I'd get stuck in one area not realising that I could monkey bar my way along a ceiling to get to the next location. Not with using a guide anyway...
Dude even with the limitations you mentioned on your description, this is a pretty amazing project. Cheers!
Ty dude 😋
@@FoXMaSteR001 It would be even more amazing if you could be honest about it!
23:27 - "What is it ? A Video game ? Is someone watching right now ?"
That's just pure gold (and writting this, I can't imagine what she'd say when marching on Midas' Hand)
It kinda made me sad how she didn’t wanna kill the animals. “Hello mister bear! How did you get down there? What are you eating to stay alive I’d like to know.”
Also her asking if the wolf is a ghost when she walked through it was actually very suspenseful. If this really was her own choice of words I am incredibly impressed.
Yeah, she avoided killing the wolves below the bridges, when most human players will open fire on them as soon as they see them because there might be loot down there XD
This is Incredible!!
One of the first things she says "It's strange, I didn't think there were wolves in Peru. Must be convergent evolution." 10 seconds in and I'm already dead. ^^
So it has emotions?
Because it wasn't actually AI, it was a scripted dialog for sure...
Goodness! It's really impressive that you were able to make such immense, groundbreaking strides in artificial intelligence: especially since there are *no* prior videos on your channel that even broach the topic! You must be a quick learner! What's even more impressive is that I can't find *any other* UA-cam channels with footage of Tomb Raider games being played by AI: that must mean you invented one of the most robust machine learning algorithms in gaming history...all by yourself! Holy moly, you're a real pioneer of the field!
Not only that, but you're also quite the comedian. Every time someone accuses you of faking your footage, and you respond by leaving a heart on their comment without actually addressing any of their claims: it makes me laugh hysterically! Keep doing you, buddy! A lion does not concern himself with the opinion of sheep.
Read the description, Mr. Obvious.
You call it "immense and ground breaking" but this isn't really that difficult to do. You just think it is because you aren't educated on AI.
@@halfmoon106 If it's so easy, then you do it.
@@halfmoon106 bro... his post was sarcastic.
I wanted to ask, you said "We need to teach the bot" - is there any neural network that controls Lara or are there pre-defined rules that the bot is following?
I would love to see/read about the bot architecture (the code flow in high/low details).
This is one of the most fascinating, brilliant and hilarious experiment I have ever seen done on a video game!! Hearing Lara questioning why there's music and jokingly saying "dum dum" is hysterical.
Her character is so adorable and witty! It would be hilarious if we ever got video games with self-aware characters.
"I know you're trying to help me reach the goal, but maybe it would be easier if you actually took a moment to look around and not kill me every two seconds."
That was a running gag in alot of ps2 era games but this just turns it up to 11
What modeling estimation model did you use? I see trained on renders of blocks with random textures and random orientations,
But is the output a depth map from the image? Coordinates? Block and its orientation?
This is so entertaining to watch! The commentary of her own voice brings this to a whole new level! :D
This is the kind of content and quality the Tomb Raider community needs.
I would watch every single level of the classic games like this.
Wonderful job and so creative.
Thanks MariaCroft 🤩
Me too
I hope there will be! I was so entertained by this
@@ferrugemalemao omg yes we need this!
omg yes please! more of such playthroughs! even if she needs help sometimes (most people needed guides to solve some stuff).
Then: We played video games.
Now: We watch other people playing video games on UA-cam and Twitch.
Soon: We will watch an AI play video games.
With that said, I want a full movie of Lara playing and commenting.
This is actually sad
I do that with Wrestling Games or Replays of battle I fought in C&C Generals.
@@lunarheadcrab8265 People have been doing studies of ai to be able to get better results when making npcs or ai that is your opponent in a game when you don’t have a live person to play against, like pretty much any racing game. It’s not too crazy or new, and it’s interesting to see how they perfect the ai!
I am with ya, it was humorous to hear the AI speak their mind of just the 1st level
Lara Croft as a Vtuber completely run by AI 👀
My mind thinks like this. You laid it all out in a detailed linear presentation. Very therapeutic.
Ty dude :p
Its just fiction.
The first sentence in the description says "This video may be inaccurate and is made for entertainment.". This should be a very good indicator something is off.
This is incredible. She makes a few mistakes but she's as sweet, clever and charming as she ever was. I would have killed for this as a kid
Dude that is crazy, i love that she makes jokes and is playful, dude this is a piece of art for sure
So true! I hope he gets here to do a livestream, she'd be a great streamer! 😄
Just wanna say that this video is just entertainment - like it says in the description - and not real. But maybe that's also art in a way.
It’s a masterpiece of a video! Loved it! Her personality shines!
@@air278 read the description again. It's not live-video due to all the lag generated by all the AI software. So the lag parts are edited out to make it more watchable. It's still real though.
@@imarchello That's not relevant to why i'm saying it's all fabricated. FoxMaster is pranking you all
this is amazing! I love how shes just vibing and doing her thing.
this is hands down the coolest thing ive seen accomplished with Ai so far. such entertainment. instant sub and i was so glad to see a few episodes already out.
You have been fooled. It’s staged
@@Tariguz1990 nooooo why ruin this for me this shit was so fuckin cool. thats some serious bullshet
@@jayhawk184 A lie is sweet in the beginning and bitter in the end, truth is bitter in the beginning and sweet in the end
¯\_(ツ)_/¯
@@Tariguz1990 honestly i still wont believe you till i here from the creator himself, what hes done here is very possible.
@@jayhawk184 Believe me? What does that have to do with believing? It's not like I know for sure, but if this video was real and his AI really worked that well, there wouldn't be a video of it on UA-cam, but he'd already be sitting in a company and making a fortune.
Just think about it carefully! Just because you want it to be real doesn't mean that it really is real.
honestly it captured 90s lara so well, arrows come flying out the wall at her and she stops, stands REEEALLLY close and remarks on how fascinating it is. You couldnt write a movie script with more character.
I really love her character. Almost feel the parasocial friendship forming. ☠️
This is amazing stuff! Clearly a lot of work was put into this...great job! Thanks for sharing!
Ty dude ^^
that time as a kid with no internet i didnt finished this game. i would love to see the complete playthrough of this
I LOVE this. If you upload a full playthrough of the ai playing TR I would watch the whole thing. ❤
So would I 😂 it’s like I’m getting to know Lara more 😂
yes! full playthough plz
Yes id love it too
Yes please!
I genuinely don't know the scope but I would really like this also
I'm not convinced this is real, but it was still fun to watch.
How do we confirm that it's real? Should the creator share the plugin or source code or whatever is used?
100% not real
@@johndoe1646 Ideally, yes. Or at least some footage of them working on or testing it lol
It's very not real lol
Maybe you don’t know just how far ai has come.
Omg, I loved Lara Croft games as a teen girl 25 -30 years ago, and I need to save that Video for watching later when I am on the couch!
Really fascinating and nice to watch!
Good Work 🎉🎉🎉
I would love to see more of this, the voice generations are brilliant! lol.
Great video!
Ty dude, there is a full playlist of the first game and second game is in progress, there is also an updated video ^^
The most disturbing thing the AI does is deliberately not picking up medipacks
I need more of a tech deep dive before I accept this was done without human intervention 😂
The commentary part is not AI. the rest might be a TAS run
I love how enthusiastic
There is no way current AI could do this without a lot of human assistance.
Yeaah, im pretty sure the dialog was 100% scripted
That technology doesn't exist. This is just clickbait, and a description to cover their ass. Not to mention that scientists are terrible at gaming the algorithm. If this tech was created, it would be called something like "Stochastic Actors within Virtual Environments" and would have 163 views.
Ok, there's one thing I really don't understand. A great example is at 25:45 when she shoots while spinning on herself, right AFTER saying her magazines should be empty.
That, and a lot of other examples, seems to imply that the voice lines somehow influence the bot's decision making. But from what I understood, the reverse image search to voice pipeline is an "exit" path, starting at the image analysis, and is not part of tye decision making workflo.
So what's happening there?
It's fake.
I knew from your TRII video, that you're a genius. But this is even greater...
My God I never for a moment expected AI Lara to be so entertaining. I think I could watch the AI play through the whole game with commentary. Subscribed!
It's a fake AI. Look for other comments for the explanation.
I never thought I'd say this: I would definitely watch more videos of Lara Croft playing Tomb Raider. This was crazy!
So glad i stumbled across this 😂 one of the most entertaining TR content i've seen. Can't wait to keep watching. Thank you for the laughs!😂
This is how NPCs should be programmed in video games. If 1 guy can do this, an actual development studio should be able to create real self aware NPCs, making the game feel like an actual adventure. AI is the future of gaming.
The video is most likely fake/a joke.
1) She turned on those bats really quick: "I love you! Ow, it bit me. Die, you filthy beast."
There was no pause in between, that was all in one breath.
😂
2) She became aware of her medium even quicker: "Another medi-pac? What is this, a videogame? Is someone watching me right now?"
😱
Given those two informations, feel free to draw your own conclusions.
😅
he said that its pausing the game between every text to speech but its sped up so its instantaneous.
there is A LOT OF PAUSES, the video is cut, the guy cut the loading for each audio request. he even said this in the video
Also one of laras traits is that she's aware she's in a game.
Could we... get a full playthrough of this please? This is genuinely fascinating.
Agreed! Was looking for this comment! ❤
Agreed. Full playthrough please!
Full play through of the classic games pls 😢 if possible! 😅
That's fantastic! Especially I was impressed with her comments on gravity not influencing on arrows, about a ghost wolf dead body, and comments while discovering third person view. Seems like she is really discovering she's a computer game character. Brilliant, thanks for making this project and video!
This may be a little old but thanks for making the series I'm going to be obsessed with for 2024
Ty dude :p
"She can get angry, she is empathetic as she regrets not being able to save the guide, *she has a backpack,* she is capable of sparing the life of someone who tried to kill her..."
I'm dying
Lol I meant the ability of carrying stuff XD
The backpack part made me laugh too. Haha it's the mark of a true adventurer and badass, after all.
A true explorer must have a backpack, it's like practically a rule.
"she has big boobs" LOL
Cracked me up too man 😂
I love how enthusiastic she is about new things. When she met that bear, that had me in stitches! "Hello mister bear" 😂
Yes, it's a fun let's play, but no sophisticated AI is involved. It's fake.
@@virusdellaits almost like the whole video is dedicated to explaing how its a "fake ai" and how to guy managed to make it look real 🤔
@@theFishy_A lot of people saying it's fake doesn't make it fake. We live in a time where mid-tier (at best) intellects feel they'll be perceived as smart or free-thinkers if they're seen calling everything fake.
@@allrequiredfields they're all going to look so dumb when AI-players+AI-commentary video game streams (with absolutely zero human involvement other than to set it up) become commonplace. We obviously have all the AI technology to make this possible...Not sure why it's so unbelievable to all these low-IQ turds that _somebody_ out there in the world has the time, and took the time, to make this happen. This will be all over the place soon, once AI tech gets to speeds where it can happen live. (Instead of needing to constantly pause the game, which OP edits out of these videos)
@@allrequiredfields just reflects how they're not really understanding whats being said or how any of this works
Love this vídeo!! ThIS dialogues made me feel like playing this game for the first time. And I loved the thoughts like: "I'm dreaming or in a video game" 😄😄😄😄
Bruh I died when she kept breaking the fourth wall
I assume there was a TON of work that went into crafting the AI... but this could as easily have been a person playing it.
this feels very suspicious... i really really want to believe this, but i think it's a hoax. And even though the first part of the video was convincing, during the play through things got pretty fishy because it displayed capabilities that the AI tools he used just don't have, especially not as separately 'stitched' systems, to do some of the things done in this video each AI would have to have additional knowledge about each other that they just cannot have without an whole 'integrated' AI system.
Here are some examples:
The main clue is that Lara's audio generation AI is consistently and repeatedly able to predict what action the 'player AI' is going to take, even before the action is taken, and since the text and audio generation system is separate from the movement system, it relies on the visuals to generate appropriate textual content. i.e. the text and audio generator is just an observer/commenter, it cannot take actions or know what the 'player AI' will do 1 second in the future. Basically, it is impossible for the audio AI to predict the next move without having knowledge about it first, and in this case, it's knowledge is exclusively based on things it 'sees' in the game window, and since the action has not taken place yet, it cannot see it to be able to comment on it. That on its own is enough to convince me that this video is fake.
Another clue is that the image recognition AI that uses Google Lens to detect images is also separate from the player AI, and the player AI seems to be making choices based on the insights gained from the image recognition. again this is an issue because those two systems are completely separate, think of it like TV commentators at a sports game, the players have no idea what the commentators are saying and therefore the commentators can have no influence on what the players do.
I absolutely second this. It shows how little most people know about how AI systems work, that they are willing to believe that this could be real. A good amount of credit regarding this also goes to the long intro explaining the way it would work. It is pretty well done until they just butcher it by having it do impossible things.
@@Sparkfist83 I've actually just come across some pretty damning evidence just now.
so, his channel has no mention of AI until this video, and he's never demonstrated any programming skills, only some video editing skills and an interest in tomb raider. then, if you look at his community posts, there isn't a single one that mentions AI or programming, it's all just tomb raider polls. then two weeks ago, just before this video came out, he does a community post where he talks about having trouble rendering a 47 minute long video, he says its taking 24h to render because he has an "old computer" that appears to be prone to crashes and still does backups on an actual spinning hard disc drive. and he's clearly talking about this video because the community post came out one week before this video was uploaded, and no other video even comes close to that length of time.
riddle me this: how can he train a crazy complex computer vision + game playing AI, speed it up 40x like he claims, train the AI to actually play competently in under a month, as a solo developer with no apparent background in AI, and with a self reported "old computer" that struggles for hours and hours to render long videos and apparently uses an actual literal old fashioned spinning hard drive to store and access the neural network?
I think we all know the answer, he's just a guy with some video editing skills that didn't expect this to blow up like it did
btw I have the screenshot of the community post in case he tries to delete it (which would now just make him look more suspicious)
bummer if true. however, it was still fun to watch@@kerrcampbell7407
An easy way to see that it's fake is to turn off the sound and comment on her playthrough yourself, 5 seconds at a time, and then compare.
As good as ChatGPT is, it's still not fully human, especially in terms of awareness of videogame. A human will be able to perfectly understand what's going on in the game, but one thing they won't be able to comment on is AI decision-making. We can't know when and what the AI will do. Therefore, we cannot make a comment like this: "what is the solution here? I'm dumb, it's in the middle of the room". 34:00 Making a comment like that would require us to know the change in level solver AI state, and we simply don't have that information.
Likewise, ChatGPT, as described in the video, is unaware of the state of AI level solver. It is, even in a perfect world, commenting on what it sees, just like us. And so for the same reason, it cannot make predictive comments, it can only make descriptive comments.
I mean, theoretically, it can, but then we would see errors in the other directions. Something like "I'm about to jump", and then Lara wouldn't jump, so then ChatGPT would follow up with something like "Nah, that was just a joke". That's another telling sign, by the way - AI Lara never ever makes any mistakes.
also sometimes she jumps where the place she lands on is almost totally unknown and she doesn't know if there's a hole where she could hurt herself for example
It's amazing how the comments make a 27 year old game much more immersive and entertaining. Real or fake, it shows the power of curiosity and imagination.
Astonishing interplay between different networks, how long did you work on it? Considering doing something similar for FPS titles
Why am I finding this now? This is phenomenal!!
Seeing Lara as a person who is not affected by ludonarrative dissonance feels like she's more real has more real reactions than an average gamer. It's really fascinating
The 'eh-heh-heh, Lara 1, arrows 0' made me smile from ear to ear. And the bats. Wow. Also she did NOT just say 'leave me alone, I'm busy'.
just like in Angel of Darkness the NPC in Paris
"Another medipak! What is it, a video game?"
This is fake, search for this video but add "fake" at the ende. There is a video on it
Bro whether a human or GPT-3 generated these comments they're still very funny @@skontejonte
Dude, I love you this is awesome!
Ty dude, there is a playlist with more in description ^^
@@FoXMaSteR001 saw half by now) Please do more videos with your comments, outtakes, places where you helped Lara, places where Lara comments on her previous failures
I absolutely adore her playfulness and immersion. And the fact that she doesn't run around killing everything.
Tomb Raider has no drive to kill and only does so if the situation requires her to defend herself.
Speaking of drive to kill..
To try this with DOOM would be super interesting, as the goal there IS to kill pretty much everything.
I would love to see that
36:30 I'd love to see what was going on behind the scenes when the AI freaked out noticing its feet clipping through the wolf.
I'd also love to know what was happening here, how was LaraGPT commenting on the disappearance of the feet markers?
Edit: After reading more of the comment replies, it seems multiple things can feed into GPT - such as the marker information and, perhaps, movement information. Then by chain prompting using a keyword summary of the last several comments, it can create complex reactions. There are also some pre-prompted memes for it to draw on, from what I understood.
@@SlvtSammichArchive But nothing feeds from GPT to the player controller AI so why does it do things in response to them such as pull out the compass, shoot the guns to test them, do vertical jumps, respond to her freaking out about loud noises, etc? Seems fake to me. A lot of those actions would only be done in the context of reacting to voice lines rather than voice lines being made in response to actions taken in game by the player controller.
@@matthewbadger8685 I'd agree, because he didn't cover the input control very much, if at all, I read his comments and tried to get a sense of how it might be working - IE, certain GPT keywords may cause custom inputs, or a host of other possible inter-system interactions. I have come to the conclusion now though that the entire project is a fabrication, and any benefit of the doubt caused due to the broken English replies of the creator has been retracted. I believe his comments are just hand-waving gaps he himself doesn't understand about what the video is implying. I think the AI generated elements are Voice + GPT, but not in response to anything other than manually watching his own gameplay and trying to think of things to prompt. It's a shame too, because a lot of this tech exists and could potentially create a similar experience, combining image processing with some sort of weight based genetic algorithm for input and navigation, in conjunction with the reverse image lookup texture method > collate top keywords > use them to prompt responses. It could have worked, which is what makes this video such a disappointment in reflection.
This deserves to be in a museum of something. Brilliant work 👏🏼
Wow, just wow... this is next level, I'm not entirely convinced this is not fake yet but with the video being so detailed and reading the disclaimers in the description I really want to believe it is, mad props to you, man!
It is absolutely fake, since several processes are simply too error prone to work as good as shown.
For example the audio analysis alone of "Ugh!" would not give a deterministic result of an expresssion of "pain".
Ok i think i'll watch all your videos. That's fascinating to see Lara so fun and clever like that. I'm pretty happy to live in a period where this is possible.
Ty dude ^^
This video needs to plainly state that it's pure science-fiction right at the top of the video itself. Not just as a blurb in the description section nobody reads. This isn't a satire and it flirts with what's possible in present; you'd have to be in the know when it comes to programming and AI limitations to be able to see the cracks in the story that reveal it for what it is.
When something plausible is falsely stated with mocked up proovers and no obvious ulterior motive-- that's just lying. I don't see any other way to interpret this. It's just lying.
What's worse, is he released a follow up, and again, didn't reveal that there was no AI agent, and continued the ruse in the description that he managed to 'fix' issues with the AI bot that wouldn't allow him to finish level 2, miraculously 2 days after his first hoax video blew up. He is the fastest AI developer on the planet, despite only having access to GPT and Audacity 😅
Thanks for pointing this out.
This video corresponds exactly to the presentation of a project made by a salesman selling his product (whose development has not yet begun).
Obviously, the salesman has not had any discussions with the developers beforehand. 😂
"If you do this, plus this, plus this, you get this. Easy!"
molyneux has entered chat
In other words, the video is mostly faked.
You could tell it was faked right at the start when she notes she is trapped. An AI would not conclude that. Also when it comments that the slits in the wall are like those in mediaeval castles for archers, then arrows start coming out, that is way to convenient.
I go into deep detail about why this video is a hoax on the Tomb Raider subreddit, but yeah, this is click bait
First line of the description "This video may be inaccurate and is made for entertainment."
Admittedly, it would have been enthralling if I felt like it was real. There's just no way, I'd bet on it. The AI doing the task isn't ever said, it's not a public API no way and I don't expect they're paying for a private one since even people I know that do pay for their videos tend to have latency and there are limitations that you can't push, this feels like fiction for views.
Wow i just discovered your work today. It's genious and the result is unbelievable.
Unfortunally not in french like the way i discovered this game first but it's a nice way to practice my english too.
This is so damn cool. You have earned my sub.
What completely hit me was that Lara stopped taking medi-packs with her after a certain point. She said that she already had some and that they were getting too heavy to carry. I assume that human players always collect these packs. Especially because one of them was a secret and is perceived as a reward. I thought that was great.
Unsure if I believe this is actually happening, can you do a more in depth video of how everything was trained?
This, I dont see any mention of the technology used, I wont call it fake right now, but as it is, it could be just video editing, but I will give him the benefit of the doubt
If I watch other videos that show how much ai struggles to play way more simple games, I assume this is just well made youtube entertainment. The visual understanding of the whole surrounding is just too good. The whole sarcasm and questioning of her commentary is too good to be true.
@@jBurn_ I think the same... I think this is fake
voice is ai, script might be, gameplay is done by a h00man
Yeah, sadly I think this is fake. It had me going for a while though.
25:50 no way she started blasting her guns like that by her self I refuse to believe 😂 😂
You good sir deserve the sub and like! Holy crap this was epic! 10/10 plz make more
Ty dude, there is a playlist :P (description)
@@FoXMaSteR001 Oh yeah, I already watched all your episdoes of this game; such nostalgia! Also I'm in IT so seeing you use AI for this game, teaching her, all of it- this made my day, if not my week!
When she first meets the bats and loves them then turns to hating them upon attack, or when she walks through the wolf corpse and freaks out about him being a ghost hahahahaha
Def sending my friends over to this channel! Will be looking out for more from you in the future!
seeing herself in third person and commenting on how weird walking through the dead wolf texture was, was really fascinating. Great work! Please keep working on this!!!
Also, checking out the bottomless magazines. Because YOU also would do it.
Yes, fascinating what can be achieved when faking an AI. Or do you really believe that the code playing the game listened to the commentary from ChatGPT about seeing herself in third person, and then figured out that circling the camera around would be a nice way to test it, and then it performed that action in the game? You believe that?
Most likely the _other_ way around: the bot randomly moving the camera around itself, and _then_ ChatPTP, in order to write a text about the weird camera moves, coming _a posteriori_ with the whole "I see me, let's check me out" lines (by the way, not an unusual kind of answer when you specifically tell an AI to write 4th-wall-breaking lines).
(Basically: Bot moves camera to where it can see itself - chatGTP writes "I se me! comment" - bot moves camera around randomly - chat GTP, that remembers having comented in seeing itself, writes "hey, let's check myself" as answer for the camera movements).
There are OTHER things less likely that that in the playthrough (like the "let's check the mags" part), this particular thing is actually completly compatible with not being a fake.
The one of the mags COULD have been generated randomly, through a similar procedure, but it would have been a... remarkable coincidence that the bot randomly chooses to do a 360 burst right after Chat GTP decides to comment on the bottomless mags (which *on itself* is normal, ChatGTP is quite aware of how many rounds a semiauto usually holds).
But the audio commentary is only supposed to react to some rudimentary images (google image search) and sounds if we believe the first half of the video… this level of awareness across so many different domains honestly just triggers my bs detector
@@ManuL2444 For what I've seen on the first vid and in the "update" vid (go and check it out), it's not very clear how the recognition resul is sent to chatGTP.
(He also mentions, explicitly, that the "bot" often has troubles and needs human help. In the update he talks more about that.)
In the update he shows a script, but I'm inclined to believe he feeds that script _manually_ with the google image results, muic cues, etc.
My theory is that this is not as fake as some think, and that he has ndeed done a "bot" that plays Tomb Raider, but that he does indeed manually input all these results to chatGTP (which would, indeed, yield these results) to get the humorous running comment instead of it being a fully autonomous system.
Let's be honest, even that would be actually quite impressive. More than "bullshit" or "utter fake", I would call this "embellishment" and "slight exageration for dramatic effect" (in the case I am right. If HE is right and we are wrong, I'd call it "impressive - most impressive" instead.). SInce this is just an hilarious YT video, I'm willing to let it slide. If this were a submission to a peer-reviewed science publication, we would have the right to call it "bullshit" or "fake" - but as things are, I think people is overreacting a _wee_ bit.
its surreal that it is actually much better commentary as it immerse to the game as if it's her real life adventure. truly fascinating.
It's a fake AI. Look for other comments for the explanation.
@@virusdella yea. but look at least we just need few more generations to fully automate this. truly fascinating really
@@denmarkco3304ah yes truly fascinating how humans can make fake videos.
Could you please make a list of the various AI programs you used to create this?
he didn't use AI to make this. hence why he never mentions any programs.
I love this! Discovery dialogue from Lara... Wish it would've been added into the original hehe! But seriously, this is amazing!!! I 100% enjoy and love this and would easily watch a a full playthrough just listening to her commentary along the way