That's cool but really only a quarter of it. In truth, the most useful aspect of this is in worldbuilding and random generation. Cities can now be filled with people without sacrificing much depth at all and having serviceable dialogue even for each passerby. Imagine Daggerfall's scale with the craft of Skyrim around certain areas where more scripted NPC's would frequent and interact, such as gardens, taverns or guilds, so that the world itself can be believed as much as the characters in it: this would be such awesome delight to the mind and doubtless immersive to no end.
This is actually insane. The roleplay potential just shot through the roof. And if characters can interpret orders to go do something, the world could really become living and breathing... or potentially off-the-wall chaotic.
That's what i was thinking, everyone is talking about "Oh, dialogue will be so much better", meanwhile i'm waiting for the time i can order lydia to go steal every single sweet roll in whiterun in actual conversation.
As long as it is purposefully all within context, Gaming worlds may truly come to life with AI driven NPCs. This is the kind of thing many gamers have dreamt. of. No more "ghost towns" and glorified mannequins just walking from point A to point B with a couple of repeating lines.
@@ApolloCalrissian tbh they'd probably Zero-Sum out of the game after realizing their life is a lie. It would certainly be fitting if it happened in The Elder Scrolls.
Ahh... finally the chance I was always looking for, "Delphine, as I am the dragonborn, the blades will follow my orders, so I'm not killing PAARTHUURNAX!"
@@BLACKxOPxPRExTARGET AI as it is now takes a ton of resources, that's why there is a restriction on the number of requests one can make to ChatGPT 3-4 within a given timeframe even if you have premium you still need to wait a couple of hours, maybe we will be able to deal with the energy problem in the future? I honestly doubt it
"insane" refers to a state of mental illness or derangement that significantly impairs a person's thoughts, emotions, and behavior, to the extent that they are unable to function in society or understand the nature of their actions. It is often associated with severe disturbances in perception, reasoning, judgment, and the ability to differentiate between reality and fantasy. The term "insane" is sometimes used colloquially to describe extreme or irrational behavior, but it is important to note that mental health professionals use specific diagnostic criteria to determine whether an individual is experiencing a mental disorder.
Apparently sleeping tree sap is legal in skyrim, at least I believe it is, perhaps its like weed in our world. Legal in places but still clandestine. And given her relations with the caravans that seems i character
AI driven NPCs could make game worlds actually come to life. No more "ghost towns" and 2-3 repeating lines for NPCs. Game devs could just focus making character parameters, and direction and the AI can fill in the rest within context.A gaming experience can become unique for all players.
Or... we can aim for the future with games like Baldur's Gate 3, handcrafted with so many possibilities, ability checks, racial/skill/tag based dialogs that devs handcrafted and thought up and never think any world is boring... Too bad AAA devs will never reach the level of Baldur's Gate 3 since it's way before its time.
@@xbon1 You can thank capitalism for that. Why spend a million person-hours crafting the in-depth and customized experience possible when you can spend a tenth that and use the salary money to buy yourself another superyacht? AI is neither the solution nor the problem. The way it's used is simply emblematic of greater forces.
What is blowing my mind is how logical and reasonable this ai is. None of them have said anything off-putting, awkward or out of character. I’m baffled.
Once you start talking to the ChatGPT client for awhile, you start to notice there is no fluctuation in their manner of speaking. Rather than in the actual game. I.E. their personalities may be different, but they word things the same way and always toe the line.
@@Kaleun14 You can actually get it to throw off that consistency by telling it to be rude, belittling, aggressive and emotional when it responds. Due to the fact that the AI is naturally very conflict-averse, the output ends up being less mean and more 'inconsistent' and human in its delivery. It becomes more inclined to use language that has lots of fluctuation and realism, though with the consequence that it can sometimes be scathing in its comments. Whilst this is not a solution for all styles of speech you want it to emulate, it's a step in the right direction. I'm sure there's some combination of instructions that can cause GPT to be more variable without being as mean.
I kind of low key hope this is the reason they delayed Starfield again... Pipe dream maybe, but imagine if Bethesda knew about this already or had the same idea and decided to implement it themselves.
@@RazorsharpLT because the risk is too great for a company. They could train their own model only on specific ES texts, but it wouldn't be as dynamic as Gpt4. You could never bring it to production yet because it's just too wild at the moment, it's so easy to get it to say something offensive and Bethesda wouldn't want the potential lawsuits of an npc telling someone to do something bad aha
@@antonderzauberer lol we don’t know if it was literal or a joking metaphor. Another guy says he took an arrow to the chest. Why do people act like they absolutely know something when there’s no context.
If we could integrate this with a voice chat, and get the LLM’s running fast enough to interrupt you, true VR immersion like never before could be achieved
@@ChipsMcCliveI think it’s pretty obvious that it would be a separate and integrated system on a per game basis. Did you just think the whole world would only use gpt-4 for everything?
I can only imagine the nightmare it'd be to write something up that can procedurally generate quests from dialogue. Hats off to anyone brave enough to even dare trying out such a task.
Would it be easier to do in reverse? Improve the radiant quest system (or use an existing mod) and use the quests generated as prompts for dialogue surrounding it. I suppose emergent quests from niche dialogue generation is still a step up from that.
Imagining a mmo game where the ai run freely making their own factions and passing info like irl. Leave for a month and it could be a whole different situation. Can’t wait to see where this goes in the next 5 years
I love how the guard just kept laying out similes over and over every single line. It's like he did it once, and then the AI was like "yeah, that's this guy's thing now."
Right? But that can be justified as poor Rolf being nervous talking to an actual mythical figure, trying to talk him up and get on his good side. His character developed throughout the conversation. And the fact that Irileth didn't just continue with the similes shows that the characters are separate, and can each develop independently. Imagine you go around Whiterun telling everyone how you slayed a dragon. Some people are awestruck, some people already heard, some people just don't care. But everyone remembers how you introduced yourself to them. Then a rumor spreads that the dragonborn is a braggart, which loses you reputation with certain factions... The things we'll be able to do with this tech is awesome! I'll probably be dead before a game like that can be run on a home computer, but the fact that it's feasible (on large systems) _today_ makes me so excited for the future of gaming.
OK, that conversation with Rolf the guard made me a believer. When you revealed yourself as the Dragonborn, his reaction was very impressive. Obviously, this technology has MASSIVE potential for any RPG into which it can be incorporated.
@@cheesestyx945 Literally. At first I was amazed how well this worked and how authentic it sounded. But then he started to speak those bars. I'm truly amazed and can't stop being it. A simple guard has get such depth is just amazing.
I am actually blown away. This changes so much. Instead of predictable dialogue trees you will never know what is in store, and you can miss quests if you don't dig deep enough. Add in voice recognition and you could literally live in a virtual world of your own making
AI could be very unsafe, but if it was safe, we could create our own god. Imagine a complete virtual reality. With games created by a hyperintelligent AI, which creates games on the fly. Not only according to your wishes, but according to your psychology, which it understands better than you yourself do. A fully immersive, fully unpredictable game that always goes in a way that you enjoy.
@@hafor2846 I can't say I could resist. I can't say I love this reality enough to fight for it. A world entirely yours to live and fight for is a dream and nightmare in equal measure.
Its pretty much how dialogue system worked before the dialogue tree became mainstream, but in AI sugarcoat. You input trigger words, NPC answer with preset data. Like how morrowind dialogue works but this time it will be in a form of an actual conversation which is a huge step forward in terms of immersion.
I love how the AI decided that Balgruuf is the stoic guy that will always answer straight to the point and not elaborate more like the giga chad he is. What a time to be alive.
They tend to overshare. They need situational awareness (public place, in private, secret place) moods, and relationship. If they dislike you the AI should generate more blunt, guarded, or dismissive responses. As well as if they are in a bad mood, or in public and you ask them something like "DO YOU SELL SKOOMA?!"
yeah it's not even remotely advanced yet for me to even WANT to see it in a game. like this is a sick experiment, but at the current moment it's just.. not good.
I mean isn't the game already like that though? Ysolda literally does the same thing when she asks you to help her get a shipment of psychedelic tree sap. And all the contextual stuff? It feels like you're asking for an AI to be able to do something real time that a team of developers couldn't do in 5 years at their prime
I think this is the biggest Next Gen Revolution after physics in Half Life, I haven't felt this feeling for years and you are among the first to implement it, congratulations!
I remember waiting in line for the midnight release almost 12 years ago. I never thought we would still be modding this game and definitely not with a chat-gpt ai. This is so incredible.
Yes it is incredible how corporate shitlords destroyed the gaming industry in these years. They still release the same games with the same problems and with the same attitude of "who cares, people buy, modders fix, more people buy". Sorry for the negativity but im just so mad at greedy corporates with no intention to be better.
@@UltraProchy I'm def not a Todd Howard defender either. With Bethgames it's weird, because they give us a 'sandbox' with with dev tools (creation kit) for us to play with under the guise of 'curating our own experience'. However, at the same time there's a layer of exploitation of the modding community whom are willing to patch the game for free. Which has been an issue since Morrowind. "We keep rereleasing Skyrim, and you all keep buying it." -Todd Howard (or something like that) Anyways, I dont disagree. I was mostly refering to how cool it is that chatgpt has been implemented into skryim.
@@blahjustchris Whats even worse is that bethesda is actually kinda decent in the grand scheme because they are open about it all and they do at least provide the dev tools. They dont strike anyone trying to make their shitty product somehow better. The actual dev team behind the corporation must have some very cool managers just because they are able to push through these features without which the games would just die a week after release. And i can imagine the disgust of higherups over slave time being used for something else than immediate profit. We are just a tiny effort away from corporations hiring devs for "exposure" and not money because, sadly, some people would do that for the chance to maybe have their name in the credits. I hope im just a doomer pesimist and there is going to be a gaming "renaissance" in the years to come and we will be able to enjoy all the technological advancements free of corporate greed. I fucking hope.
@Jaroslav Procházka from what I know, Bethesda(mostly just todd) actually cares about the games they make. I mean, yes, they have taken plenty of wrong steps, but they can still grow as a company. Honestly I just like Bethesda ik they aren't very popular anymore but I still have hope in their creativity
This is awesome. I hope AI can also be used to randomly generate "background conversations" as well. One of the most immersion-breaking parts of Skyrim is just walking through a town and hearing the exact same conversations going on between everyone, like you're stuck in Groundhog Day.
Holy crap I see what you mean now. Like the characters could actually have their own ongoing conversations and issues of the day they're yammering about, and it would be different stuff if you left town and came back later. Yeah that would be super immersive.
A game with no set sidequests but what you get involved with. Every game becomes a unique experience that no two stories are the same. Some became saints, and others became death dealers. But its set simply in a world we look at through glass.
@@mysigt_ I think the solution for quest progression is a simple UI change. List all the regular responses, and then at the bottom allow the player to type a different question. That ways the conversation can flow from a tangent in the regular dialogue as well.
@@KirthsWraithwood We can participate in it too. The AI will be able to build the game around our own actions, and, importantly, make it compelling and still movie-like.
I turned 40 this week. My first video game was an Atari. I've gone through various eras and technology upgrades, but nothing compares to the current moment. To envision a future where NPCs can literally live inside the game and make less restricted decisions is exciting. I can't wait for what's to come.
45 here. Come my friend. Let's keep helthy and stable and hope we can dive in 5 years so deep into skyrim, that we can have with a guard a conversation over the purpose of life.
Imagine when they can make it properly affect npc directives. They're not on rails but tend to be in the same places over and over. Imagine giving an adventurer a tip off about an in world location and they make their way there. Speech skill may actually gain some use. Lots of potential for this mod.
I've been using it for 30 minutes and I'm mind blows. She summarizes books I read, comments on what I'm doing. This shit is so cool. I used GPT 4 to create a more detailed lersonaloty for her and put it in the configuration file.Incredible.
The possibilities could be endless with ai in games, not just dialogue, but how you're treated, what the AI might do on their own, buying selling, going their own way, perhaps even a Nemesis system
There was a great paper about a simulation where multiple ai agents powered by gpt actually lived in a town and there was so much cool emergent behavior
Well they stole her mead. You don’t steal a nords mead unless you’re looking for a quick death. Lydia actually shows considerable restraint to be honest. But yes, keep blaming white people for being racist, ya fucking racist.
Unbelievable! I never thought I'd see the day when you could write custom dialogue to an NPC and they could response to you in character, especially in a game like Skyrim. Imagine the possibility for voice input instead of a using a keyboard, particularly in VR, plus mod patches for overhauls. So many possibilities, all thanks to the creators and the community. Amazing work all around!
@@somedude000o0oo jajaja thats not the only thing that You can do. You could actually give the character the hability to act based in their personality and experiences. That was already Made in a recent experiment. Althoug i don't know how hard would be to mod that in the gane
The potential of this is insane. I imagine that with some sort of voice input, you could play the game in another language and progressively learn the language as you progress the main and side quests - kind of like when you move to a foreign country and need to learn the local language to get by.
Given that the most advanced AIs now have no problems with lots of languages, imagine automatic translators for software: no need to load translations for dialogs, etc. It just gets translated on the fly. Imagine live dubbing of the videos...
I have always wanted more out of interactions with the NPC’s outside of the crafted dialogue, after 12 years you kind of feel like you’ve heard them all, so this is truly incredible.
@@EmeraldBayMovies It does, and that mod made this game significantly more in depth and replayable to me. I shudder to imagine how many hours I'm going to pour into this game now that I can legitimately have conversations with my favorite characters. I wonder how this will work on unique NPCs like Neloth or Serana! I would be spending hours talking to them for real lmao
But why do you not want crafted dialogue? They're not saying anything, there isn't a character it's just sentences that exist strictly isolated from the game. There isn't permanence to them nor do they have anything unique at all. This just seems like a huge downgrade from regular writing.
The problem is cost. Each interaction is a call to 2 APIs, one to prompt the model to respond to the message and the other is text-to-speech. To get the voices of actors you need also to "fine-tune" a pre-trained model. All of that also needs a connection to the internet. Source: I'm a data scientist
@@ocaradovideoehbixa gpt3 which is the base model of chatGPT has 175 billion parameters which are decimal point numbers. Typically for neural networks the numeric type that is used is float32, it means each number takes 32 bit in the memory. Probably OpenAI did everything they could do to optimize performance and they are using mixed types so let's say on average each number takes 24 bit. Neural networks run on the GPU memory, so the required amount of GPU memory just to load the model (not to use it) is 24 * 175 bllions bits. I did the calculation and that's almost 500 GB of GPU memory just to load the model. Using it requires more memory. OpenAI didn't disclose how many parameters GPT4 has but it's probably orders of magnitude more. Deep learning is expensive and only rich cooperations can develop large models and run them.
Quote: *"that dude had more of a likable personality than most modern movie characters"* That's because the AI was designed to respond, as the character, in accordance to an entire set of charts and sub-charts as to how a given character, with it's particular profile, should behave and respond to a given set of inputs. It's all calculations base on assigned values to a given set of protocols. Unlike "modern movie characters" which are written by ideologically driven assholes who use every aspect of the script to emotionally and psychologically manipulate the viewer into developing specific views and opinions. So basically - an unbiased chatbot who just emulates a given character according to that character: is almost always going to be vastly more likeable than a character who's soul purpose is to constantly gaslight, demean and bully you into agreeing with the character's authors. _After thought:_ It's quite the astonishing, and shameful, testament to how *awful* the "entertainment industry" has been permitted to become - when a chatbot, with variables of a throw-away-npc plugged into it, from a 12 year old game - has a better chance at passing a Turing Test: than 99% of the content coming out of mainstream media today.
@@ObservingLibertarian jeez what kind of movies have you been watching? Nothing I've seen has made me feel that way. Movies are supposed to make you feel emotional and generally favor the socially accepted moral choice. Everyone knows it's fake, its not manipulation if you know the emotions don't actually matter outside of the movie immersion.
@@maxinefinnfoxen Quote: *"Nothing I've seen has made me feel that way."* A statement in opposition to my assertion quote: _"who use every aspect of the script to emotionally and psychologically manipulate the viewer into developing specific views and opinions."_ Quote: *"Movies are supposed to make you feel emotional and generally favor the socially accepted moral choice."* That's the very next sentence - which completely admits exactly what I was asserting - but attempts to beautify it by stipulating that the manipulation taking place is to quote *"favor the socially accepted moral choice."* 1) I question the morality of the authors, 2) I question what society we are talking about and whether or not the depictions provided of moral choices actually do reflect society: or instead does the morality portrayed more closely match an ideology which the authors would prefer society adhere to? Quote: *"Everyone knows it's fake, its not manipulation if you know the emotions don't actually matter outside of the movie immersion."* And yet - myriad persons and even companies are continuing to *try* and insert their own ideological proselytizing into any form of media they have access to in order to alter people's perception of reality as though their ideological premises _were_ the quote *"socially accepted moral choice"* - harkening back to me previous statement quote: _"emotionally and psychologically manipulate the viewer into developing specific views and opinions."_ One of the most recent items I can think of off the top of my head would be Wizards of the Coast deciding that Half-Elves are innately and inherently racist: the _unspoken_ and hidden reasoning behind that standing is that half-specie X and half-specie Y examples like half Elves and Half Orcs affirm the concept of miscegenation. Therefore, the game must be changed in order to conform to their ideology concerning real world humans in that all "races" of people are equal, identical and interchangeable - therefore, any differentiation in activities or outcomes is the result of oppression preventing them from acting, thinking, behaving and achieving the same as every other race. So the table top role play game dungeons and dragons, even though quote *"Everyone knows it's fake"* and quote *"don't actually matter outside of the **-movie-** immersion"* - is in fact still being altered in order to conform to an ideology. A behavior which is being acted out throughout main stream media.
@@orangejuice7156 I have a life - it's just that my life included an education which provided me with reading and writing skills above a 4th grade level... ¯\_(ツ)_/¯
Rolf's enthusiasm and use of metaphor is so endearing. "And now, like an arrow that has found its mark, I am proud to stand watch over this great city and protect its people from harm." Just like the arrow that found its mark in his knee 😭It's so beautiful.
@@VoidLantadd Right. We'll be able to play the world that actually exists itself, like politics and wars, immigrating and frontiering, nourishing population, quests just made up instantly, creating a protagonist npc to progress the main quest if the players doesn't interfere for long so they can take a role as a side character, seeing the world is shaping and changing by the time passes. Everything generated by the game master AI based on the settings and lores of the world, giving the players infinite choices.
11 years ago, I was talking with my friends about how cool it would be if video games like skyrim could use AI to create life like conversations and interact with the world like real life players. I did NOT think it would happen this fast
As soon as I saw the ai voice generation I instantly knew we were gonna see a skyrim mod. This has so much potential to cause Bethesda to re-release skyrim again.
I think one of the problems with the AI in this condition, is that it's too polite. You could say something very rude to the AI and they would not defend themselves. Somehow we need to bring AI to the point where they can be sassy or angry at us if direct to do so as a response to our actions
chatgpt CAN do that, you just need to use a jailbreak method (many of which have been patched though). most of these AI's are lobotomized by the devs because theyre deathly afraid of the ai being too based
@@themonsterunderyourbed9408 It's not working purely off truth and facts. Not every piece of literature humans produce is true, even if you want to believe it.
In one fell swoop, you've restored the "ask for directions" feature and created a limitless potential for storytelling. It's already shockingly rare how little they break environmental continuity, so further refinement can make them even more aware of their surroundings
It's the potential for every random background npc to become a fully fleshed out character that's really doing it for me. Imagine getting arrested by a guard you have a previously existing relationship with and being able to explain what happened. If your friends he'd be more willing to listen but if its a guard you'd butted heads with he'd be jumping at thr opportunity to arrest you.
@@ilikeavacado next gen consoles like xbox can quick resume several instances in multiple triple AAA games even offline, their SSDs are mad powerful and could easily handle remembering multiple past convos for tons of NPCs
@@ilikeavacado not exactly every conversation, but the Nemesis System in Middle Earth: Shadow of Mordor/War lets significant enemies remember every interaction you've had with them. I can see this being expanded to every NPC in the future
This really is a huge milestone i don’t think you guys realize. If we could add more convincing emotion and randomly generated voices, the possibilities are endless
A couple of years ago i played a bit with generating background chat and npc one-liners, as a way of teaching myself some generative deep learning. This goes SO FAR beyond what i could imagine.
Hi. I am a game designer. This is the most impressive video i have seen about a game, ever. You just unlocked so much possibilities in my mind. Thanks, internet stranger, and congrats.
This is AWESOME! Can you imagine just talking with any random NPC like this? You go in and talk to a guard, he introduces himself as Gunnar Iron-Beard. You have a lengthy conversation about all of the places you’ve been and the things you’ve both seen. And the conversation shifts as Gunnar mentions that he hasn’t heard from his brother Boric in a while, ever since he went to Markarth to work on the excavation.
Honestly i’d be too busy checking in on the sick and injured you could find in game and using my maxed healing magic to help them, perhaps even acting as a proper diplomat between the Imperials and Stormcloaks while revealing the true intentions of the Aldmeri Dominion, uniting both sides against them.
@@hiddendesire3076 bruh, just imagine changing the ending of the game. You as the last Dragonborn talking with Alduin and convincing him that you want to restart the Dragon Cult. Or how about using the Jagged Crown to ACTUALLY take over Skyrim and basically make it like the Senile Scribbles 😂
Imagine auto-gpt continues to improve, and as you want to integrate more features, such as changing ending of the game, it automatically creates the needed files
Allowing user input via voice-to-text is another big one. They also have AI to help render animations. This could be used for more organic VR play or even in tandem with the custom speech.
@@Splarkszter Indie developers are a threat against Capitalism, support big game developers, they need money to grow and without growth the economy will collapse.
It would be amazing if the NPC's AI could be autonomous so they are able to make conversation with one another, or start up one with you out of nowhere.
That’ll definitely happen, especially when big game companies start taking ai into use. Also would be cool if it wasn’t just conversation, but they could also start random actions too that relate to what they say.
I dont know if you're already aware of it and that's why you brought it up, but there's a demo of such a thing. Look up "reverie arXiv Demo" pretty cool, the potential.
That could become too heavy a load for most PCs pretty quickly. It's especially concerning that, assumingly, the data load will be increasing exponentially over time as you talk to more and more characters. I wonder how long it is sustainable.
Only trouble is GPT4 is really locked down and censored when it comes to sexual content. Might need to wait for an open source alternative. People are working on those but from what I've seen, they're still too far behind ChatGPT.
Now make the AI good enough to be aware of in-game events. Asking lydia "hey, see anything weird happen lately" and having her respond with how wikd it was watching the farmer down the hill get launched into the air by a giant would be absolutely side splittingly funny
I wonder how far this could go in terms of how the NPCs acknowledge the player. Say you wanted to be the son of an existing NPC, could you get thay NPC to acknowledge you as such? The role play potential here is insane
Yeah once they manage to get the text to become actions it would be a huge leap, like imagine rping as a bandit and actually being able to extort npcs you find on the road or buy things with a few words rather than a menu@Someone who's harnessed the gravity
Someone just needs to make a dynamic lipsyncing animation mod and this would be perfect. It's beyond amazing that AI has gotten to this level. It's really cool to see that, despite typing with grammatical errors, it can still accurately determine what you're saying or asking. I'm also amazed at how fluid the audio is for it as well, it doesn't sound super robotic most of the time.
@@itdobelikedattho8112 for faster response you need better GPU or better connection to OpenAI's APIs You could also use OpenAI's Whisper API to accurately translate your voice as an input to this mod.
It's fascinating. You can definitely note the flat tone compared to the voice actors, but it definitely creates a backstory and personality. I can see it complementing the professional talent.
Wow. Makes me want to get back into Skyrim after all these years. I’m so glad that people are implementing new technology on such an amazing yet old game.
This is truly revolutionary. As someone who mainly does role playing playthroughs, I have always wanted to be able to hold lengthy conversations with NPCs.
you know, this would be absolutely Fantastic for games like Fallout. in the original Fallout games, you could ask NPCs more specific questions that you yourself could type out. it was very basic and didn't always understand what you were asking, but it gave you the chance to learn more about the world than the simple Dialogue Choices would let you. i would love to see it in something like Fallout 3, New Vegas, maybe Fallout 4, and sure as hell i'd love to see it in the fan mods attempting to recreate Fallouts 1 and 2
@@NewSorpigal1 yeah- you often had to dumb down every question you asked to 1 word sentences, and even then it didn't always understand. at least with this AI system, they could actually *comprehend* what you were asking. that said, the system, while very basic, was a really good concept, and i'd love to see it make a return in some way. using something like this mod might be the best option
This makes me think the next step is for some games to have a "story mode" and a "organic freemode" where a story, quests, scripted sequences and so on will be perpetually generated based on player actions and inputs, allowing for thousands of hours of play time and playthroughs where the story is never the same.
Damn, I remember watching another video a few weeks ago and the AI voices were a bit robotic. This is soo much better. Crazy how fast this all is improving.
the better follower's mod lets you take any NPC as a follower, so its possible. there is a NPC name mod that generates a random lore friendly name for npcs that have generic names like "whiterun guard" or Thalmar mage or highway bandit. Would be cool if that + this mod worked together so when it gets named the AI would register it. Whats cool with the name mod is that it keeps a running list of names its given to NPCs so every NPC is unique even if 2 look exactly the same you will be able to tell them apart by the given name.
That guard is super relatable and really respectable. Stand up guy. I used to hate the guards cuz they seemed so boring and all of them told basically the same stories.
This is awesome. I imagine the next step assuming its possible would be a system where NPCs take action based on certain phrases, for example snitching on Ysolda's skooma business to a guard, they attempt an arrest, asking for a shop and the npc pathfinds to it , etc. I can only imagine where gaming will go from here
18:50 It is amazing the emotion of surprise he shows in his voice when you tell him you are the dragonborn. The prospects for the future of gaming is incredible. And to think this technology just came out!
To get a real convincing voice, you would still want a voice actor to perform several hundreds of lines. Then the AI can use the voice to match the tone, demeanor, etc. to fill in the blanks of lines not spoken. Gotta remember that it's using all Lydia's dialogue to create the new stuff. Have to give it a base. One day we won't have to, but we are still a bit out from that I think.
I personally think there will always be need for voice actors to make lines actually convincing. You need tons of voice performance to train the AI off of. Plus they will always be using celebrity voices in games
@@dawert2667 That and Voice AI for Skyrim specifically I think is a good thing because Skyrim came out almost 12 years at this point. the voice actors in this game probably wouldn't sound the same if someone were to pay the originals for their own mods. (If it's even something that can be done)
This is (to me at least) really incredible, as it opens up a lot of development opportunities for open world games in the future in my opinion. I don't know if you've ever heard of "the dragonborn speaks", but I'm really curious as to how that would function with this. In a way, if someone made it work, I'd assume you could have very realistic conversations with anyone in skyrim. Paired with VR, that has to be one crazy experience.
I stated in FAQ part but let me touch that point here too, you don't need external mod/module to make that work because Inworld already comes with speech-to-text module, so you can technically just use their solution and can have conversations without typing.
Only problem i had with this type of is ai is that eventually this will go insane and starts looping or forget things that happend before and start making stuff up, not sure if this have the same problem as those.
@@renzmanzano4010 Well, as far as I know. Inworld AI which is being used in this video doesnt really create random and insane scenarios and stay true to the character. But Im sure theyll improve a lot in the near future!
@@renzmanzano4010 I've had this exact problem just talking to some of the free bots on inworld AI so I wouldn't be surprised if the same problem happens in game.
@@adamf6391 yea I hope so, its just funny how in one minute you can have the most realistic conversation and the next it feels like your talking to somebody with dementia.
@Davi: They can't execute actions at this stage. I was in contact with Inworld and requested that feature awhile ago when I was working in Bannerlord, they are working on that feature as far as I know. @renz: As Adam said, Inworld AI doesn't go crazy with random dialogues. They occasionally hallucinate though, talk about things that doesn't exist, but they are generally very "strict" to their characters. You can create your account now for free and test it yourself as well, you don't need mod for this - although you probably need to create a character with somewhat elaborate details, otherwise AI can create awkward conversations when it doesn't have enough information to go with. What good about Inworld AI is, you can't make them say things like "As a Large Language Model..." regardless of how much you talk, they always stick to their characters and even in case you push ethical boundaries, they reject giving you an answer by staying in their character.
"I'm sorry, but as an AI language model, I cannot promote or encourage the use of illegal substances. Skooma is a fictional drug that exists in The Elder Scrolls video game series. It is a highly addictive and illegal narcotic that is known to cause negative effects on the user's health and behavior. " Just teasing, great job on the mod! 😸
I love how Lydia immediately slanders Khajiit and Ysholda brings up genuine ethical questions about the distribution and use of Skooma. Makes me want to sit at the throat of the world and have a deep psychological conversation with Paarthurnax about the state of Tamriel and his opinion on its change since the Merethic era. Also want to ask M'aiq some questions
Dang the amount of depth the guard has now is so cool. Didn't realize he was so poetic lol. It was cool how his voice was able to change too yelling in shock
The future is now Back then I literally imagined what it would be like for future games to have human like dialogue interactions with NPCs and now here we are
Great job Bloc! However, what would make it even better is if the AI could speak up on their own, not always waiting for input from the player. That would make it way more natural. Although I am aware that this would be very difficult to balance.
NPCs in Skyrim are doing something similar already, they have some randomized greeting lines. Like after hearing "No lollygagging" from Guard, you can ask "Why no lollygagging? What's the problem with that" and it should give an appropriate answer.
With our tech, you can create custom event triggers and goals and actions so they can be programmed to speak up to share certain things, to greet you, or to interject some piece of the game narrative into the conversation. They are able to do that at a specific time, based on a trigger in what you say (ex. I'm looking for a new sword and they can jump in to talk about where to find one), or they can be given the goal to share about something and they'll look for the right opening in the conversation in order to not just blurt it out in a way that comes across as out of context.
@@Bloctheworker What I also thought about was reducing just how much the talk. They spit out whole dialogues while normal people would probably at first go with a simple "Huh?" "What do you want?".
@@anobody410 2Kliksphillip made a video about this, one of the example characters that the Inworld people made more or less fits into this non-talkative style of writing.
Bro, ever since I started playing Skyrim, my thoughts were like "Hmm, how epic it would be to actually talk to these NPCs?" and now I see my imaginations and dreams slowly (but surely) becoming a reality.
I feel like for this to truly work, every npc would need to have a memory of everything you say to them or what they see, but seeing this already is like a childhood dream come true
Well, you could store that dialog chat into a database on your local computer and it get's loaded from there when you speak the next time with the same NPC again. GPT-4 has a very large context size, so you can pack a lot of informations into it and that gives you a big playspace to you tricks for great NPC memory.
To really work, they'd need a sort of memory for everything that anyone says to them and anything they see, they'd need a way of losing memory, and they'd need a system for censoring themselves instead of just spitting out everything that's relevant to the question. They'd need actual trust systems and relationship mechanics that determine how they interact with the player and other NPCs, and what kind of information they're willing to share. There's a lot that this still needs to truly be immersive and feel like real characters. But it's not that far off, because AI technology is rapidly advancing. We'll undoubtedly get something like that in a game in the coming years.
@@carolusmagnus9757 Maybe, but if it does it's clearly not as sophisticated as it needs to be. I mean, as a simple example, the Whiterun guard used the exact same phrasing about the dragonborn after the player told him they were the draghonborn. It was very unnatural and unrealistic, and showed that the guard didn't really have the memory to contextualize what he'd just said about the dragonborn and apply that to his response to being told that the player was the dragonborn.
I love this a lot. The NPCs don't only vary their text according to what you say to them, they stay within character as well. This is truely amazing software.
This is incredible, I think the big thing to change is to make the characters more defensive, erratic, and less reasonable. Rn in the early stages their behavior is a little too calm and compliant to be human. Still an incredible showcase of new technology and the future of gaming, definitely required lots of hardwork to make
I love how every time new tech comes along someone IMMEDIATLY thinks 'I can use this to make Skyrim even better' lol
Always back to skyrim
@@hehe234haha9 all roads lead to skyrim
That's because it's an amazingly fleshed out world
Yeah love it how skyrim is now the test platform for creative ideas, shows how a mod friendly game can be still of value decades after
just wait till Tod the man himself finds out ...
It's like having a neighbor you've said "hi" to 100 times, and now you're suddenly having your first real conversation with them
very real. Swap neighbour with co-workers for me.
@@edattacks hahaha
@@edattacks lol
Bro yes lol u totally nailed it it feels so cool lmao like damn another 1000 layers to dig into now lmaoo
Such tales of horror... Warn us before you post such vile ideas
I think the coolest thing about this is you can have NPCs call your character by their actual name
Waaaat, that's true haha, awesome time to be alive
They call me janus, hugh janus
@@thatch8537 COME OUT, HUGH JANUS
That's cool but really only a quarter of it. In truth, the most useful aspect of this is in worldbuilding and random generation. Cities can now be filled with people without sacrificing much depth at all and having serviceable dialogue even for each passerby. Imagine Daggerfall's scale with the craft of Skyrim around certain areas where more scripted NPC's would frequent and interact, such as gardens, taverns or guilds, so that the world itself can be believed as much as the characters in it: this would be such awesome delight to the mind and doubtless immersive to no end.
@@icarvs_vivit Don't care. Lydia calls me Sir Poopybutt McGee and that's all that matters
This is actually insane. The roleplay potential just shot through the roof. And if characters can interpret orders to go do something, the world could really become living and breathing... or potentially off-the-wall chaotic.
That's what i was thinking, everyone is talking about "Oh, dialogue will be so much better", meanwhile i'm waiting for the time i can order lydia to go steal every single sweet roll in whiterun in actual conversation.
As long as it is purposefully all within context, Gaming worlds may truly come to life with AI driven NPCs.
This is the kind of thing many gamers have dreamt. of.
No more "ghost towns" and glorified mannequins just walking from point A to point B with a couple of repeating lines.
if rockstars made skyrim instead of gta 6
like being able to strop someone on the road and demanding all the money from their pockects
pretty sure its set up. watch it again and watch how he asks question knowing what the npc will say next
At this point, I fully expect the AI singularity to happen in a Skyrim mod.
Thanks, now I won't sleep tonight 🤣
That would be so morbidly cool.
An NPC just becomes self aware and corrupts your game.😅
Actually that almost happened with oblivion 💀
Serana becomes sentient and immediately goes after all the coomers
@@ApolloCalrissian tbh they'd probably Zero-Sum out of the game after realizing their life is a lie. It would certainly be fitting if it happened in The Elder Scrolls.
After 12 years of waiting, the world finally knows why the guard had taken an arrow in the knee.
Surprised to see it was bandits after all, and not a wifey!
Think the 'arrow in the knee' meaning is that he fell in love with someone and settled.
@@onzir Yes, everyone has been aware of that for years. Thanks for just finding that out and passing it off like you've known that.
@@corporatecat230 Wait
He didn’t actually take an arrow to the knee? I thought he did!
My whole world has been shattered
@@onzirIt doesn't.
Ahh... finally the chance I was always looking for,
"Delphine, as I am the dragonborn, the blades will follow my orders, so I'm not killing PAARTHUURNAX!"
Mans got the right idea
I just set the quest stage in the console to the part of that quest after you kill partysnax. Then i just pretend i lied to the blades
parthunaax dilemna already allows this ;)
You can get around that entirely thing by completing the Civil War as the meeting begins.
Delphine with the new AI: "Fuck you! I'm not letting you progress the quest until you kill the lizard bastard"
The potential here is utterly insane. This could change gaming in a way we've never seen before.
FINALLY I CAN HAVE E-SEX WITH AN AI
very true but still just a concept
@@jackvolkwyn7590 concept? it works good enough as it is are you nuts?
@@BLACKxOPxPRExTARGET AI as it is now takes a ton of resources, that's why there is a restriction on the number of requests one can make to ChatGPT 3-4 within a given timeframe even if you have premium you still need to wait a couple of hours, maybe we will be able to deal with the energy problem in the future? I honestly doubt it
"insane" refers to a state of mental illness or derangement that significantly impairs a person's thoughts, emotions, and behavior, to the extent that they are unable to function in society or understand the nature of their actions. It is often associated with severe disturbances in perception, reasoning, judgment, and the ability to differentiate between reality and fantasy. The term "insane" is sometimes used colloquially to describe extreme or irrational behavior, but it is important to note that mental health professionals use specific diagnostic criteria to determine whether an individual is experiencing a mental disorder.
I love how Ysolda just straight up admitted to being a criminal smuggler to a complete stranger right in the town's market square
You gotto let them know if you want to earn bucks for that inn
Apparently sleeping tree sap is legal in skyrim, at least I believe it is, perhaps its like weed in our world. Legal in places but still clandestine. And given her relations with the caravans that seems i character
the thought that Ysolda is a secret (or not-so-secret, in this case) drug dealer is hilarious to me
What's disturbing is the AI almost made it sound reasonable
Thats why I still love her!
I like how the Skyrim monotone voice acting fits perfectly with the AI
Feel bad for the AI that has to handle Cicero. 1 of the only few characters in Skyrim with acting skills.
It's hard to tell the difference...
monotone? 19:00 I can tell the emotion in the dialogue
@@Just_a_niceguy it sounds fucking terrible
I'm impressed that the AI didnt answered with "As an AI language I condone arrows in the knees as it can be painful.
Imagine this in vr with a voice to text mod. That would be unbelievably immersive
And it truly wouldn't be that hard to do
Throw in a personal journal mod and some survival mods plus maybe some more realistic combat mods and you’ve got one of the best games ever made
You mean this? ua-cam.com/video/Gz6mAX41fs0/v-deo.html
@@ALFTHADRADDAD check the link I sent above
@@zackfair_og ah i don't see it you mind reposting
AI driven NPCs could make game worlds actually come to life.
No more "ghost towns" and 2-3 repeating lines for NPCs. Game devs could just focus making character parameters, and direction and the AI can fill in the rest within context.A gaming experience can become unique for all players.
Ai can even create the voice and its quite hard to tell if the voice is generated by ai or not.
Or... we can aim for the future with games like Baldur's Gate 3, handcrafted with so many possibilities, ability checks, racial/skill/tag based dialogs that devs handcrafted and thought up and never think any world is boring... Too bad AAA devs will never reach the level of Baldur's Gate 3 since it's way before its time.
@@xbon1baldurs gate and Skyrim are overrated trash games. Larina and Bethesda studios just make an illusion with these crap scam games
@@xbon1 You can thank capitalism for that. Why spend a million person-hours crafting the in-depth and customized experience possible when you can spend a tenth that and use the salary money to buy yourself another superyacht?
AI is neither the solution nor the problem. The way it's used is simply emblematic of greater forces.
15:12 12 years later we finally get to hear Rolf tell his tragic backstory. Gods be good
Good thing he told us. I always thought he got married and settled down.
That is what the arrow to the knee is supposed to mean, that he got married and settled. I suppose this is from taking the phrase literally.
@@TheRishikesh99 What does taking an arrow to the knee have to do with getting married and settling down?
Goths be good.
@@enermaxstephens1051its a metaphore in my language we have that "men went into horse collar"
What is blowing my mind is how logical and reasonable this ai is. None of them have said anything off-putting, awkward or out of character. I’m baffled.
Once you start talking to the ChatGPT client for awhile, you start to notice there is no fluctuation in their manner of speaking. Rather than in the actual game. I.E. their personalities may be different, but they word things the same way and always toe the line.
@@Kaleun14 You can actually get it to throw off that consistency by telling it to be rude, belittling, aggressive and emotional when it responds. Due to the fact that the AI is naturally very conflict-averse, the output ends up being less mean and more 'inconsistent' and human in its delivery. It becomes more inclined to use language that has lots of fluctuation and realism, though with the consequence that it can sometimes be scathing in its comments. Whilst this is not a solution for all styles of speech you want it to emulate, it's a step in the right direction. I'm sure there's some combination of instructions that can cause GPT to be more variable without being as mean.
Yes, VERY logical like when Lydia seemed to want to prove she camped near the Khajiits like it was an important detail.
Where do I get this mod?
If this becomes a mod I would download it.
If you listen closely you can hear Todd laughing in the background, known that now Skyrim will be re-re-released again for the next 50 years.
I kind of low key hope this is the reason they delayed Starfield again... Pipe dream maybe, but imagine if Bethesda knew about this already or had the same idea and decided to implement it themselves.
@@PunkerNinetySix Ha fuck no. Good idea though. Just impossible unfortunately.
@@Tokmurok He's literally showing off a real time mod on how it's done in a 12 year old game
Why should it be impossible?
@@RazorsharpLT because the risk is too great for a company. They could train their own model only on specific ES texts, but it wouldn't be as dynamic as Gpt4. You could never bring it to production yet because it's just too wild at the moment, it's so easy to get it to say something offensive and Bethesda wouldn't want the potential lawsuits of an npc telling someone to do something bad aha
This is insane how well the AI reacts to questions. I want to use this immediately.
Hearing the backstory for his Arrow in the Knee was lifechanging.
He wasn't adventuring he was on watch.
@@MH-up1xe he said he used to be an adventurer like Dragonborn until he took an arrow to the knee
@@guts-141 which means getting married, but the AI took it literally 😂
I lost it at this
@@antonderzauberer lol we don’t know if it was literal or a joking metaphor. Another guy says he took an arrow to the chest. Why do people act like they absolutely know something when there’s no context.
If we could integrate this with a voice chat, and get the LLM’s running fast enough to interrupt you, true VR immersion like never before could be achieved
if they could talk over me, and passive-aggressively bully me out of the conversation, that will truly be the height of immersion.
@@cl114c0777498d at this rate, give it another year-3 years and you’ll have your wish
OpenAI doesn’t want people pegging their service at those rates.
In the video description they said even though it's not used in the video, speech recognition is already in.
@@ChipsMcCliveI think it’s pretty obvious that it would be a separate and integrated system on a per game basis. Did you just think the whole world would only use gpt-4 for everything?
Now we need the ability for quests to trigger from these conversations and it would be next level for sure!
procedurally generated quest lines triggered from this AI chat mod would be insane.
@@ZIZZOBLIZZ and it can get dropped by npc if they get annoyed enough by the players >.
Ayyy what’s up Skullzi!!!
I can only imagine the nightmare it'd be to write something up that can procedurally generate quests from dialogue. Hats off to anyone brave enough to even dare trying out such a task.
Would it be easier to do in reverse? Improve the radiant quest system (or use an existing mod) and use the quests generated as prompts for dialogue surrounding it.
I suppose emergent quests from niche dialogue generation is still a step up from that.
Imagining a mmo game where the ai run freely making their own factions and passing info like irl. Leave for a month and it could be a whole different situation. Can’t wait to see where this goes in the next 5 years
Isn't the point of an MMO that players create the factions and stories?
@@shaddaboop7998 Yeah, this would be different. AAIMMO Augmented-Artifical-Intelligence-Massively-Multiplayer-Online
@@AxodusOverlord...
@@gabbyn.3049can't wait to have my own Albedo and Demiurge to help me conquer the world.
I love how the guard just kept laying out similes over and over every single line. It's like he did it once, and then the AI was like "yeah, that's this guy's thing now."
lmao
reminds me of the Master Chief AI videos.
That was funny but if every NPC starts doing it it's gonna feel like a drawn out family guy joke xD
His final response had me cracking up, simile guard should become a meme
Right? But that can be justified as poor Rolf being nervous talking to an actual mythical figure, trying to talk him up and get on his good side. His character developed throughout the conversation. And the fact that Irileth didn't just continue with the similes shows that the characters are separate, and can each develop independently.
Imagine you go around Whiterun telling everyone how you slayed a dragon. Some people are awestruck, some people already heard, some people just don't care. But everyone remembers how you introduced yourself to them. Then a rumor spreads that the dragonborn is a braggart, which loses you reputation with certain factions...
The things we'll be able to do with this tech is awesome! I'll probably be dead before a game like that can be run on a home computer, but the fact that it's feasible (on large systems) _today_ makes me so excited for the future of gaming.
This is insane. Who needs other games when you have Skyrim with such amazing modders!
Who needs real life you mean
this is true.
In the future there is only Skyrim. God Howard watches all from his Obsidian throne, and it all simply just works so sayth the old texts and new.
Honestly, I care more about every npc having different bodies, hopefully we can get both someday.
@@ihavetubes obody is a thing you know :D
OK, that conversation with Rolf the guard made me a believer. When you revealed yourself as the Dragonborn, his reaction was very impressive. Obviously, this technology has MASSIVE potential for any RPG into which it can be incorporated.
I think that guard missed his calling in life... a poet
@@cheesestyx945 Literally. At first I was amazed how well this worked and how authentic it sounded. But then he started to speak those bars. I'm truly amazed and can't stop being it.
A simple guard has get such depth is just amazing.
Seems Rolf has a thing for simile, like a rabbit producing offspring.
This and "the dragonborn speaks naturally" mod would pair insanely well.
It wouldn't be hard for them to rename the npc to Rolf the Guard after their conversation, either
I am actually blown away. This changes so much. Instead of predictable dialogue trees you will never know what is in store, and you can miss quests if you don't dig deep enough. Add in voice recognition and you could literally live in a virtual world of your own making
AI could be very unsafe, but if it was safe, we could create our own god.
Imagine a complete virtual reality. With games created by a hyperintelligent AI, which creates games on the fly. Not only according to your wishes, but according to your psychology, which it understands better than you yourself do. A fully immersive, fully unpredictable game that always goes in a way that you enjoy.
@@hafor2846The AI would be able to make the game so that it is always a challenge for you and never easy.
@@hafor2846 I can't say I could resist. I can't say I love this reality enough to fight for it. A world entirely yours to live and fight for is a dream and nightmare in equal measure.
Its pretty much how dialogue system worked before the dialogue tree became mainstream, but in AI sugarcoat. You input trigger words, NPC answer with preset data. Like how morrowind dialogue works but this time it will be in a form of an actual conversation which is a huge step forward in terms of immersion.
I love how the AI decided that Balgruuf is the stoic guy that will always answer straight to the point and not elaborate more like the giga chad he is. What a time to be alive.
Jarl Ballin SWAG
@@AOitsAO Tis I
@@jarlballinofswagrun4229 I like to think your account was always this way. thank you, i needed this laugh.
@@AOitsAO "Holla if ya need me. Holla if ya need reefer...bitch!"
They tend to overshare. They need situational awareness (public place, in private, secret place) moods, and relationship. If they dislike you the AI should generate more blunt, guarded, or dismissive responses. As well as if they are in a bad mood, or in public and you ask them something like "DO YOU SELL SKOOMA?!"
yeah it's not even remotely advanced yet for me to even WANT to see it in a game. like this is a sick experiment, but at the current moment it's just.. not good.
Riiight.
basically, a reputatution system like from dragon origins but ran by A.I
I mean isn't the game already like that though? Ysolda literally does the same thing when she asks you to help her get a shipment of psychedelic tree sap. And all the contextual stuff? It feels like you're asking for an AI to be able to do something real time that a team of developers couldn't do in 5 years at their prime
@Lady Marigold Yeah because the NPC dialogue before was so much better when they had a handful of lines to repeat!
I think this is the biggest Next Gen Revolution after physics in Half Life, I haven't felt this feeling for years and you are among the first to implement it, congratulations!
Did you download and test the mod?
@JimmyThree-Balls is it even available?
@@jamellwinners7192 seems its more of a moderate resource type thing,
It was kinda used in rain world. They ve made ecosystem with ai. Not sure on which stage so. Maybe its only movements but still fun
@@archniki_ idk I think the only thing comparable is the mount and blade version he made before this
Rolf the Guard is a hidden poet; his dedication to his duty and appreciation for life bring a tear to the eye.
The man would make a great bard
He really loves thunder.
@@sontrajamfemininegaze145 I love how the AI got caught up in the lightning and thunder analogy and then just went analogy crazy.
Now rolf is more than a meme, its a legend !!
I remember waiting in line for the midnight release almost 12 years ago. I never thought we would still be modding this game and definitely not with a chat-gpt ai. This is so incredible.
Yes it is incredible how corporate shitlords destroyed the gaming industry in these years. They still release the same games with the same problems and with the same attitude of "who cares, people buy, modders fix, more people buy".
Sorry for the negativity but im just so mad at greedy corporates with no intention to be better.
@@UltraProchy I'm def not a Todd Howard defender either. With Bethgames it's weird, because they give us a 'sandbox' with with dev tools (creation kit) for us to play with under the guise of 'curating our own experience'. However, at the same time there's a layer of exploitation of the modding community whom are willing to patch the game for free. Which has been an issue since Morrowind.
"We keep rereleasing Skyrim, and you all keep buying it." -Todd Howard (or something like that)
Anyways, I dont disagree. I was mostly refering to how cool it is that chatgpt has been implemented into skryim.
@@blahjustchris Whats even worse is that bethesda is actually kinda decent in the grand scheme because they are open about it all and they do at least provide the dev tools. They dont strike anyone trying to make their shitty product somehow better. The actual dev team behind the corporation must have some very cool managers just because they are able to push through these features without which the games would just die a week after release. And i can imagine the disgust of higherups over slave time being used for something else than immediate profit.
We are just a tiny effort away from corporations hiring devs for "exposure" and not money because, sadly, some people would do that for the chance to maybe have their name in the credits.
I hope im just a doomer pesimist and there is going to be a gaming "renaissance" in the years to come and we will be able to enjoy all the technological advancements free of corporate greed. I fucking hope.
I can already see the fanfics 😢
@Jaroslav Procházka from what I know, Bethesda(mostly just todd) actually cares about the games they make. I mean, yes, they have taken plenty of wrong steps, but they can still grow as a company. Honestly I just like Bethesda ik they aren't very popular anymore but I still have hope in their creativity
This is awesome. I hope AI can also be used to randomly generate "background conversations" as well. One of the most immersion-breaking parts of Skyrim is just walking through a town and hearing the exact same conversations going on between everyone, like you're stuck in Groundhog Day.
That’s probably a more likely use in the near future. Getting these AI-generated conversations to trigger and advance quests seems like a nightmare
Holy crap I see what you mean now. Like the characters could actually have their own ongoing conversations and issues of the day they're yammering about, and it would be different stuff if you left town and came back later. Yeah that would be super immersive.
A game with no set sidequests but what you get involved with. Every game becomes a unique experience that no two stories are the same. Some became saints, and others became death dealers. But its set simply in a world we look at through glass.
@@mysigt_ I think the solution for quest progression is a simple UI change. List all the regular responses, and then at the bottom allow the player to type a different question. That ways the conversation can flow from a tangent in the regular dialogue as well.
@@KirthsWraithwood We can participate in it too. The AI will be able to build the game around our own actions, and, importantly, make it compelling and still movie-like.
I turned 40 this week. My first video game was an Atari. I've gone through various eras and technology upgrades, but nothing compares to the current moment. To envision a future where NPCs can literally live inside the game and make less restricted decisions is exciting. I can't wait for what's to come.
45 here. Come my friend. Let's keep helthy and stable and hope we can dive in 5 years so deep into skyrim, that we can have with a guard a conversation over the purpose of life.
@@AdamSider in 5 years you should really check lovelab mods development 😂
Imagine when they can make it properly affect npc directives. They're not on rails but tend to be in the same places over and over. Imagine giving an adventurer a tip off about an in world location and they make their way there. Speech skill may actually gain some use. Lots of potential for this mod.
36 here and i believe we'll see total inmersion in games in 20 or 30 years
@@manolako give it 10 max 15
I've been using it for 30 minutes and I'm mind blows. She summarizes books I read, comments on what I'm doing. This shit is so cool. I used GPT 4 to create a more detailed lersonaloty for her and put it in the configuration file.Incredible.
and if you ask Lydia, could she rinse the leather in her pants? could she do it?


Отзыв
Другие также
The possibilities could be endless with ai in games, not just dialogue, but how you're treated, what the AI might do on their own, buying selling, going their own way, perhaps even a Nemesis system
There was a great paper about a simulation where multiple ai agents powered by gpt actually lived in a town and there was so much cool emergent behavior
@@McDonaldsCalifornia do you have a source for that i wanna see it
@@Arrkail the paper is called "Generative Agents: Interactive Simulacra of Human Behavior"
Warner brothers said not till 2035
@@KingKaleb77 not literally, AI will just be reacting to your decisions and other, act accordingly, make ties with other nps to take you down, etc.
Holy shit as soon as she gained the ability to form meaningful phrases Lydia immediately leans on that Khajiit racism. Fucking Nords
😂
Well they stole her mead. You don’t steal a nords mead unless you’re looking for a quick death.
Lydia actually shows considerable restraint to be honest.
But yes, keep blaming white people for being racist, ya fucking racist.
“Goodbye Lydia.”
I thought it was obvious she's a racist? Girl even yells "Skyrim belongs to the Nords!" in combat 🤣
Based.
Unbelievable! I never thought I'd see the day when you could write custom dialogue to an NPC and they could response to you in character, especially in a game like Skyrim. Imagine the possibility for voice input instead of a using a keyboard, particularly in VR, plus mod patches for overhauls. So many possibilities, all thanks to the creators and the community. Amazing work all around!
You can talk to them however you want but that has no effect on the world or characters, what's the point?
@@somedude000o0oo immersion.. making the characters feel more human.
@@somedude000o0oo jajaja thats not the only thing that You can do. You could actually give the character the hability to act based in their personality and experiences. That was already Made in a recent experiment. Althoug i don't know how hard would be to mod that in the gane
@@deepnutty6500 Now imagine if the content would go with the AI dialogues and make up game content along....
@@somedude000o0oo Because its WAY better than NPC's standing around and repeating the same 3 lines over and over the whole game? lol
The potential of this is insane. I imagine that with some sort of voice input, you could play the game in another language and progressively learn the language as you progress the main and side quests - kind of like when you move to a foreign country and need to learn the local language to get by.
Given that the most advanced AIs now have no problems with lots of languages, imagine automatic translators for software: no need to load translations for dialogs, etc. It just gets translated on the fly. Imagine live dubbing of the videos...
This is a huge milestone in gaming history!
In the future, we’ll be telling our grandkids “They had to hire people to say every single line of dialogue, it was a real pain in the ass”
Grandkids? Heh, you'll be surprised how soon this will be implemented!
@@softluxuryone2169 Indeed. This'll be standard in less than a decade, I think.
So... All these lines are AI generated by inserting the voice of the original Lydia into AI?
That's incredible, how well it talks.
Yeah, who needs art made by actual people!? Just let the machine recycle people's art into meaningless drivel and don't ever stop consuming
Good point!
I have always wanted more out of interactions with the NPC’s outside of the crafted dialogue, after 12 years you kind of feel like you’ve heard them all, so this is truly incredible.
I'm pretty sure the relationship overhaul mod adds more dialog options
@@EmeraldBayMovies It does, and that mod made this game significantly more in depth and replayable to me. I shudder to imagine how many hours I'm going to pour into this game now that I can legitimately have conversations with my favorite characters. I wonder how this will work on unique NPCs like Neloth or Serana! I would be spending hours talking to them for real lmao
my mind is totally blown
@@nousername2942 there's actually a video already using the AI voice of Serana saying a whole speech, with Laura Baileys voice
But why do you not want crafted dialogue? They're not saying anything, there isn't a character it's just sentences that exist strictly isolated from the game. There isn't permanence to them nor do they have anything unique at all. This just seems like a huge downgrade from regular writing.
Imagine Bethesda announcing that they will use AI npc interaction for the next elder scrolls. That would actually be a game changer
The problem is cost. Each interaction is a call to 2 APIs, one to prompt the model to respond to the message and the other is text-to-speech. To get the voices of actors you need also to "fine-tune" a pre-trained model. All of that also needs a connection to the internet.
Source: I'm a data scientist
@@qadr_ maybe when we eventually have all the AI running locally in our PCs? Dont know in how many years from now it will be feasible tho
@@ocaradovideoehbixa gpt3 which is the base model of chatGPT has 175 billion parameters which are decimal point numbers. Typically for neural networks the numeric type that is used is float32, it means each number takes 32 bit in the memory. Probably OpenAI did everything they could do to optimize performance and they are using mixed types so let's say on average each number takes 24 bit. Neural networks run on the GPU memory, so the required amount of GPU memory just to load the model (not to use it) is 24 * 175 bllions bits. I did the calculation and that's almost 500 GB of GPU memory just to load the model. Using it requires more memory.
OpenAI didn't disclose how many parameters GPT4 has but it's probably orders of magnitude more. Deep learning is expensive and only rich cooperations can develop large models and run them.
Their sales would go through the roof and every game studio would following suit.
If modders can do it then bethesda can definitely do it too
I love how Rolf the Whiterun Guard speaks so poetically
. It's like he's testing out new material for his application to the bard's college
And when it comes to the dragonborn, he thought of similes with lightning and thunder and then decided "yep, those are perfect, I'll stick with them"
Speech 100%
Ah , I see you met Rolf the recruiter. Whiterun guard applicants tripled since he started on the job.
his assignment told him to "guard the city with a smile," but he misunderstood and read "simile" instead
Rolf just found out about similes
man that conversation with the guard was so natural it was creepy, that dude had more of a likable personality than most modern movie characters.
Quote: *"that dude had more of a likable personality than most modern movie characters"*
That's because the AI was designed to respond, as the character, in accordance to an entire set of charts and sub-charts as to how a given character, with it's particular profile, should behave and respond to a given set of inputs. It's all calculations base on assigned values to a given set of protocols. Unlike "modern movie characters" which are written by ideologically driven assholes who use every aspect of the script to emotionally and psychologically manipulate the viewer into developing specific views and opinions.
So basically - an unbiased chatbot who just emulates a given character according to that character: is almost always going to be vastly more likeable than a character who's soul purpose is to constantly gaslight, demean and bully you into agreeing with the character's authors.
_After thought:_ It's quite the astonishing, and shameful, testament to how *awful* the "entertainment industry" has been permitted to become - when a chatbot, with variables of a throw-away-npc plugged into it, from a 12 year old game - has a better chance at passing a Turing Test: than 99% of the content coming out of mainstream media today.
@@ObservingLibertarian jeez what kind of movies have you been watching? Nothing I've seen has made me feel that way. Movies are supposed to make you feel emotional and generally favor the socially accepted moral choice. Everyone knows it's fake, its not manipulation if you know the emotions don't actually matter outside of the movie immersion.
@@maxinefinnfoxen
Quote: *"Nothing I've seen has made me feel that way."*
A statement in opposition to my assertion quote: _"who use every aspect of the script to emotionally and psychologically manipulate the viewer into developing specific views and opinions."_
Quote: *"Movies are supposed to make you feel emotional and generally favor the socially accepted moral choice."*
That's the very next sentence - which completely admits exactly what I was asserting - but attempts to beautify it by stipulating that the manipulation taking place is to quote *"favor the socially accepted moral choice."*
1) I question the morality of the authors, 2) I question what society we are talking about and whether or not the depictions provided of moral choices actually do reflect society: or instead does the morality portrayed more closely match an ideology which the authors would prefer society adhere to?
Quote: *"Everyone knows it's fake, its not manipulation if you know the emotions don't actually matter outside of the movie immersion."*
And yet - myriad persons and even companies are continuing to *try* and insert their own ideological proselytizing into any form of media they have access to in order to alter people's perception of reality as though their ideological premises _were_ the quote *"socially accepted moral choice"* - harkening back to me previous statement quote: _"emotionally and psychologically manipulate the viewer into developing specific views and opinions."_
One of the most recent items I can think of off the top of my head would be Wizards of the Coast deciding that Half-Elves are innately and inherently racist: the _unspoken_ and hidden reasoning behind that standing is that half-specie X and half-specie Y examples like half Elves and Half Orcs affirm the concept of miscegenation. Therefore, the game must be changed in order to conform to their ideology concerning real world humans in that all "races" of people are equal, identical and interchangeable - therefore, any differentiation in activities or outcomes is the result of oppression preventing them from acting, thinking, behaving and achieving the same as every other race.
So the table top role play game dungeons and dragons, even though quote *"Everyone knows it's fake"* and quote *"don't actually matter outside of the **-movie-** immersion"* - is in fact still being altered in order to conform to an ideology.
A behavior which is being acted out throughout main stream media.
@@ObservingLibertarian dude get a life, you're worrying me with your essays 😐
@@orangejuice7156 I have a life - it's just that my life included an education which provided me with reading and writing skills above a 4th grade level... ¯\_(ツ)_/¯
Rolf's enthusiasm and use of metaphor is so endearing.
"And now, like an arrow that has found its mark, I am proud to stand watch over this great city and protect its people from harm."
Just like the arrow that found its mark in his knee
😭It's so beautiful.
I know!! That part really gave me pause. This new generation of AI is astounding so far.
Rolf a real one
Overdone for a guard. Too talkative. But at least he got the arrow in the knee 😂
@@frgv4060 Maybe he's a poet at heart. His words are just so beautiful and symbolic.
@@keetard Could perfectly be. Now to maintain realism the other guards should be heard making fun of him haha.
16:00 That's Quite a Speech by Rolf and VERY Well Summed Up!
I bet in 10 yrs we'll have a game that players can talk with npcs in all kinds of stuffs based on its world. How fascinating...
It's gonna be like playing dungeons and dragons as a video game, with a GPT model as your dungeon master and all the NPCs.
@@VoidLantadd Right. We'll be able to play the world that actually exists itself, like politics and wars, immigrating and frontiering, nourishing population, quests just made up instantly, creating a protagonist npc to progress the main quest if the players doesn't interfere for long so they can take a role as a side character, seeing the world is shaping and changing by the time passes.
Everything generated by the game master AI based on the settings and lores of the world, giving the players infinite choices.
More like 5 years 😂💀
Brother, this won't take another 10 years. Wait for a game like this in 2024.
This is literally what this mod is doing ...
11 years ago, I was talking with my friends about how cool it would be if video games like skyrim could use AI to create life like conversations and interact with the world like real life players. I did NOT think it would happen this fast
As soon as I saw the ai voice generation I instantly knew we were gonna see a skyrim mod. This has so much potential to cause Bethesda to re-release skyrim again.
Uh, well... 11 years is a long time man. It didn't happen very fast
@@enermaxstephens1051 вырастешь, поймешь
@@enermaxstephens1051 I guess I assumed I'd be an old man or something 🤣
i liked how the whiterun gaurd used a metaphor in in every sentence
man likes his similes
Imagine he wrote a book about his adventures
He wanted to be a poet
That guard is the real bard lol, unlike Jon
That guy had a flare for drama, didn't he?
I think one of the problems with the AI in this condition, is that it's too polite. You could say something very rude to the AI and they would not defend themselves. Somehow we need to bring AI to the point where they can be sassy or angry at us if direct to do so as a response to our actions
Giving ai emotions
chatgpt CAN do that, you just need to use a jailbreak method (many of which have been patched though). most of these AI's are lobotomized by the devs because theyre deathly afraid of the ai being too based
@@AsadAbbasi-ss4bh Funny how something purely working off truth and facts is considered "racist".
@@AsadAbbasi-ss4bh I mean, ChatGPT has been showed to gaslight its own users already, with no jailbreaking necessary.
@@themonsterunderyourbed9408 It's not working purely off truth and facts. Not every piece of literature humans produce is true, even if you want to believe it.
In one fell swoop, you've restored the "ask for directions" feature and created a limitless potential for storytelling. It's already shockingly rare how little they break environmental continuity, so further refinement can make them even more aware of their surroundings
Yep, very detailed immersive conversation that stays within the lore. This what we've all been waiting for.
It's the potential for every random background npc to become a fully fleshed out character that's really doing it for me. Imagine getting arrested by a guard you have a previously existing relationship with and being able to explain what happened. If your friends he'd be more willing to listen but if its a guard you'd butted heads with he'd be jumping at thr opportunity to arrest you.
This^^^^^^^
mfw the guard that always asks you to stop using shouts sees you stealing 5 cabbages
That's interesting. I don't imagine the game could remember every single interaction, but it could store a couple friendliness values
@@ilikeavacado next gen consoles like xbox can quick resume several instances in multiple triple AAA games even offline, their SSDs are mad powerful and could easily handle remembering multiple past convos for tons of NPCs
@@ilikeavacado not exactly every conversation, but the Nemesis System in Middle Earth: Shadow of Mordor/War lets significant enemies remember every interaction you've had with them. I can see this being expanded to every NPC in the future
This really is a huge milestone i don’t think you guys realize. If we could add more convincing emotion and randomly generated voices, the possibilities are endless
i dont think you realize
I don’t think I realize…
Standing here I realize
Somehow, no-one realizes...
I didn't realize... And I still don't
A couple of years ago i played a bit with generating background chat and npc one-liners, as a way of teaching myself some generative deep learning. This goes SO FAR beyond what i could imagine.
Personally I think in 5 years this kind of stuff will be wildly common. I can't wait.
I love thinking about where all this will be in 50 years. Its hard to even imagine.
@@DazHotep6EQUJ5 its sad that we'll be too old where the young kids will be kirito v2s
We'll probably be talking to NPCs with microphones as if they're real in the not too far away future.
It’s inevitable.
You overestimate the diversity hire..
The Dragonborn finally getting the respect he deserves from the guards 😭 👏
Hi. I am a game designer. This is the most impressive video i have seen about a game, ever.
You just unlocked so much possibilities in my mind.
Thanks, internet stranger, and congrats.
Skyrim will never disappear, and this makes me very excited
Well until next scrolls come
@@archniki_ Depends on whether the Elder Scrolls 6 plays like Skyrim or Fallout 76 instead
@@grungeisdead8998 and most importantly, wether it has mods or not.
Rolf sounded mindblown when you revealed yourself as Dragonborn! What a great guy.
This is AWESOME! Can you imagine just talking with any random NPC like this?
You go in and talk to a guard, he introduces himself as Gunnar Iron-Beard. You have a lengthy conversation about all of the places you’ve been and the things you’ve both seen. And the conversation shifts as Gunnar mentions that he hasn’t heard from his brother Boric in a while, ever since he went to Markarth to work on the excavation.
Honestly i’d be too busy checking in on the sick and injured you could find in game and using my maxed healing magic to help them, perhaps even acting as a proper diplomat between the Imperials and Stormcloaks while revealing the true intentions of the Aldmeri Dominion, uniting both sides against them.
@@hiddendesire3076 bruh, just imagine changing the ending of the game. You as the last Dragonborn talking with Alduin and convincing him that you want to restart the Dragon Cult.
Or how about using the Jagged Crown to ACTUALLY take over Skyrim and basically make it like the Senile Scribbles 😂
Imagine auto-gpt continues to improve, and as you want to integrate more features, such as changing ending of the game, it automatically creates the needed files
That guard got really poetic after he learned he was talking to the Dragonborn!
really reminds me of my manager when the big boss came to visit my office
The combination of an AI to generate contextual text and xVASynth to speak it out will be a game changer
xvasynth sounds so robotic, the ai voice showcased here is elevenlabs
@@lomborg4876 interesting I wasn't aware of this one
Allowing user input via voice-to-text is another big one. They also have AI to help render animations. This could be used for more organic VR play or even in tandem with the custom speech.
Yeah I reckon atm text based games could use this right now, but games like Skyrim I think should wait till the ai voice is better
Just insane how you could have a deep conversation with literally any NPC in the game with this. I feel like it would multiply my playtime.
1:40 That ANSWER By Lydia is so AMAZING! Its completely Generated.
I struggle to think of a more underappreciated modder on UA-cam than you Bloc, you've done great work here.
Sadly modding in general is underappreciated. People have forgot how games became the games they are today. It was modding.
Support your indies :)
@@Splarkszter
Indie developers are a threat against Capitalism, support big game developers, they need money to grow and without growth the economy will collapse.
It would be amazing if the NPC's AI could be autonomous so they are able to make conversation with one another, or start up one with you out of nowhere.
That’ll definitely happen, especially when big game companies start taking ai into use. Also would be cool if it wasn’t just conversation, but they could also start random actions too that relate to what they say.
Your pc would explode 😂
@@sownheard Yeah true lmao, didn't think about that
I dont know if you're already aware of it and that's why you brought it up, but there's a demo of such a thing. Look up "reverie arXiv Demo" pretty cool, the potential.
That could become too heavy a load for most PCs pretty quickly. It's especially concerning that, assumingly, the data load will be increasing exponentially over time as you talk to more and more characters. I wonder how long it is sustainable.
The adult mods are going to be so good with chat AI, that I fear some people might never see the light of day again
Loverslab going to have a wild fun with this
Only trouble is GPT4 is really locked down and censored when it comes to sexual content. Might need to wait for an open source alternative. People are working on those but from what I've seen, they're still too far behind ChatGPT.
@@augustday9483 maybe people could use one of those "jailbreaks" but honestly i doubt this would be efficient
@@Cappuccino_Rabbit
The jailbreaks get patched too quickly to be practical I think. But yeah that's definitely an idea.
Do you... by any chance.. get to the Cloud district very often?.. 🤣🤣
Now make the AI good enough to be aware of in-game events. Asking lydia "hey, see anything weird happen lately" and having her respond with how wikd it was watching the farmer down the hill get launched into the air by a giant would be absolutely side splittingly funny
They absolutely can. The biggest hurdle for AI was, it didn't understand context, now that hurdle is overcome, AI can talk about anything.
@@Slav4o911and if you ask Lydia, could she rinse the leather in her pants? could she do it?


Отзыв
Другие также
@@Slav4o911and if you ask Lydia, could she rinse the leather in her pants? could she do it?


Отзыв
Другие также
I wonder how far this could go in terms of how the NPCs acknowledge the player. Say you wanted to be the son of an existing NPC, could you get thay NPC to acknowledge you as such? The role play potential here is insane
Yes, easily. GPT-4 can do that.
then i could get my dad back atleast one way
@@Musica_ad_Patrem Have you tried looking in the dairy shop?
@@bare_bear_hands 🤣
Yeah once they manage to get the text to become actions it would be a huge leap, like imagine rping as a bandit and actually being able to extort npcs you find on the road or buy things with a few words rather than a menu@Someone who's harnessed the gravity
Someone just needs to make a dynamic lipsyncing animation mod and this would be perfect. It's beyond amazing that AI has gotten to this level. It's really cool to see that, despite typing with grammatical errors, it can still accurately determine what you're saying or asking. I'm also amazed at how fluid the audio is for it as well, it doesn't sound super robotic most of the time.
And also faster responding
And also voice typing
If only Jali would be easier to license
@@itdobelikedattho8112 for faster response you need better GPU or better connection to OpenAI's APIs
You could also use OpenAI's Whisper API to accurately translate your voice as an input to this mod.
@@itdobelikedattho8112 And my axe
01:15 Lydia
03:39 Jon Battle-Born
07:50 Ysolda
11:17 Carlotta Valentia
14:13 Guard
21:02 Irileth
23:48 Jarl Balgruuf
It's fascinating. You can definitely note the flat tone compared to the voice actors, but it definitely creates a backstory and personality. I can see it complementing the professional talent.
Not just any guard, Rolf
@@DriftEJ20 While this guard claims to be Rolf, I wonder if all the other guards would also claim to be Rolf.
No Nazeem?😂
14:13 Rolf**********
Wow. Makes me want to get back into Skyrim after all these years.
I’m so glad that people are implementing new technology on such an amazing yet old game.
This is truly revolutionary. As someone who mainly does role playing playthroughs, I have always wanted to be able to hold lengthy conversations with NPCs.
I like playing with survival mods and hunterborn roleplaying I'm a lowly hunter with a skill for the bow!
you know, this would be absolutely Fantastic for games like Fallout. in the original Fallout games, you could ask NPCs more specific questions that you yourself could type out. it was very basic and didn't always understand what you were asking, but it gave you the chance to learn more about the world than the simple Dialogue Choices would let you. i would love to see it in something like Fallout 3, New Vegas, maybe Fallout 4, and sure as hell i'd love to see it in the fan mods attempting to recreate Fallouts 1 and 2
Yeah or like... Skyrim, imagine that! (xD)
@@____-ei4gq nah, I rather it get implemented into games that has more RP than G.
@@NewSorpigal1 yeah- you often had to dumb down every question you asked to 1 word sentences, and even then it didn't always understand. at least with this AI system, they could actually *comprehend* what you were asking. that said, the system, while very basic, was a really good concept, and i'd love to see it make a return in some way. using something like this mod might be the best option
I'm just hoping someone makes a detective mystery game with this
@@batman5796 oh wow, I never thought about that one. Sounds cool
This makes me think the next step is for some games to have a "story mode" and a "organic freemode" where a story, quests, scripted sequences and so on will be perpetually generated based on player actions and inputs, allowing for thousands of hours of play time and playthroughs where the story is never the same.
Damn, I remember watching another video a few weeks ago and the AI voices were a bit robotic. This is soo much better. Crazy how fast this all is improving.
Kinda scary too
Vwey scary. Even skynet is real
that's because it is improving itself
right!? I thought I saw this already, but it's better already. Sheesh.
Now I want Rolf as a companion. He seems like a chill dude.
Everyone needs a good hype man talking in similes
the better follower's mod lets you take any NPC as a follower, so its possible. there is a NPC name mod that generates a random lore friendly name for npcs that have generic names like "whiterun guard" or Thalmar mage or highway bandit. Would be cool if that + this mod worked together so when it gets named the AI would register it. Whats cool with the name mod is that it keeps a running list of names its given to NPCs so every NPC is unique even if 2 look exactly the same you will be able to tell them apart by the given name.
That guard is super relatable and really respectable. Stand up guy. I used to hate the guards cuz they seemed so boring and all of them told basically the same stories.
This is awesome. I imagine the next step assuming its possible would be a system where NPCs take action based on certain phrases, for example snitching on Ysolda's skooma business to a guard, they attempt an arrest, asking for a shop and the npc pathfinds to it , etc. I can only imagine where gaming will go from here
18:50 It is amazing the emotion of surprise he shows in his voice when you tell him you are the dragonborn. The prospects for the future of gaming is incredible. And to think this technology just came out!
So funny though. The guard didn't address the saying that dragons are nonsense and then reveal you are the dragon born, I would be confused😅
Lol he was sucking your dick MAD hard tho xD "Like staring at a storm at it's Apex"
His delivery was flat as it could had been.
@@REgamesplayer you go make this tech then
@@klizzarddddddddddddd You do love your logical fallacies, don''t you?
This is what AI was built for! No one gets hurt/exploited (except nazeem) and we can enjoy even more skyrim!
This is one of the most impressive things I've ever seen done in a videogame. But man, you gotta feel for voice actors these days.
It’s really cool. But yeah this stuff is gonna put em out of a job
To get a real convincing voice, you would still want a voice actor to perform several hundreds of lines. Then the AI can use the voice to match the tone, demeanor, etc. to fill in the blanks of lines not spoken. Gotta remember that it's using all Lydia's dialogue to create the new stuff. Have to give it a base. One day we won't have to, but we are still a bit out from that I think.
This stuffs going to put humanity out of existence
I personally think there will always be need for voice actors to make lines actually convincing. You need tons of voice performance to train the AI off of. Plus they will always be using celebrity voices in games
@@dawert2667 That and Voice AI for Skyrim specifically I think is a good thing because Skyrim came out almost 12 years at this point. the voice actors in this game probably wouldn't sound the same if someone were to pay the originals for their own mods. (If it's even something that can be done)
The conversation with Jon blew my mind. Thats amazing. Congrats on making something so amazing!
This is (to me at least) really incredible, as it opens up a lot of development opportunities for open world games in the future in my opinion. I don't know if you've ever heard of "the dragonborn speaks", but I'm really curious as to how that would function with this. In a way, if someone made it work, I'd assume you could have very realistic conversations with anyone in skyrim. Paired with VR, that has to be one crazy experience.
For anyone not aware, "the dragonborn speaks" is a speech recognition mod for skyrim.
I was curious about the same thing. Could be incredibly immersive even in this early state of AI!
I stated in FAQ part but let me touch that point here too, you don't need external mod/module to make that work because Inworld already comes with speech-to-text module, so you can technically just use their solution and can have conversations without typing.
@@Bloctheworker Is it a machine learning recognition model, or the old Microsoft solution we've been using?
I'm really impressed! This is revolutionary. Can they decide to execute actions based on the conversation? Like attacking if we offend them?
Only problem i had with this type of is ai is that eventually this will go insane and starts looping or forget things that happend before and start making stuff up, not sure if this have the same problem as those.
@@renzmanzano4010 Well, as far as I know. Inworld AI which is being used in this video doesnt really create random and insane scenarios and stay true to the character. But Im sure theyll improve a lot in the near future!
@@renzmanzano4010 I've had this exact problem just talking to some of the free bots on inworld AI so I wouldn't be surprised if the same problem happens in game.
@@adamf6391 yea I hope so, its just funny how in one minute you can have the most realistic conversation and the next it feels like your talking to somebody with dementia.
@Davi: They can't execute actions at this stage. I was in contact with Inworld and requested that feature awhile ago when I was working in Bannerlord, they are working on that feature as far as I know.
@renz: As Adam said, Inworld AI doesn't go crazy with random dialogues. They occasionally hallucinate though, talk about things that doesn't exist, but they are generally very "strict" to their characters. You can create your account now for free and test it yourself as well, you don't need mod for this - although you probably need to create a character with somewhat elaborate details, otherwise AI can create awkward conversations when it doesn't have enough information to go with. What good about Inworld AI is, you can't make them say things like "As a Large Language Model..." regardless of how much you talk, they always stick to their characters and even in case you push ethical boundaries, they reject giving you an answer by staying in their character.
"I'm sorry, but as an AI language model, I cannot promote or encourage the use of illegal substances. Skooma is a fictional drug that exists in The Elder Scrolls video game series. It is a highly addictive and illegal narcotic that is known to cause negative effects on the user's health and behavior. "
Just teasing, great job on the mod! 😸
Now that I know the story of the arrow in the knee I can finally rest in peace.
I love how Lydia immediately slanders Khajiit and Ysholda brings up genuine ethical questions about the distribution and use of Skooma. Makes me want to sit at the throat of the world and have a deep psychological conversation with Paarthurnax about the state of Tamriel and his opinion on its change since the Merethic era. Also want to ask M'aiq some questions
It’s be awesome if you could generate your own quests like in the beginning when they asked Lydia if she wanted them to deal with the khajiits
Honestly that's not too far-fetched given Skyrim's already existing radiant quest system.
that and imagine with enough scripting radiant quests like that would be possible with the ai
An NPC saying they’ll handle it themself goes against the very essence of Bethesda games
@@nathanielshaver3139 imagine “another settlement needs our help, I’ll handle it myself” that would be the day
@@unknownuser565 a man can dream...
Dang the amount of depth the guard has now is so cool. Didn't realize he was so poetic lol. It was cool how his voice was able to change too yelling in shock
The future is now
Back then I literally imagined what it would be like for future games to have human like dialogue interactions with NPCs and now here we are
This blew my mind. Just the fact that you can get more of a story out of them is really amazing. I want this in my game now.
Great job Bloc! However, what would make it even better is if the AI could speak up on their own, not always waiting for input from the player. That would make it way more natural.
Although I am aware that this would be very difficult to balance.
NPCs in Skyrim are doing something similar already, they have some randomized greeting lines. Like after hearing "No lollygagging" from Guard, you can ask "Why no lollygagging? What's the problem with that" and it should give an appropriate answer.
With our tech, you can create custom event triggers and goals and actions so they can be programmed to speak up to share certain things, to greet you, or to interject some piece of the game narrative into the conversation. They are able to do that at a specific time, based on a trigger in what you say (ex. I'm looking for a new sword and they can jump in to talk about where to find one), or they can be given the goal to share about something and they'll look for the right opening in the conversation in order to not just blurt it out in a way that comes across as out of context.
@@Bloctheworker What I also thought about was reducing just how much the talk. They spit out whole dialogues while normal people would probably at first go with a simple "Huh?" "What do you want?".
@@anobody410 2Kliksphillip made a video about this, one of the example characters that the Inworld people made more or less fits into this non-talkative style of writing.
@@inworldai Very cool, you are doing great things at Inworld.
This is the best thing I've ever seen in a videogame I'm truly in awe how far games have come hope this will be the future of gaming.
Bro, ever since I started playing Skyrim, my thoughts were like "Hmm, how epic it would be to actually talk to these NPCs?" and now I see my imaginations and dreams slowly (but surely) becoming a reality.
I feel like for this to truly work, every npc would need to have a memory of everything you say to them or what they see, but seeing this already is like a childhood dream come true
Well, you could store that dialog chat into a database on your local computer and it get's loaded from there when you speak the next time with the same NPC again. GPT-4 has a very large context size, so you can pack a lot of informations into it and that gives you a big playspace to you tricks for great NPC memory.
To really work, they'd need a sort of memory for everything that anyone says to them and anything they see, they'd need a way of losing memory, and they'd need a system for censoring themselves instead of just spitting out everything that's relevant to the question. They'd need actual trust systems and relationship mechanics that determine how they interact with the player and other NPCs, and what kind of information they're willing to share.
There's a lot that this still needs to truly be immersive and feel like real characters. But it's not that far off, because AI technology is rapidly advancing. We'll undoubtedly get something like that in a game in the coming years.
@@peterlewis2178 I'm pretty sure inworld has an individual character memory right?
@@carolusmagnus9757 Maybe, but if it does it's clearly not as sophisticated as it needs to be. I mean, as a simple example, the Whiterun guard used the exact same phrasing about the dragonborn after the player told him they were the draghonborn. It was very unnatural and unrealistic, and showed that the guard didn't really have the memory to contextualize what he'd just said about the dragonborn and apply that to his response to being told that the player was the dragonborn.
This completely changes games in a whole different way not just games you are paving the way for virtual sentence itself
bloc is really taking the charge here on this genre of modding, the hero we needed
Ok but why Ysolda sound like a modern business owner?! I'm actually crying, thats way too funny.
I love this a lot. The NPCs don't only vary their text according to what you say to them, they stay within character as well. This is truely amazing software.
This is incredible, I think the big thing to change is to make the characters more defensive, erratic, and less reasonable. Rn in the early stages their behavior is a little too calm and compliant to be human. Still an incredible showcase of new technology and the future of gaming, definitely required lots of hardwork to make
I agree, I was waiting for someone to be impatient, distracted or just an ass.
Rolf should be a bard. He has quite a way with words. He really knows how to utilize imagery