How Inworld's 'Origins' Demo Actually Works
Вставка
- Опубліковано 31 тра 2024
- In a recent video, I looked at 'Origins': a detective game that uses AI technology built by Inworld (@inworldai) that allows players to interact with non-player characters directly using speech or text, and holding fully immersive conversations with them.
In this video, we find out how it all actually works. I sit down with Kylan Gibbs, the CPO of Inworld, to discuss not just the inner workings of Origins, but the original inspiration that saw it come to light, the response they've received from the gaming community, and what else we can come to expect from them in the future.
You can try it out yourself by downloading Origins for free on Steam:
bit.ly/AIandGames-Origins
And if you're a developer yourself, sign up for a free trial of Inworld's tools, and start building your own conversational AI characters
bit.ly/AIandGames-2
[00:00] Intro
[01:07] Releasing Origins to the Public
[04:25] So How Does Origins Work?
[09:00] Building Character Motivations
[10:55] Player Profiling
[13:00] AI to AI Conversation
[14:47] Character Templates
[17:09] Safety Mechanisms
[22:00] Future Plans
[24:01] Try Inworld Yourself!
[25:01] Credits
Special thanks to Inworld for sponsoring this episode. I was compensated for my time spent producing this video.
--
AI and Games is a UA-cam series on research and applications of Artificial Intelligence in video games.
Follow 'AI and Games' for educational videos and essays:
/ @aiandgames
My second channel 'AI and Games Plus' is dedicated to bonus content, deep-dive analysis, revisiting old topics and more:
/ @aiandgamesplus
Listen to my podcast 'Branching Factor', as I discuss game development and research with my co-hosts and guests:
shows.acast.com/branchingfactor
Watch Livestreams: / aiandgames
Join our Community: discord.aiandgames.com
Buy our Merch: store.aiandgames.com
--
You can support AI and Games via Patreon and UA-cam memberships, and in return, you get bonus rewards!
/ aiandgames
www.youtube.com/@AIandGames/join
--
Follow 'AI and Games' on social media.
Twitter: / aiandgames
Mastodon: mastodon.gamedev.place/@AIand...
TikTok: / aiandgames
Instagram: / aiandgames
Threads: www.threads.net/@aiandgames
#inworld #microsoft
BlueSky: bsky.app/profile/aiandgames.b...
Substack: www.aiandgames.com
--
If you're interested in working with us, check out the following:
Business Enquiries: contact@aiandgames.com
Arrange Meeting: calendly.com/aiandgames - Ігри
Thanks once again to Inworld for their time. Don't forget, you can try out Origins yourself on Steam:
bit.ly/AIandGames-Origins
And if you're a developer yourself, sign up and try out Inworld's tools:
bit.ly/AIandGames-2
17:02 maybe something like what they do in Watchdogs, the npc doesn't gain a specific AI unless the players show interest in them.
This is really cool technology, and I'm excited to see how it develops, but right now all this boils down to just fancy chat-bots. One glaring issue I see is how to keep both the words and the actions of the NPCs consistent. Like, a lot of the characters in the demo are stationary, or on set walk-paths. If you can somehow convince them to follow you, or that you are going to harm them, they just stand there. For a truly believable character, they need to interact with and respond to the world in a realistic way. If the player knocks something over, or they pull a gun or something, you would expect the NPC to react accordingly, like commenting on it, exclaiming out in surprise, running away, fighting back, calling guards, etc. I suspect making sure that the NPCs take believable actions to go along with their words is going to be a huge hurdle for Inworld or any other dev attempting this technology .
My issue with this technology in games is that if lots of games start using it they will need to be online only, even for single player.
Yeah, that's a challenge for any company trying to use LLMs. I saw some really fun work by Square Enix at GDC this year where they're trying to figure out how to make them portable for mobile games. But given this is all running on a larger back-end, it will need to run online-only.
@@AIandGamesbelieve Qualcomm has launched AI chips for mobile with Samsung?
@@shaokhan4421Yeah there's a huge push for AI chips to move into mobile devices after we saw the big push on desktop devices (be it Intel's chipsets or NVIDIA's GPUs). I've been chatting periodically with my contact at Qualcomm about finding a way to work together on something. Who knows, maybe a video on that some day...
@@shaokhan4421 I find it dubious that companies will _want_ to run things locally because that would mean they'd need to actually give each user a copy of their very hard to make AI and the moment the encryption or whatever auth system they use is broken that AI will be in the hand of everyone for free, plus with AI as an excuse to run everything online DRM becomes a lot harder to remove
@@NICK.... Running LLMs on servers isn't exactly cheap, so there's an incentive to push that to user hardware if they can. I doubt there will be too much protectionism around these models in the future, because once there are 100 of them floating about, the 101st version finetuned to a different game and character isn't very valuable.
Large studios may like the DRM excuse, but once small indies start using this tech without doing that, that excuse won't stand up and we'll be in the same position we're in now with DRM.
I can see them wanting to keep the LLMs on servers for safety purposes though.
Working in the AI industry, I'm not sure how to feel about conversation networks in video games.
On one hand, the idea of being able to interact with NPCs in such a natural and unscripted manner is certainly exciting. It's fun to think about all of the possibilities an RPG with such a system would possess.
However, I have concerns.
Firstly, I'm going to ignore efficiency because it's too complicated and technical of a subject for a UA-cam comment. We all know LLMs do not scale efficiently and who knows, maybe a RetNet will be a valid alternative in the future.
My real concern is that the companies which are capable of fully implementing such a system will never do it "right". This is because they will not allow the freedom the player will want from LLM driven NPCs. Imagine this, you're sitting in a tavern with your companion having a beer. And you remember that joke that you told your real life friends at the bar last weekend. Your friends found it funny, maybe one of them found it offensive but, that happens. Offensive is subjective, the majority found it funny and maybe John should lighten up a bit. You decide to tell this joke to your Ai companion in-game at the tavern and one the following scenarios plays out:
1.) Your message is not allowed to be sent, blocked by an inbound filter.
2.) The message is sent, but the NPC just stares blankly at you and ignores it.
3.) The message is sent, and the NPC turns to you and begins giving you an unhinged moral lecture that no sane individual would find reasonable.
Does that sound like fun? No, of course not. Imagine a mature rated game where swear words are strictly forbidden. You're an adult, you purchased this game for its conversational mechanics, and you can't actually have a 'real' conversation with the NPCs.
This will create another procgen scenario. Where players begin to roll their eyes and long for the days of handcrafted worlds whenever the words "procedural generation" are uttered from a game devs lips.
I worry the same will become true for conversational networks in gaming.
I guarantee if that happens, there will be "Rejected prompt" % speedruns.
you are absolutely correct. I am an indie dev and am building my own llms to solve this problem. no AAA will ever be able to compete with smaller teams with zero "hate speech" limitations on the inputs and conversation filtering.
I think another big problem, aside the always-online limitation, is that it's a very intensive system on hardware and power. In short, it's a big waste of electricity, which is not going to be so easy access as resources get more limited. I feel like it's too much of a luxury to be viable aside a niche, like VR.
I know this is completely unrelated, I just found your channel recently and finished your Alien Isolation Video and have to ask if you have thought about covering Amnesia the Bunker's AI. I just cleared it cause of Halloween and I havnt been impressed by an AI since Isolation, but Amnesia the Bunker's Beast is very similar and could be worth a video
I just played it last night for the first time on stream over on my second channel.
ua-cam.com/users/livemEHdSJTc1Pw?si=y1QrjMKpG397-YI4
@@AIandGames Nice, Ill check this out tonight when I go to wind down. Hope it is worthy of a full video AI breakdown in the future.
@AlandGames could you plz make Inworld AI & Convai mod tutorials? Bloc was able to do GTA5, Skyrim, and others with Inworld but no tutorials. And Akshit Ireddy made a Hogwarts and Cyberpunk Convai mods so far with written tutorials, but hard to follow as a noob lmao
I've been subscribed since the alien ai vid haven't watched much but since you do game stuff I thought you might want to take a look at the environmental destruction system in: The finals. However it's a multiplayer only game currently in beta but I haven't seen destructive environments like this since battlefield 4 and I'm surprised how well it runs and the great graphics. Sure I have a fairly top end pc 3090 Nvidia 16gb ram and a fairly high end 3rd gen 7000 Ryzen but I have had no lagg spikes since I first booted into the game. And on a sidenote a friend said something about the in-game announcers are apparently AI generated
i love ur content man, keep up the amazing work 👍🏼
Having a story system that is limited to what a company allows you to tell, will never allow you to make a game that pushes our society forward. Any issue that is taboo in our current time you wont be able to bring up in your game.
Its a great tool but it can be very limiting.
Dean Takahashi 🤣🤣🤣🤣🤣
its neat but i wouldnt like that they get to determine what my characters can or cant say with their ToS
Does anyone actually trust this?
Depends on what you mean by "trust".
Like, I definitely trust publishers and developers to use this technology to avoid paying voice actors as much as possible, as well as any writers, artists and coders that can technically be replaced. I trust that people will go "wao freeform conversations with npcs so cool here's money!!!" without any critical thought.
I don't trust that any of this technology will be regulated to a sufficient degree that it becomes a pipeline tool for legitimate development. I don't trust that these systems could even make a truly compelling game experience without being harshly wrangled and heavily tweaked by developers.
So, it depends.
@@symphoricquoz3763a real world game implementation will include a robust voice over script in addition to any AI character driven conversation mechanics. the system is far off from being ready to implement without the aid of actual scripting for many of the narrative character trees
the "hate police" requirements are a non-starter for any serious game development implementation. Not being able to write your fiction with the characters the way you intend because of hidden diversity and inclusion programs fighting you at every turn makes this a complete waste of energy. as you said, "evil characters need to sound evil"