NVIDIA ACE | NVIDIA x Inworld AI - Pushing the Boundaries of Game Characters in Covert Protocol
Вставка
- Опубліковано 10 вер 2024
- Watch how NVIDIA & Inworld AI worked together to create Covert Protocol, an innovative technology demo that brings AI characters to life.
Created by Inworld AI in partnership with NVIDIA, Covert Protocol is powered by the Inworld Engine and NVIDIA ACE microservices including NVIDIA Riva Automatic Speech Recognition (ASR), and NVIDIA Audio2Face.
Learn More: www.nvidia.com...
Learn More about NVIDIA ACE: developer.nvid...
Learn More about Inworld AI: inworld.ai/
As I walk up to the receptionist
"Ayo, someone demolished the bathroom. You might need to a cleaning crew for that."
aint no way us said that🤣🤣
I know this is early days, but the vocal performances and character expressions are on the level of Elder Scrolls Oblivion.
Yea, but remember, Ai is only as bad as its ever going to be today. Its going to get better and its shown it has gotten better at a rapid pace. a year ago we had a scary will smith eating spaghetti ai generated video, it was pretty bad to look at but now just go look at openAI new video generated work. Its only going to get better. Scary but cool at the same time.
@@DeadShizno Things may in fact stay just as bad as they are now! I do not think that is the case, but if the vultures decide to flock to some other tasty thing -- taking their money with them -- then there could be a very long period of stagnation.
@@daoshenThat's because Nvidia currently has no expertise in anything relates to AI Software. They lead the AI hardware market, but each and every software Nvidia ever released, was garbage. On the good side, other developers are developing AI Voice Synthesis as we speak and they're doing an amazing job.
CUDA?
@@DeadShizno Been more than a year and these AI algorithms still can't draw hands. When they improve, I'll acknowledge it. Until then, I'll remain skeptical.
Can NPCs have fully AI generated conversations between one another? Cuz I bet that shit could get wild.
it wouldnt get too wild as they have to not take risks that could jeopardize the profits of their shareholders. There'd be a ton of guardrails in place to prevent liabilities
@bwzarchive708 but what if this feature will in GTA VI))
You can already do that in modded Skyrim but the restrictions on the AI make it kinda bland and boring.
it wouldnt get wild, its just boring and sad. the AI fun police would prevent them from saying anything funny or possibly offensive. all you would get is "How about this weather?" "the weather is good." Nothing interesting, and nothing a human writer cant write.
yes they can
0:35, bro definitely lifts. look at those bad boys
*HENCH*
Shia LeBUFF
The question is: Can the AI feed its Experiences inside the game dynamically into its backstory? If so then sandbox games with npc's are in for a huge story-boost
If you ask if AI can roleplay a character, yes it can. If you ask if it will be a human level roleplay, no, but it would be much better than repeating the same scripted line (few lines) again and again. Also it understands context so the character can track what has happened in the past. I think AI is suited best for RPG games, where it can tailor unique non scripted experience based on your actions. Also you could possibly create characters, give them background and other stats and they then behave according to that.
Open world game will have unique experience with this ai. @@Slav4o911
Imagine Hitman with AI npcs. You can try to fool them or do some stuff to help you with the mission. For some reson Hitman is one of the first games that came to mind, also GTA.
Honestly, completely unironically, Hitman is the perfect game for this AI. I had the same idea.
Current AI has the exact balance of surprising and incidental bouts of intelligence, interspersed with being incredibly dumb and uncanny (i.e. just like the NPC behaviour that's already in the Hitman games), that it would match up wonderfully with the tone of a game where you can dress up as a clown and murder people with banana skins and rubber ducks. The wacky shenanigans that would result from combining AI with the narrative of the Hitman series would be absolutely hilarious.
Hitman takes itself just the right amount of seriously (i.e. not very, but there is an underlying vaguely coherent story) for machine learning to work.
That sounds pretty interesting. It could really add to the replayability of games if implemented correctly.
imagine the life that would breathe into skyrim npcs. Just sitting down as I have a 2 hour long argument with nazeem about the sky district.
@@NineSeptims Skyrim mods in 2030 gonna be wild
It can make games much more interesting.
@@NineSeptimsYou just want a excuse to replay it for the 50th time, dont you?
I can see a surge in Adventure games when this is perfected. Imagine a detective series.
Uncanny Valley is strong on this one.
Waiting for the moment such a video will be played and at the end they state "all presenters were rendered in real time"
And some random guy with a red shirt will ask if this is some out of season Aprils Fool.
I actually watched a UA-cam video about the Sega Mega Drive's sound capabilities and the guy in the video did exactly that. All the audio in the video was running on the MD.
Not just "state at the end", but in the middle of the video people should start turning into textureless models - then maybe into polygon meshes - and then they state, "it all was rendered in real time".
Yeah it's just too creepy for me. I wouldn't play this game. It's a cool tech demo though.
One thing I noticed about this is that for this to work you need to connect to their servers for every interaction and the Inworld servers will return to the client the result of the AI interaction. That means this only works for always-online games? Does the developer need to pay for every interaction done in every game sold if we go over 5000 interactions per month or over $50000 revenue (from what I read in their FAQ)? If these are the cases I'm not gonna lie it sounds a bit unsustainable
Eventually the models will be compressed and run locally. The hardware in computers will be completely aligned to executing this as the fastest part of the heap.
@@user-account-not-foundYeah that would be ideal, but don't know if that would align with Inworld's business model, it seems they are leaning more into the Software-as-a-Service side of things
There are already pretty decent local versions of LLMs around
RPGs and open world games are about to be alot more immersive and unique
game physics hasn't improved that much though.
yeah no more NPCs repeating the same few lines of dialogue....imagine every time you 'talk' with an NPC it will say something completely different, like a NPC shopkeepers that sells the weapons or whatever
.... by steering completely clear of this garbage.
In 5 years when this has been fully adopted and it’s just a beta
This will be widely adopted only when consoles are able to run it without major compromises so it will take a while.
Imagine an Animal Crossing where your neighbors share new stories every day, engaging in truly meaningful conversations. It's a dream come true. However, given that AC is a Nintendo brand, the next "innovation" will likely be Voice dubbing in four to five years. But in 10 years, things could get really interesting. Maybe.
Heck yes I'd love for something like that to happen, especially when it comes to writing letters!
We've seen how amazing the Skyrim A.I. Companion mod can be, having that in more games? Sign. Me. Up!
Very weak AI performance! NPCs look, talk and feel like as if they were from video games from the early 2000s. Nothing new nor great has been accomplished, with this video.
It sounds great on paper, but it doesn't really correlate with what is being shown. Facial animations and "acting" is horrible for this level of graphics. And three different responses with several outcomes isn't anything new.
@alargecorgi2199 nope, never said that
Goodbye writers. Now all the stories will be AI generated and no handcrafted by people telling an amazing story.
Modern life sucks.
Some in the comments are complaining about the graphics completely missing the point of this demo.
It will be very interesting to play with these AI-minded npcs.
If you guys dont understand how impactful this is let me break it down. They dont have to call in voice actors. The npcs are independent with a giant wide range of emotions and reactions. Built in. One day theyre happy. And depending on the circumstance. The complex independent ai can fluctuate, blend, and morph moment to moment gameplay. If one of the ai loses their dog, it will have a behaviour to where it will react accordingly. Aka simulate emotions of sadness and tone of voice will be sad. This is insane.
The facial expressions were ridiculous, the movement of the mouth looks like Origami.
It's a show case for AI not graphics
Imagine the lively feeling that you'll get in games in the future with this tech. Interaction sith thr world around you will be on a different level ❤❤
Almost like real life!!
In fact, I might just go outside.
@@brenolad yeah man, 100%. But this interaction in games will be kickass. ❤️💪🏻
a whole new level of lifeless dialogue
Indeed
RIP actually true -- this is only gonna make these dead AAA money grubbing games even MORE DEAD
Came here because The Verge unfortunately described this as "Covert Protocol, a playable tech demo" - and I assumed that means *I* can play it.
For now, there's "Inworld Origins" on Steam for free, using GPT-3.5. A very early, simple tech demo - but it's fun to hear the different NPCs, trying to stay in-character.
I convinced an AI character to provide code after it initially refused as not relevant to the job of investigating the crime scene, insisting that we could import a Boston Dynamics "Spot" with a CLIP model for visual analysis of the crime scene... so AI went like "import torch, import os, import clip" and so on, lol. Fun if that would cause downstream confusion and hallucinations of other NPCs now believing there's a robo-dog in the game; I can't wait! 😀
Awesome, this will greatly advance the immersion of the game. When you can talk to any npcs. These are the first steps towards ai being able to seem alive. Right now secondary characters are being spelled out, but in the future this will greatly enrich optional quests, level serve, fetch. (Though of course I'd prefer not to have those quests at all, but getting them from "a live" one is at least something.) Unfortunately, so far, such models are created for short insignificant dialogs and they do not possess scripting skills. But hopefully this will make the work of scriptwriters easier, and the language models themselves will become more flexibly customizable
You could actually leverage multiple AI agents for that purpose. Some of them would be responsible for NPC interactions, but others (invisible to the player) could be crafting a wider spanning story in the background. For me this looks like the future. However for this to be widely adopted we still have a few fences to jump. I imagine once the hardware catches up and open source LLMs (run localy) get better and better, this would bring insane amounts of immersion and replayability.
Perhaps I'll be around for a few good AI games.
Need this in Cyberpunk 2077!
In the sequel yeah. I think they won't add it to 2077.
@@GeneralS1mba Mods will
This was a game I couldn't delete fast enough post beating it and I played it after all the patching. Terrible game.
@@user-account-not-found keep telling that to yourself
@@user-account-not-found Keep coping lil bro
Ill wait for the day you use a mic and just talk to npcs and ai is used to respond. That will be a cool experience.
To the guys at NVIDIA, just learn what CDPR did with cyberpunk. That needs to be the benchmark
I have an idea for a gaming platform that could be both fun and profitable. The concept is to allow gamers to pay $1 for 100 credits, which they can use to compete for the best score in retro-style games. These competitions could be held daily, weekly, or monthly, with the winner taking the prize pool after a small deduction-say, 5 credits out of each dollar as profit.
To make it even more interesting, the platform could have two zones: a bot-safe zone and a no-bot zone. This way, we could see what AI and human players come up with, like a 1-day Mario clone run competition. The winner would receive a substantial prize in credits, which could be redeemable, and this is where the platform could generate revenue. Additionally, the data from human speedruns would be invaluable for training and further development.
I think this platform could really capture the competitive spirit and creativity of the gaming and development community.
Revised by chat
This again isn't AI. This is just a giant IF statement. The AI model isn't spontaneously deciding anything
How are decisions not if statements?
You really need to improve the voice of that A.I. from the 00:10 second mark. It is totally ineligable.
Calm down ai is still pretty new and we are still trying to improve bre
😂
Future Hitman games will be even more fun and immersive
"hey! i heard a weird clucking sound from your upstairs walk-in closet maybe you should go check it out!"
It works until actual players get to play it.
The minute people start saying random stuff it's gonna just break.
Quantity over quality. Todd Howard should be giving you guys a call soon.
All the articles I've seen about this is complaining about how they suck and actors/coders are still needed but nope. In a few short years I'll be able to just ask my computer to make elder scrolls 10 in space with table top rpg elements but also as a shooter just to make the system really take 8 seconds to make me a 400+ hour game on the fly. Oh and if I don't like something or want more content, I ask the system for more content.
That is very cool. But what I would like is for AI simulated experiences not just different speech with the same scripted outcome. Like more of a live gameworld whee anything can happen. Something like A-life from Stalker series could be improved amazingly using modern AI.
Yeah. Handling NPC interactions is one thing that AI can do but it could also be like a Game Master, crafting an intertwining stories in the background.
I cannot wait to tell NPCs to either "f off" or "stop following so close to me!"
Skip. (C)
why in cp2077 the all characters more natural than in this demo?
i'm one intel&nvida fan btw
They really nailed the quality of characters of Bethesda single player games, and this isn't a compliment.
They actually managed to do worse. That takes effort. A true breakthrough for AI. 😂😂
This is a dialogue solution, not a graphics toolbox.
@@Safetytrousers stop simping.
@@GiuseppeNelvaStart using your brain.
ua-cam.com/video/fRm9iOpreLw/v-deo.html
This is gonna suck so much. Instead of fine tuned questlines written by a actual writer its going to be inconsistent slop. What if i want to replay a questline? I wouldnt be able to do that. This is just going to be skyrims radiant quests but more advanced. Its fundamentally creatively bankrupted.
Stiff asf.
If we this implemented, what about voice actors then ?
People still prefer 4D motion capture than this freaky facial animation with janky body language...
Looks like some cool tech but this is so far from "immersive" they need to stop using that word.
They should hire decent character designer, now it looks like .... How they want to sell the tech this way, scene looks good, characters beyond horrible.
Guys, as an animator... what are you doing? Where are the phonemes in the NPC's lipsyncs. You are mainly articulating the jaw and there is no mask reaction which is making your characters look so lifeless. This stuff should be rudimentary now and makes the work look far less impressive. Please hire an animator to punch this stuff up, AI is only going to meet you half way.
The corporate speak is strong in this video lol.
westworld is getting closer
Ok, I don't want to downplay this, but everything here is really pretty easy to do. If the price is good then fine, but LLMs and voice input/output really are amazingly easy to do these days with the services avaliable. If it's locally hosted then yes, that's much harder. What services are they using? Opensource LLMs? Local voice synth?
It is local. Tensor cores have a use beyond DLSS now.
@@FelaleI wonder if npus in a couple years or something will be powerful enough for this. A desktop npu doesn't *have* to be designed for efficiency like our current intel/amd ones are.
This and nemesis system in an open world GTA like game would go so hard
Chat messenger simulator. I doubt that this will help made good game. Most problems are weak plot not NPC replies
The beginning steps. Gamers will be eating good in a few years!
this feels soulless. what makes side objectives in games so endearing and memorable is the writing and performances from actual people. I get using something this to help quickly slap some stuff together, but all this isn't so much helping the devs, it's trying to automate creativity, which will do nothing but hurt the industry as a whole because you lose out on stuff like as creative as Alan Wake II, Cyberpunk, and Deus Ex, when you try to shove it through a machine and tell it to "make".
This should increase the level of gaming! Great!
WOW STUNNING!
OMG 0:34 guy looks like Heinrich Himmler
It could work on robot/non-human stuff but as soon as I see human npc with that, it falls flat. Good concept, will not be used for years. After all a lot of features from UE5 from years ago are still NOT used in games now.
when is it going to be available on my phone to answer my phone calls?
These are big steps... backwards
Can we use it in unreal engine 5?
Nice tech demo, just give them a few decades and this will be really sg in games as well
Wow I can’t wait to go AFK in one of these games and cause an AI to have an existential crisis!
I love how skyrim modders are ahead of nvidia by a year
Devs are gonna be forced to use it so they don't need to pay for voice acting and story writing... Nah. Please, gaming industry, we want games with soul.
After seeing last Unreal Engine Presentation these characters look like from 2018
Mass effect andromeda?
You guys are comparing this to perfectly curated and recorded NPC interactions from 300million dollar games. Of course this will fall short of those.
I hate this marketing BS
Why?
AI is changing everything!
I love it that the humans promoting this product are completely scripted.
Parallel came first, love to see it
Як мені зрозуміти що люди які розповідають про ші npc в цьому відео не є ші npc?
Can't understand why they didn't use the best of Metahuman for this. The NPCs look terrible.
Dam, that Yasmina is a beauty.
Ai characters: iterative
Human VAs: irreplaceable
You may think that now but as technology develops, all things we think we understand or think are better get replaced over time, and the cycle continues.
Here's the problem with your model: It treats people as a commodity. People aren't worth something because of what they can do. People who are totally dependent due to illness or injury are worth something. VAs are replaceable, but that doesn't mean that they're not worth something.
that^ this is early stages, and even at this stage it’ll be useful for unimportant NPCs, to keep the world immersive, lively and save costs
I think voice actors of the future will license their voices to developers who will train AI on it to make any dialogue they want out of it. It's already good and it's only going to get better.
Someday we will have better looking NPCs. that day is not today.
I swear. These whole shits won't stop until someone seriously gets hurt
I mean woke*
@@Midnightservant1What?
I don't care about AI NPC's if they still sound robotic and can't use inflection... when they get the AI to do that I will be way more impressed.
What happens when you repeat the same prompt to an NPC multiple times over? +10 points if they lose their temper and tell you to bugger off.
Imagine this and Jali together, oh boy.
Looks like crap if u ask me. Characters looks like Bethesda npcs.. Cmon guys, you can do better.
they gotta rework the way the voices sound otherwize i cant take it seriously
This is where they tell you, everyone and everything in this trailer, was and is A.I including Yasmina, Kylan and Igor, meanwhile, you're tech can only handle the other CPC's the real tech being utilized are these three which are aformentioned.
Pretty uncanny characterwise. Nothing special tbh. Screw AI
Never been more convinced that I don't want AI in games.
This was awful.
You know the tech is there, where they have to explain what you are observing...
If they didn't say it's AI, I would be mislead to believe, it is some sort of student project, where the characters have 3 random lines. But now I understand better. Thank you.
На 1:20 Игорь Полетаев очень скованно себя ведет. Замените для интервью Игоря цифровым аватаром, не мучайте человека - говорить "на камеру" это не для него. ))) А технология, о которой идет речь в этом видео перспективная. Вероятно мы стоим на пороге момента, когда игровые миры перестают быть однообразными и скучными.
The best rendered NPC was the VP ...
My question is, what you gonna do when one or ALL of em realize what they are and want out of the GAME???....
More animation to the body language 😾
LMAO the level of animation and uncanny valley is on PS2 level. Nice one
Do the AI NPCs know they're in a game?
Soooo.... when can we initiate an actual conversation with an A.I. that is constrained within a game world? I wonder how many conversations you could have about breaking the fourth wall... haha. It'd be cool though.
Can i see a short clip without the narration, please?
It s the beginning. There s a lot of work to do... but ... WOW
We need to make a new law that forbidden use all data from Nvidia and videogame to make a robot in real life
In five years we'll have no idea if we're playing online games with real human beings or not.
Maybe less.
This looks so crap
I am not impressed, i am way more angry because out of a suddon i need an account to updated the driver for my nvidia graphics card. What do i need a freaking account for downloading the fixes for software errors the producers of my graphics card made?
You guys at Nvidia couldn't work fast enough to bring the technology to fruition, so what you perceive as groundbreaking and controversial is actually stagnant; you had the potential to achieve so much more if you were truly committed. **Insert Owen Wilson's WOW meme right here please** BTW LOVE the gym bro you guys brought on.. literally staring at the teleprompter, was pathetic.
the lipsync killed the hype, to be honest
2:12 Nvidia showing what my stock money being used...