NPC character triggered to speak audio and animate in spatial.

Sample of an NPC character triggered to speak an audio clip and animate the speech/ with body language, when a real time avatar steps close to it. Intended for in Spatial. Created am avatar from Ready Player me, Blender,, then Unity and the Spatial Unity SDK.

[@joselino973]

Hi Brian, I don't know how many times I played your video, it is exactly what I need to do but I cannot find any info, any updates on the longer video? 😁Thanks

[@bakkasensei]

Hey Brian,
Any chance you could explain to me how you did this?

[@BrianLife]

Hi, yes, I downloaded the Ready Player me, avatar. ( you have to get a RPM account.set up an avatar. go to My Avatars, click the 3 dots, on right and download GLB. then in blender import a GLB ( need an add of for that, sorry I cant explain all, you can google that). so after I have the avatar in blender. each model has blend shapes for the face, mouth expressions. I imported an adios clip to Blender (YT search working with audio in blender, or lip sync animation in blender) I then keyed the mouth movements to the sounds as best I could. I then saved out and FBX of the animation and imported that into Unity. Now, its not that easy though, you do have to know a bit about blenders NLA tracks and how to push down the animation to be a final mesh deformed, animation and Unity not easy either. When you import your character into Unity you have to change its rig from generic to Humanoid. and also go into configure and be sure it right. you can scroll down to bottom to force a t-pose. these are all things that would be better visually showing. not in text)
I am new to Unity, I found many issues but, soem how got it to work. also the audio. So in Unity. you will need to learn/ know about Spatial Unity SDK. Spatial UA-cam site has learning videos on it. install etc. also how to make trigger events component. This is all ver hard to explain in text. but you basically have to make a trigger event. ( spatial has a video on that) so when you/ the visitor steps in a certain aria, things are triggered, like in this case the animation is trigged on event and ( him speaking) and the audio at the same time, so it is in sync again this was difficult to do but doable. I may make a video on how to do this step by step soon. its really the only way to explain it best by showing. its was tough to get my idle character and my animation character to be used. I have to save out two versions.

[@bobdeclor528]

any tutorials you know of where one would accomplish something like this?

[@EventHorizonVR2023]

Nice Job! This can also be done as an interactable trigger and a longer animation done with a Mocap suit I assume like for example when one enters the space the NPC can give a quick 30 sec speech intro etc with set animations imported in from Blender via rigging.