Location-aware AI characters in Augmented Reality (AR) | Convai Unity Tutorial
Вставка
- Опубліковано 14 тра 2024
- Learn how to integrate Convai-powered AI NPCs for an immersive augmented reality (AR) experience! Our step-by-step guide will show you how to bring your characters to life with natural conversations and interactions. AI NPCs in an Augmented Reality app can be connected with real-world location-aware knowledge, AR games and so much more.
Use it for augmented reality(AR), mixed reality(MR), or any XR projects. Should work for Android-based setups (e.g. android phones, Meta Quest 3, or any Android XR devices), and iOS/Vision Pro coming soon!
Convai plugin for Unity: docs.convai.com/api-docs/plug...
Convai AR Documentation: docs.convai.com/api-docs/plug...
Unity Pathway Project: learn.unity.com/project/creat...
Subscribe for upcoming demos and tutorials, and join our Discord channel for support. / discord
Sign up at convai.com to try it out.
Write to us at support@convai.com for any queries, bug reports, collab, or business-related engagement.
Chapters:
0:00 Intro
0:33 Getting Started with Convai for Unity AR
1:05 Automatic Set-Up for Convai AR
3:15 Build AR Project with Automatic Set-Up
3:52 Manual Set-Up for Convai AR
7:03 Build AR Project with Manual Set-Up
7:29 Outro
Follow us on your favorite platforms to stay in touch:
Discord: / discord
LinkedIn: / convaitech
Reddit: / convai
Twitter: / convaitech
Instagram: / conv.ai
Facebook: / convaiofficial
TikTok: / conv.ai
ArtStation: www.artstation.com/convai - Ігри
Oh hell yes!!! Well done my friends!! I cannot wait to test this!!
Wow, this is exactly what I needed!
Glad it helped! Feel free to join the discord channel in description for any help. :)
Really Cool !
ty for the video 🥰🥰, but can u make a tutorial about how to make my character that i created using blender to do this ?
Is there anyway to use this feature with the WebGL SDK?
Hi, the base avatar works fine. But how do I change the Amy avatar with another CC4 character? When I imported an FBX clothed character of another avatar , the mesh loads but its just in a static T-Pose and cannot talk. Could you help on this?
amazing!! wish it was on unreal
Here's a tutorial for doing in in Unreal Engine for VR - ua-cam.com/video/HHhkBd6NOlo/v-deo.htmlsi=C2rNfwE_ML1PJ52_ Should give you a path to do it for AR as well. Happy Building! :)
Can you please do it UE?
now make a video to create the app on ios please 🤞I want to do this to be able to see with my apple vision pro and be able to create any character cloning the voice with eleven labs this would be the beginning of something big
Hey there!
It's so great to see your enthusiasm! I have some exciting news to share with you. We've started developing VisionOS and we can't wait to keep you updated on all the latest developments. To stay in the loop, I recommend joining our Discord server and following us for all the latest announcements.
HI there Convai , I tried to build for apple and It seems like impossible ..? is it available to be built on IOS operating system or Not ( regarding the AR package + Convai).
Hello @m7mdrf3t,
We are excited to announce that we will release iOS Support in our next update.
If you need any help, feel free to join our Discord server. We will be happy to help you.
discord.gg/Tm9b3FWFJG
Thanks for response, hope you are doing well ✌️
Will there be an Unreal plugin?
Yes Android is already supported on the Unreal Engine plugin.
Docs: docs.convai.com/api-docs/plugins-and-integrations/unreal-engine/supported-platforms
UE Plugin: www.unrealengine.com/marketplace/en-US/product/convai
Please do an IOS version.
👻: tested this in unity; works pretty well from scratch BUT: the latency is far too long to have a realistic conversation.
How to fix it sir
@@vuquangtruong5950 👻: You have to ask the developer I guess 🙂
Hello,
Please check your internet connection.
Try to use Convai or Azure voices. ElevenLabs sounds may have a little more latency.