Me and a ChatGPT NPC in VR / MR (Mixed Reality) on Quest 3 going for a walk, pt.2
Вставка
- Опубліковано 31 гру 2023
- My first Unity and VR development project which is a work in progress, showcasing the capabilities of Quest 3, like mixed reality, and OpenAI features like image processing and conversation through ChatGPT. This project features an NPC with a memory and autonomous movement, notice there are no Quest 3 boundary warning messages, the play area space has no limitations. I used an old phone for internet connectivity which is slow and kept dropping out. Enjoyed working on this project and will improve it.
Edit: this app is now available for $2 at : / tykeai
This app, called TykeAI, is now available from here : www.patreon.com/TykeAI
Wow! I started for that moment when she had no shadow next to yours. This is very interesting.
Thankyou Fred :) yes the no shadow is a big give away she's not really there!
birdwings
🤣 lol note this was 5 months ago and very early days in the development of my app, if you get chance watch my latest videos to see how the avatar has improved.
that looks great will you public the app on a site like patreon? and will it have nsfw stuff? keep up the great work
Thanks! I'm not sure how i'll enable others to use the app as yet tbh but I very much hope it can be free or atleast very cheap. Right now it uses OpenAI API calls for the AI aspect and these aren't free, I'm trying to workout a way of using them free or as cheaply as possible. I have no plans for NSFW content.
so you were able to enable dynamic occlusion for your real hands which are displayed in front of the avatar, but if you put your hand behind the avatar, it covers the real hand?
also you disabled the borders, but how did you record the video? because I disabled Borders on my Quest 3 and I try to record a video and in the end I only see the VR elements but everything that is filmed by the Quest 3 cameras is not recorded
you need to improve the avatar animations because especially outdoors it seems to have problems
and there is always the problem of giving it dynamic shadows, for example it would have greatly increased the sense of presence if the avatar also had a shadow exactly like yours, it would have felt much more integrated into the real environment
Good recommendations, certainly something to consider, thankyou. I was able to record in mixed reality mode by using the Quest Games Optimizer to remove the boundary.
@@Tyke18 thanks for the information, I'll try to record like this too! I need your invitation to access the discord channel if you have one, or the patreon link as soon as possible, thanks, regards
@@scm74realtavirtuale90 Hi, the discord link is in the channel description, no Patreon link as yet as I haven't published the page but I will do soon. Thanks.
Thats pretty cool... Will it work with quest 2 if its plugged into a PC?
Hi, thx. It's a standalone/native app so no pc required. I haven't created it for the Quest 2 as this uses mixed reality/passthrough which on the Quest 2 is low res and not colour. Afaik though it could be used on it.
Do you get to choose the voice of the ai?
Yes, I have a poll running on my Patreon right now to select the voice.
Do I need a PC to create something like this, is that the only option.
No PC required, it works on the Meta Quest 3 as a standalone app.
oh brilliant what is the name of the app
@@fcukwork there's no name at the moment, i've been naming my Unity / Android builds for it after my dog Tyke :) but right now as an app I don't have a concrete name for it.
I would like to try this?
Hi, it will be available either through App Lab, SideQuest, Patreon, itch.io soon (should be 14th March). I'll upload another vid when it's ready. Thanks for your interest.