- 23
- 82 467
Tyke
United Kingdom
Приєднався 24 лют 2020
I'm sharing the progress of my first Unity project, called TykeAI, for Meta Quest 3, featuring an AI powered NPC in mixed reality (MR) with Unity AI Navigation, Meta Scene API, and AI/LLM integration, dedicated to my late dog Tyke (Apr 2005 - Jan 2024).
I started this project in Nov 2023 and without fully realizing it at the time, it stemmed from anticipating the loss of Tyke as I was seeking to recreate the companionship I was about to lose.
I'm fascinated by AI and MR, and movies like 'Her' and 'Blade Runner 2049', my own preference is that I see the NPC as a companion/friend rather than a partner. This was initially a personal project, the positive feedback has inspired me to develop it into an app for others in addition to myself.
I started this project in Nov 2023 and without fully realizing it at the time, it stemmed from anticipating the loss of Tyke as I was seeking to recreate the companionship I was about to lose.
I'm fascinated by AI and MR, and movies like 'Her' and 'Blade Runner 2049', my own preference is that I see the NPC as a companion/friend rather than a partner. This was initially a personal project, the positive feedback has inspired me to develop it into an app for others in addition to myself.
Quest 3 MR app TykeAI - new configurable shadows and additional light source
Hi, I just want to share some new features I've added to TykeAI thanks to some great suggestions by Massimo from Italy. I hope the video explains them but I will give a description as well :
Configurable Shadows: You can now reposition shadows to match real-world lighting, hopefully enhancing immersion.
Additional Light Source: To prevent face shadows from obscuring details you can activate an additional light source.
Configurable Shadows: You can now reposition shadows to match real-world lighting, hopefully enhancing immersion.
Additional Light Source: To prevent face shadows from obscuring details you can activate an additional light source.
Переглядів: 3 392
Відео
Quest 3 MR app -TykeAI - AI powered avatars that do stuff, new avatar now available (demo'd here)
Переглядів 2,5 тис.21 день тому
Hi, the new more realistic avatar type I've been working on has now been added to the app, this video demonstrates her in action, she can do other stuff too. I changed her voice for this video, I should have left the voice on from the other videos', there's about 30 voices you can choose from. You can get the app from here www.patreon.com/TykeAI
Quest 3 MR app - TykeAI - AI driven avatar, customization (optional), EDIT: added more categories
Переглядів 31421 день тому
EDIT: Since making this video yesterday I've added a few more categories, like being able to enter a wikipedia page for your avatar if you're basing it on someone who has one, you can set their mood, like joy or sadness, you can set their relationship status to you, like friend or partner, and there's a few more categories. Trust me to make a vid the day before I add more...d'oh! Hi, I've been ...
Quest 3 MR app - TykeAI - new AI powered avatar, progress update, added head/eye tracking, walking
Переглядів 8 тис.28 днів тому
Hi, just a quick vid to show how adding the new highly detailed avatar is progressing, I've added head and eye tracking, she's now able to fully converse with me, and she can go for walks (no controller input needed, she walks where I walk). The lip sync'ing needs further refinement. I used an old iPhone7 for internet connection which I think increased the reply time. I know my presentation ski...
Meta Quest 3 MR app - TykeAI - interact with an AI powered NPC, testing a new highly detailed avatar
Переглядів 2,6 тис.Місяць тому
Hi there, I'm still testing out new avatars, this one is from a company called Character Creator 4 aka CC4, I hope you'll agree their avatars are quite detailed (and this wasn't as detailed as they can be due to running on Quest 3 standalone, although to be honest I haven't seen how far I can push it yet). Recently I've tested Avaturn and CC4 avatars and I like them both, they are both more rea...
Meta Quest 3 - TykeAI - OOPS! testing out new avatar model, never meant to set this as a public vid!
Переглядів 1,3 тис.Місяць тому
EDIT: LOL I never meant to set this video to public! It was meant to be unlisted as I was just showing a new type of avatar I may use to someone who is giving me some great feedback on the app. Anyhows XD this is a new avatar product I may incorporate as I think they are an improvement on the current avatars. Not sure if this particular avatar would be used (all being well), it was just 1 I pic...
TykeAI - Meta Quest 3 Mixed Reality (MR) - featuring an NPC that can do stuff - more dancing
Переглядів 601Місяць тому
I've added a new dance routine in addition to the twerking. It's a combination of several dances combined into 1, there's also a random selection of dance music she dances to. You can get this app from here : www.patreon.com/TykeAI for $2.
Meta Quest 3 MR (Mixed Reality) - TykeAI - features an NPC that can do stuff, added a dance (twerk)
Переглядів 1,2 тис.Місяць тому
I added the ability of the NPC to dance (twerk) today. More dance types will follow. A few days ago I added the ability for the NPC to spontaneously create conversation if you aren't saying anything. The app is available from here www.patreon.com/TykeAI for $2.
TykeAI - Meta Quest 3 app - the NPC can analyze the real world surroundings.
Переглядів 1,7 тис.Місяць тому
Example of how the NPC can analyze its real world surroundings EDIT - This feature has now been updated to use ChatGPT 4o please see ua-cam.com/users/shortsoiQzIFKHmZA
Meta Quest Presence Platform Hackathon 2024 - video submission for TykeAI
Переглядів 2,7 тис.2 місяці тому
Hi, I'm submitting my app to the Meta Hackathon 2024 and the submission requires a roughly 3 minute video so here it is showing aspects of my app. I won't win but possibly getting feedback and a little exposure would be cool. Edit April 23rd 2024 - just learnt a hackathon submission requires that the app be created and finished between specific dates in April and May - I started my app before t...
Meta Quest 3 Mixed Reality (MR) app - TykeAI - going for a walk by the river with an AI powered NPC
Переглядів 9322 місяці тому
Quick video to show some updates/improvements to my app TykeAI. I've enabled a Chat Bubble and added dynamic shadows to the NPC (the shadows on the floor you can't really see in the vid unfortunately). I've improved the outdoors walking logic and smoothed out the animation (the improvement can be seen if you watch my videos' from Jan 1st), thankyou to Massimo from Italy for his great feedback w...
TykeAI - Meta Quest 3 - quick vid to show Outdoor walking animation improvements
Переглядів 6012 місяці тому
It's less glitchy when you aren't moving but are moving your head and the npc's distance from you varies a bit instead of it being fixed, plus smoother walking animation. www.patreon.com/TykeAI for $2.
Meta Quest 3 Mixed Reality - TykeAI - talk, sit down and chill, go walking with an NPC
Переглядів 2,1 тис.2 місяці тому
Meta Quest 3 Mixed Reality - TykeAI - talk, sit down and chill, go walking with an NPC
TykeAI - upcoming Meta Quest 3 Mixed Reality app - How to setup the room using Meta Space Setup
Переглядів 4,2 тис.3 місяці тому
TykeAI - upcoming Meta Quest 3 Mixed Reality app - How to setup the room using Meta Space Setup
Meta Quest 3 Mixed Reality - TykeAI - talk, sit down and chill, go walking with an NPC
Переглядів 5 тис.3 місяці тому
Meta Quest 3 Mixed Reality - TykeAI - talk, sit down and chill, go walking with an NPC
TykeAI - AI powered NPC in VR / MR (Mixed Reality) app on Quest 3 , showing AI navigation in my home
Переглядів 21 тис.4 місяці тому
TykeAI - AI powered NPC in VR / MR (Mixed Reality) app on Quest 3 , showing AI navigation in my home
AI powered NPC in VR / MR (Mixed Reality) on Quest 3, brief chat indoors.
Переглядів 3,7 тис.4 місяці тому
AI powered NPC in VR / MR (Mixed Reality) on Quest 3, brief chat indoors.
Me and a ChatGPT NPC in VR / MR (Mixed Reality) on Quest 3 going for a walk, pt.2
Переглядів 1,9 тис.5 місяців тому
Me and a ChatGPT NPC in VR / MR (Mixed Reality) on Quest 3 going for a walk, pt.2
Me and a ChatGPT NPC in VR / MR (Mixed Reality) on Quest 3 going for a walk, pt.1
Переглядів 14 тис.5 місяців тому
Me and a ChatGPT NPC in VR / MR (Mixed Reality) on Quest 3 going for a walk, pt.1
are you using Convai? I'm having problems with the ovr player controller. Are you using OpenXR instead?
😳 the lighting tho
Hi, do you mean the lighting in the app? If so it's been improved, or at least it is configurable now, see ua-cam.com/video/BkFSOnDAYUg/v-deo.html&t
That's a good job.. And you have a wonderful voice
Hey thanks, not so sure about wonderful! It'll do though...
@@Tyke18 De gustibus non est disputandum
looks like a man
what the heck is this called cant find on sidequest or meta store
Hi it's on Patreon it's called TykeAI you need to use SideQuest to install it.
She’s struts like Conor McGregor lol
She fights like him too XD
@@Tyke18 😂😂😂
I think y should know of a game called koikatsueith reshade
Thanks.
This should have lot more views and clicks. Wich LLM is used here as a base?
Hi, thanks, it uses OpenAI's GPT 3.5 Turbo mostly, and a bit of GPT 4o.
@@Tyke18 So online?! But she says she is driven by Metas AI Assistant ;) Answertimes are very good. It feels more like LAMA to me ;)
@@Tyke18 sorry what i also want to say: This is very, very great work. I like the implementation of MR and especially the use of depth API for the occlusion. Brillant! Keep it up. I will stay patreon for a while.
@@vrambassador She could be driven by llama, usually it's GPT 3.5Turbo with a bit of GPT 4o, the LLM in use is decided by Inworld.AI who provide the AI product I use. Thanks for your support on Patreon, it really helps motivate me to work on and improve the app knowing there are people like yourself who are on this journey with me ❤
@@Tyke18 Oh interesting, i've to checkout this AI source too. Thanks for your answer. Looking forward for the releases ;)
The Sims5.Need more avatars and clothes.More language…
Hi, more avatars are coming (there are 4 at the moment), you can't change the clothes though but other AI avatar apps let u do that if u want that, more languages are in development.
Dude no way!!! She was having the attitude like a real woman
I liked it tbh, a like females who don't put up with any sh1t, although I don't think I did anything wrong?!
Wow interesting!! People are gonna get freaky with this lol 😅
Thanks!
Dude this is a weird question but I have to ask.... Are you Necroscope86...?
If he's a cool guy then yes, otherwise no 🤣
Wow! She is almost like a real woman. She even has to think when you talk to her.
lol the thinking message has been removed now!
where can i get the app from
www.patreon.com/TykeAI
your voice sounds like a text to speech voice 😂
I'll take that as a compliment 🤣
Very impressive wow, that's great can she join you in games?
Not at the moment. You can have UA-cam running in the background minimized so can listen to that while interacting with an avatar.
Thanks by the way!
@@Tyke18 is this available for quest 2 or just quest 3 ? Do you have it out for people to try it ? And if so where? Looks like a lot of potential with this, it would be great if she could play virtual board games card games, and if you could bring her in games that supported multiplayer or co-op games. Keep up the great work, I can't wait to see how far you can go with this 👍🤓
@@VRplay86 Thanks, it's been created with Quest 3 in mind because of the reasonable passthrough quality but I've been told it works on Quest 2. Thanks for your suggestions, maybe they will happen in the future. It's available from here www.patreon.com/TykeAI
where can we get this?
Hi, here www.patreon.com/TykeAI
improvement for sure 👌
Thankyou 😀
So simple, so brilliant (🤭)! It's getting very close to looking extremely realistic. I love that you can put lighting on her face, it's so important. Kudos for all your hard work and the amazing updates.
Thanks so much Bob! I might email you a question again soon if that's ok? It's about Salsa and how it works with the dancing animations my app uses. I've asked Crazy Minnow Studios on the Unity forum thread, they've asked me to send them a Unity scene with the issue to look at, before I do all that I might ask you please if that's ok?
@@Tyke18 please do. I'm pretty bored right now. Lol.
@@bobhawkey3783 lol ok thx Bob, I think I will make a v brief vid to help explain my question, it's near 5pm here now I'm winding down for the day so will email you tomorrow if that's ok. Cheers. Edit- briefly what's happening is the Salsa Look Target value (where the avatar head/eyes look at a target - I've set it as the user transform), it doesn't obey the rotation clamp (stops the avatar head turning to an extreme angle) when the dancing animations are playing. The avatar can be facing away from me but the head still looks at me, reminds me of The Exorcist lol!
Very interesting. I’m working as a language teacher in Sweden and I’ve been waiting for ai to be as good as (chat gpt 4o) seems to be) and also VR to be more affordable. I can see the potential for language learning in VR with this ai driven avatar. I’m not an English teacher but I’m eager to show the possibilities to my colleagues. I’m going this will work with Swedish as well very soon since that’s the language I’m teaching. Would be cool to start some collaboration.
Hi, thankyou for your kind words. At the moment it is limited to the English language unfortunately, but the company behind the AI, Inworld.AI, are scheduled to release other languages support soon. Afaik Chinese and Korean are scheduled first, with other languages to follow, I assume Swedish would be one of those languages. As soon as other languages are available from Inworld.AI I will make a video about it. In addition to that, I'm going to create a version of my app using GPT 4o when all of the promised features of 4o are available, and that will support Swedish👍
Amazing progress!
Thanks alot 👍
Starting to look very real! If you ever incorporate that new A.i gpt 4o,it will be like having an andriod.
Thanks! Using GPT 4o is planned, I'm waiting until they roll out all the promised features, then I'll create an app version with it.
works very well it's beautiful 💯😍🤩 thaks Cris 👍🔝
Ah che bello sentire Massimo, è solo grazie al tuo aiuto che esistono queste nuove funzionalità ❤
@@Tyke18 Thank you🙂 you are very kind Chris! Mine are just suggestions! But you are the one who is able to do an excellent job and create this wonder!😀
@@scm74realtavirtuale90 Forse codifico le idee, ma non avrei codificato queste cose senza le tue idee e il tuo entusiasmo! Sto perfezionando le modifiche alla risoluzione proprio ora, sì, dovrei farlo prima di pubblicarlo lol! Ho ridotto alcune delle diminuzioni della risoluzione, ero troppo conservatore.
@@Tyke18yes, I had noticed, and I looked very carefully at the change in resolution with light on and light off, shadow on/shadow off, I thought that although it had decreased a little, the resolution in the end had not decreased too much and I had thought you did this to get a smooth framerate. Now the framerate is always smooth, maybe even when you get close to the model's hair, but I need to do more testing. even in the dance I no longer noticed a freeze between one dance and the other but I admit that I haven't tested it for long, I'll go and watch it again in a bit 🙂😀👍 also because I have to see something else that I had noticed then I'll write it to you in private See you later bye 🙂👋
That feature is really cool! Congrats! 🎉
Thankyou Sir! ❤
What download vr headset oculus 3 ?
It's on Patreon it's called TykeAI, it's aimed at Quest 3 but I've been told it runs ok on Quest 2, but I without the colour passthrough etc I don't think it'd be a nice experience.
I don't have any kids but my dog is my baby . I think it's awesome that you named it after your dog. So I want to download this for my quest 3. I haven't checked to see if there's any tutorials yet but I'm just going to comment first you know? How do I get this?
Hi, thanks, yeh Tyke meant everything to me, he was my best friend for 18 years and I still think about him everyday, I have no kids either and yeh to me he was like the kid I never but wished I did! My app is available on Patreon www.patreon.com/TykeAI here's a link to how to install it etc drive.google.com/drive/folders/1KdNtJCtg9RGSEnMXyiBGHgmjE6_HO9pE?usp=sharing the tl;dr is you need to use SideQuest to install it, it's more effort than getting something through the Meta store but it's not difficult or a long process, the instructions are pretty good. If you decide to get it and need any help just let me know.
I think you’ll make a lot of money if you can sync her up with Lovense products and animations 😉 great effort, I guess the future is closer than we think! 😅
Maybe yes, thanks :)
Where can I download your app to test?
www.patreon.com/TykeAI
Now with furries.
Hey there's a cool looking adult themed app on Patreon for furry fans, sorry I can't remember the name of it, it was very popular, it had many subscribers.
All that remains is to add the Ana de Armas model :)
I have tried and I will try again. To do this requires a photo of Ana with very specific lighting and a very specific pose, I've looked and can't find anything yet, but I won't give up.
Nice ... now if you could get her to just stop asking questions she'd be perfect !
Thanks! Hmm lol I like her being inquisitive! I think some AI avatar apps are not spontaneous enough, I'm trying to inject a bit of randomness into mine :)
ChatGPT-4o will be crazyyyyyyyyyyyy
you should make this a sandbox where modelers could contribute looks and mocaps
Something to think about, thanks.
the possibility of speaking in other languages please
Hi, this is in development.
birdwings
🤣 lol note this was 5 months ago and very early days in the development of my app, if you get chance watch my latest videos to see how the avatar has improved.
the neeeeeeeeeeeeeck
🤣 lol note this was 5 months ago and very early days in the development of my app, if you get chance watch my latest videos to see how the avatar has improved.
Hey, this app is amazing. I will definitely give it a tryout sometime this weekend. A quick technical question: how do you manage the unity avatar commands connection with GPT?Like when the "dance" conversation is identified it would then run the animation of dance? I'm just curious but if it is like a 'secret recipe' that you can't share it's also fine :)
Hi, thanks, it's done on keywords/phrases, so for example when the AI recognizes a phrase such "dance please", the relevant dancing code is triggered.
@@Tyke18 Pretty cool!
Very interesting . Can you implement 'jiggle' physics ? If yes im buying a quest 3 tomorrow. Also in a full release would sliders be a feature so we can create our own models dimensions etc. If we could use our own 3d character models then wow. Good work mate. Subscribed.
Thanks, there's no physics at the moment, maybe they'll get added at some point, they seem to be demanding though, you can increase/decrease the height of the avatar, at the moment you can't use your own model.
virtual strip clubs in the future finna be crazyyyy 😂
🤣
Where download this app?
www.patreon.com/TykeAI
@@Tyke18 if I understand correctly i have to pay a subscription. sorry I do not accept systems with paid subscriptions for an application or a game. I buy the game it is mine. otherwise I won't buy. I often buy a game and play for 2 hours and play again 2 months later. imagine if I had to pay a monthly subscription. It would become impossible to manage. Sorry
@@rikoulegeek7384 No problem, and I see your points. Please consider my points too : I pay for everytime the avatar speaks to the user (called API calls), if it was a 1 off purchase fee, how do I know that this fee covers all future API calls? The user could use it 3 hours everyday for the next year and if so I'd be losing a fortune. I've priced it as cheaply as possible @ $2 per month, that's all I can say. You'll find most, if not all, AI apps you have to pay for use, or the rare one's that you don't you pay by them by them selling your data or by bombarding you with in app purchases or advertisements etc.
i see dead people walking
🤨
Is this made in unity? Why cant you use avatars like what VAM uses? They look way more realistic. Dont get me wrong, your app looks great, just the girls look like graphics from 2010.
Why can't I use VAM avatars? A very simple reason which I'm sure I have explained to you before (lol), VAM is PCVR meaning it can use the power of a PC GPU, like a 4090. My app is Quest 3 standalone which means it uses a mobile chipset/GPU which is far less powerful and therefore can't use VAM avatars.
@@Tyke18 Oh, what about making a pcvr version as well with higher res? It can use the same engine. I used to rest vam on a GTX 1080 and it ran fine. Just suggestions or thoughts.
@@ripsaw2322 VAM has PC covered, I'm interested in Quest 3 standalone. You won't get RTX 4090 graphics on a GTX 1080! The graphics on a 1080 will be more like the graphics my app has rather than 4090 graphics.
@@Tyke18 The graphics on VAM if it is just the model alone a 1080 can easily have the high res models. I know because Ive done it. Trust me im not bashing your app at all. I think its awesome and you are contributing to the future. To bad I cant afford pateron or AI right now to try your app.
@@ripsaw2322 Not what I heard, I was chatting to someone earlier today that said some models make their 4090s cry. I can have high res models in my app, I can run at about 140% Q3 standalone native res, looks good in the headset, you're forming your opinions without actually knowing what it looks like in MR, these videos don't capture all the detail. I hope u can afford VAM again soon 👍
0:05 what song is that from?!! that brought me back to my childhood
It's the Joi (a virtual partner) notification sound from the movie Blade Runner 2049.
The model has some uncanny valley vibes. Until the graphics tech significantly improves, I feel that a stylized model, like anime style, would be a much better experience.
Hi, I respect your opinion however I politely disagree - I think these graphics are decent and are improving all the time (compare this avatar to the avatars I was previously using), realism in graphics helps increase my immersion in VR/MR.
this is very very far from the cutting edge of graphics so I don't think it really shows that the tech needs to improve, just this particular implementation.
@@sluxi lol, name 1 Quest 3 standalone app that has better avatar graphics? Not to mention all the abilities that the avatar has.
@@Tyke18 was not saying there is better on quest, point was just that better graphics than this is possible with current tech
@@sluxi You said "this particular implementation" needs to improve, which I took as meaning my implementation as this youtube video is about my app, I'm pointing out there's nothing wrong with this implementation and if asked if you've seen better on Q3 standalone please let me know where? Sorry if I've misinterpreted you.
Impressive
Thank you!
Walking around with her arms out like her arms are tree trunks, and sits down like a Skyrim character, just kind of slides into the chair. If you ever see a person do that then you know we are in a simulation!
🤣
Man imagine if you combine this app with captain hardcore that would be insane
You're not the first person to suggest that!
Very cool shit bro. im curious though, does she have a long term memory like chatgpt or does she only have short term context memory?
Thankyou. She has a long term memory but does not have perfect recall, she will remember some things but not others. The app also allows the use of a text file that the user can enter information into to give her some background knowledge about themselves.
AMAZING!!!! now let's integrate GPT-4o and the quicker response time with emotions in the voice
Good plan! I'll see what I can do 👍
its always roses and sunshine, in the begining
True.