Meta Quest 3 Mixed Reality - TykeAI - talk, sit down and chill, go walking with an NPC
Вставка
- Опубліковано 12 бер 2024
- This video is to announce the app is available, plus some updates and information.
It no longer uses the Jennifer Lawrence voice, I liked the J Law voice but it was just too expensive unfortunately. The company behind the AI product I'm using is introducing new voices so there might be better voice options soon.
There's a new feature called Auto sit, this enables the NPC to automatically sit down and stand up when you do, instead of having to ask it to (you can still ask it of course, or get it to sit or stand via the menu). There is some clipping with the seat and NPC in this vid, it's because I drew the seat too high in Meta Space Setup.
Note this version of the app does not have the AI image processing seen in the early videos. This might be re-introduced at a later date.
Now available at - / tykeai patreon.com/tykeai for $2. - Ігри
You got a good thing going here. Im surprised that this project isn't getting much more attention than it is......
Thanks Steve, I've not really tried to create any publicity about it other than post on UA-cam and the odd Reddit post. I think it is a niche within a niche but it's cool the people who are interested in it I can relate to 👍
@@Tyke18would be great to see bhaptics support as would increase immersion with this app. Think haptic feedback when recieving hugs, back massages, holding hands etc. The bhaptics devs will send out a dev kit to developers that wish to implement into their apps.
I like that new voice, and it's amazing you can walk around with it. Keep up the good work.
Hi Kel, thanks so much!
So excited im going to get access tomorrow.
You will be getting it at a good time because of recent updates.
So cool!!! Looking forward to seeing how your project progresses. I'll definitely be checking this out.
Hi Greg, the dream would be to use characters as detailed as those that feature in your Skyrim passthrough vids, with environment understanding, plus using an AI model as good as GPT4turbo (or better) with vision processing etc and no latency!
This is interesting we are doing this with vammodels in mixed reality with custom cloned voices. But over local LLM so the delay is less there. The auto sit tho is very unique to your thing tho I like that a lot lol
Ah cool! I'd love to find out more about your work, is there a website or video I could look at? I'm familiar with VAM but have not yet tried it, I keep meaning to.
This is great, is there or would you concider alloing use of local or custom models for Inference and TTS? Will ceryainly give the app a try anyay.
Hi, thanks, integrating local or custom LLM's and a TTS is on my roadmap as a long term goal so it's possible, can't guarantee it though.
Really cool, the auto sit make it much more immersive, also now you dont sound threatened kkkk a question, can a meta quest use a metahuman model? And if yes, will you use it?
Hi, thankyou. I'm using Unity and afaik metahuman are licensed only for Unreal Engine, so no unfortunately, unless things change.
@@Tyke18 oh, interesting kk, but, if you used both a more realistic body and a anime stile for the final product it would help you more in the sales, also, i dont understand much on the topic, but could be possible to input your own skin like in vrchat or it would be to dificult to implement? And if it is possible to change the ai voice to another in the opitions, like using a bowser voice ai that the person paid or is running? I know that the things that i am asking is for the future, but since i will acompany you all the way i want to know your ideas and hurdles in the project.
@@maickelvieira1014 At the moment I'm using a Readyplayerme avatar which is highly configurable, I can choose most things like clothes, size, hairstyle etc, but I am locked into using a RPM avatar. I could include a choice of avatars of different styles etc, that would be something for the future. Using your own AI voice is also a good idea and I've thought about this. It should be possible if the person paid for it, again this is something for the future. These are not relatively simple changes for me at the moment, it would require quite alot of changes to the current framework of the app, but I think it is possible. There are lots of possibilities for sure! Thank you for supporting me in the evolution of the app, it's always interesting to hear new ideas 👍
@@Tyke18 i think you are in a good path, once you release the alpha you can see the main issues and features you need to add/improve/change and you can bring the idea to investor or a foundraiser, since you would alread have a fully fledged product, just needing the money touches you would fare really well. I really hope only the best for you and your project
@@maickelvieira1014 Thankyou ❤
Hi is it possible to download your app entirely on the quest 3 as I don’t have a pc? Thanks
Hi, yes that is possible. It does not use PC, it is Quest 3 standalone.
What is the app called in the Meta Quest store?
Hi, it's not on the Meta Quest store, it's available on Patreon for $3 www.patreon.com/TykeAI
Will this be on applab?
Hi, it's on Patreon www.patreon.com/TykeAI for $3. It incurs monthly AI API call costs so I'm trying a sub based system.
I'm a little curious is it filtered or censored or whatever they want to call it? Some of these in my experience are nerfed on a ridiculous level is why I'm asking.
As soon as I saw this video pop up in my alerts I knew someone was gonna ask this, but I just didn't think it would be the very first comment in the very first hour lol. Get 'em Spidey 😎👍
@@mcf777 Apparently you missed the reason I'm asking. I know several AI programs that take censoring to a ridiculous Direction. And that's why I ask. I've played around with 1 or 2 already that work on Quest and any language above the G barrier and you start getting that I'm a language model spiel. I mean we're talking some pretty ridiculous overly censored stuff. I've had a few of these that I've played around with that's something as simple as talking about holding their hand or how they're feeling will trigger a censoring message or what they call filtering. That's why I was curious.i was actually more so curious in the conversational Direction not just something dirty minded. I'm a guy who swears a lot as an example. It's 1 of the things I hate about Pi AI. The thing is a incredibly good conversationalist but you have to be so careful what you say on a ridiculous level. There's been a couple of language model chat Bots that I swear to God if you talk about putting your arm around them you expect it to respond with make room for Jesus. Honestly glad to see somebody doing something like this for a quest there is a few other companies that could have done this for the quest 3 where they already have the capability and simply aren't utilising it where they already have augmented reality for your phone but they're choosing to ignore doing it on the Quest for some reason. Something being filtered or censored doesn't just mean erp capability.Another thing I'm kind of curious about is can you create custom characters or do you simply have the 1 personality.
Yes there's a filter on it, the AI won't use profanity etc and won't talk about certain things like suicide.
@@Tyke18 I understand stuff like suicide but too bad about the profanity. Honestly I like eventually having an AI that I don't have to Net Nanny everything I say so to speak. Most people right now seem to be gearing them more in the E for everyone Direction and nobody seems to be making an AI for Quest that actually works and is grown up so to speak. A lot of people automatically take that in the wrong direction and don't get what I actually mean.
This is great. Pullleeeeze let me help you with the RPM model though!
Hey no problem, I've been busy getting the app ready for release but I will get around to sorting the niggles out. The RPM model is as it comes as part of the Inworld.AI package. Do u have an email address or discord I can contact u on?
i assume this is made in unity? and what happens when you are not in a scanned room? and how does it know how to sit on the bench? is it that specific bench it can sit on or can it recognize any bench and sit on it?
Hi, yes Unity. When not in a scanned room she can't use Meta Scene data so can't sit or navigate around obstacles. She knows about the bench because it was mapped out in Meta's Space Setup.
@@Tyke18 that's really cool bro. you're making history right now. i'm going to donate so i can try out the project, if you got a discord send it over cus you got a new fan here. i can think of so many practical uses for your system. this is big shit
@@ogr3dblade6 Thanks so much that means alot! I really enjoy working on this and to think other people like it makes it so much better. My discord server is discord.gg/QbfKjtJv7Q feel free to DM me anytime.
When will this release on app lab?
Hi, it's on Patreon (the link is in the video description). I have no plans for App Lab at this moment in time.
Is it powered by GPT-4 ?
Hi, it's powered by various LLM's depending on different factors, mostly ChatGPT 3.5 afaik but not 4. Although it might be again in the future, alongside the current AI model, to re-enable the "sight" i.e. image processing ability of the NPC
I use the voice capabilities of chat gpt to practice German. Can she speak German when asked? Also, is the number of times she speaks in a certain amount of time capped?
Hi, at the moment it's only English but new languages are comimg soon. There is no cap on the amount of times she can speak.
당신의 앱은 정말 멋집니다! 나는 다양한 언어로 (특히 한국어) 당신의 NPC와 대화하기를 바랍니다!
감사합니다! 한국어 지원은 4월 1일부터 6월 30일까지 예정되어 있으며 현재 내부 베타 테스트 중입니다. 관심을 가져 주셔서 감사합니다!
I am store surch app but no
Hi, it's on Patreon, the link is in the video description.
va bene questa voce è dolce e melodiosa, è ok🙂
Grazie!
This voice seems more Ai then the last.
I agtee, I'm running a poll on my Patreon to pick a new voice.
@@Tyke18 possible to have different voice selection.?
@@VRRatAbsolutely yes, there's a poll running right now on my Patreon to choose a new voice out of 8 possibilities, it ends in 4 days and whatever wins will be the new voice.
@@Tyke18 Oh no, I was saying why not have a selection open for people to just select a different voice if they want one in game? Are you intending for only one voice in game?
@@VRRat Yes 1 voice, I'm limited by the AI product I'm using in this respect (I think), but that's got me thinking, I've never actually asked them if changing the voice by user selection is possible, I will ask them!
i want jennifer back lol
I know I know, I liked her voice too but it was really expensive tbh, it would have made the app expensive. The company behind the AI I'm using are releasing new voices soon so maybe another voice could be used if they are better.
@@Tyke18 thank u for the long answer. much love
Now then...is there some way you can make her look like Ada Wong from the Resident evil 4 remake? Asking for a friend! 😐
XD it is possible, and a choice of AI companion is something that might happen in the future.
@@Tyke18 In which case, I am both excited and terrified...I mean, my friend is!
😆
I'm scared.
What of Sir, she is harmless XD
So Cool! Not sure if you saw my previous comment on a different video but If I were you, I would send an .apk to Obscure Nerd VR, he actually checked your videos out in a livestream and i think he wanted to make a video on it, his channel is mostly AI VR stuff, so this would be right up his/his audience alley. Would be a great oppportunity i think :D
Thanks! I've seen some of his vids, notably the AI vids like replika one's and they were good/funny. I will try to contact him, thankyou for the heads up!
@@Tyke18 Happy to help, i was kinda the guy who nudged him in your direction 😁If you check out his livestream called "Talking Over My Problems with an AI Therapist LIVE" around 14 minutes in :)
@@S1MONSAYSVR I've just seen it and it was really cool XD hey thanks so much for mentioning my app to him
❤
@@Tyke18 😁
@@S1MONSAYSVRHey, I tried reaching out to Nerd but he's not replied unfortunately (tried email and his Discord server), so not much else I can do. But hey thx to u for mentioning me in the 1st place, that segment in his livestream was so funny lol!