TykeAI - Meta Quest 3 app - the NPC can analyze the real world surroundings.
Вставка
- Опубліковано 12 кві 2024
- Example of how the NPC can analyze its real world surroundings
EDIT - This feature has now been updated to use ChatGPT 4o please see • Quest 3 MR app - TykeA... - Ігри
Seriously impressive. Give it six months and she'll be developing the app for you. Kudos, sir.
Thanks! I kinda hope not and hope so at the same time XD
I have to say I love text overlay! And the dark colors highlighting the text along with the thinking animation. Might I suggest a better standing position to indicate “thinking?” Maybe a slight stance to a side with a hand on hip and hand on chin? Could add some extra flair!
Great ideas! Thankyou : )
@@Tyke18 Do you have a discord? I’d love to help brainstorm!
@@VRRat Yep, discord.gg/QbfKjtJv7Q
This is big you created something wonderful so many uses.
Thanks very much! I hope so...
Very impressive technology altogether, but when I see the "NPC" I can't stop thinking of Second Life :-)
Thankyou! NPC, she, her, AI companion, etc, all interchangeable 👍
i love this shit it would be cool if she could find things to interract with in the back ground like if she sees a dog shed pet it and maybe she observes the background without you asking
That would be really cool I agree yes, maybe it will happen eventually :)
molto bello! è davvero incredibile che lei possa vedere! ottimo lavoro!👍🤙
Grazie Signore! Sì, anche a me piace molto questa funzionalità, sogno il giorno in cui potrà vedere immagini in movimento in tempo reale, come poter guardare lo sport o la TV, ecc.
This looks impressive! Keep up the good work! Nevertheless, I wonder how can you access the Quest 3 cameras if Meta does not give access to them due to privacy reasons?
Ah, there is a workaround, my app simply processes an image from the images folder of the Quest 3. So the user must 1st take an image - which is easy and quickly done with the correct button press - then the NPC is asked to analyze the image, and it is this just taken image that is analyzed.
Do you host your own ai model or is this more of a front end using an API from another multimodel ai? if so which services do you guys use?
Hi, I'm using Inworld.AI for the NPC conversation etc, they use several LLM's, and use ChatGPT4 Vision for the image processing.
Is it full-standalone or does it fetch data from your pc or some online API? Amazing work btw, looking forward to it.
Hi, thankyou, it's completely standalone (no pc required). It does need internet connection as it uses AI API's on servers.
Will it be possible to talk also with other languages or will it work only using English?
Hi, at the moment only English but other languages are due to be rolled out soon, starting with Chinese and Korean, then other languages will follow.
Wow that's very neat
Thankyou :)
The artificial intelligence model you use keeps the chat history of each user and you can read it. You need to make this clear to those using the application.
This is all clearly set out in the apps Privacy Policy on TykeAI's website tykeai.com/ which was published last February (before the app was released). Messages can be collected as they may be used to train the AI model but they cannot be associated to a user as no names are collected, only a session ID (which consists of letters and numbers and is anonymous). So in summary, I can't see anyones names, I can't see the IP addresses, I can see a message and a session ID. Thanks for your concern.
Interesting, GPT4 or local VLM?
Thanks, ChatGPT4 Vision.
Will be possible to a acquire the app when it be finished?
Hi, the app can obtained from here www.patreon.com/TykeAI thanks for your interest 👍
@@Tyke18 Thanks but i mean acquire the app in a single paynent whatever the price is and not being a patreon.
@@antoncv1050 Not at the moment (I prefer 1 time purchases too). I chose Patreon with its monthly sub because I pay for the AI services the app uses monthly. I didn't want a situation where a single payment didn't cover the ongoing monthly payments I have to pay if someone uses the app over a longer timeframe. I'm not really interested in making lots from it, I'll be happy if my costs are covered. I've already given April for free to subscribers who subscribed in March, and will give free months again in the future if my costs are covered.