Vive Facial Tracker showcase in Neos VR
Вставка
- Опубліковано 9 бер 2021
- Neos VR has a full native support for the new Vive Facial Tracker, giving any avatar huge level of natural expressiveness and ability to script behaviors on top.
Showcased avatars by:
GearBell: / gearbell
Rezillo Ryker: gumroad.com/rezilloryker
Find Neos VR on:
Steam: store.steampowered.com/app/74...
Discord: / discord
Patreon: / neosvr
Twitch: / neosvr
Twitter: twittter.com/frooxius
#NeosVR #HTCVive #socialVR #metaverse - Ігри
If you'd like to know how to import/setup your avatar for the Vive Facial Tracker and even how to script custom behaviors showcased here, I've put up a tutorial here: ua-cam.com/video/OHyl90_X9SQ/v-deo.html
I love how when you get sad the ears in the fox drop, that's so cute :)
This makes me want to invest in VR. Looks like fun.
absolutely mindblowing what vr has come to. insane work
yea furrys with Facial Trackers is what vr has come to xD
Wow, looks really good with the Rexouium and Canis avatars!
1:26 honestly adorable
Impressive technology. Surprised by how well it tracks.
Lets Go, For Next Level VR!
This is so cool! The days of crutches such as emoticons and smilies to convey human emotion on the Internet are numbered :D
currently waiting for my facial tracker & Tundra trackers :)
Frooxius sir you do great work, keep it up.
Holy crap... Techlinked showed this?! We're really moving up!
absolutely, we all the neos family are just skyrocketing lately x3
Epic!
They should make it so you can plug it into the charger socket on any headset
Would be awesome for Quest 2 but I think Oculus could do it much smaller and cheaper.
Because of Facial Tracking Data to suck up into their system.
@@phibelus you can use this on your Quest 2.
amazing work
wow thats awesome
Anyone else from the latest Tech Quickie video?
This is honestly amazing
Amazing!
SO cool!
thanks I love it
Amazing
Makes me wonder with things like Microsoft Mesh that allow volumetric video of the real you to be in social VR apps, will the level of realism ultimately change the social dynamics of VR? No avatars. What does social VR look like in 10 years? Platforms that embrace all types (real video and avatars) or will most platforms divide into Real holograms and/or avatars for some - while others will strictly be avatars?
fantastic, i seriously cannot wait for the facial tracker to come out, i am so excited about them.
btw does anyone know whta the soundtrack name is called? i have been on the search of it for 2 years or so ^^
Hi, so, the Vive Facial Tracker connects to the VR headset through a standard USB-C connection, right? Does that mean it could work with the Valve Index for example if you use a USB-A to C adapter? I know it's officially only supports the Vive Pro, but has anybody tried it with other headsets or are there some other technical incompatibilities i didn't account for?
please show one where you're talking on human rig. The Froox lips move weird when talking. ;)
Got more videos coming soon!
@@Frooxius is the face tracker for sale yet?
@@ShhheilaASMR Yes you can get it here: www.vive.com/eu/accessory/facial-tracker/
So cool
thats cool but they need a sensor inside the headset to track the eyes blinking as well now lol
there's a version of the vive pro with eye tracking
@@Danman350 Oh nice! I did not know that
I'm using the HTC Vive Pro Eye headset, which tracks my eye movements (including pupil dilation and closing of eyes) as well.
It's planned that the Decagear headset will have basic eye and lower face tracking integrated although it'll likely only support finite facial 'gestures'/visemes whereas this seems to much higher definition.
Goooooooood!!
nice
i wish i could do this with oculus lol
This is sooo cool!
Whooooa.
Do you happen to have an Index and the ability to confirm if it works via software? Considering getting one if it does work and all I have to do is create a new bracket to attach to my Index.
Other youtubers have confirmed it does work with other headsets
@@whiteoutwolf6131 Thanks for the info! Been trying to find a straight answer for a while now but not much luck. Definitely going to be getting one then. Just gotta figure out how to mount it to an Index. Lol.
the big question is does it work for the Cosmos Elite
How is the lip tracker if you have facial hair?
Is this fully compatible with Neos VR? Is there a tutorial on how to rig our own characters to use in Neos?
I don't know about facial hair. The developer kits had a bit trouble when someone had a big beard, but that's all I know, we'll have to wait for people with different facial hair to try it out.
Yes it's fully compatible with Neos VR, you get access to all the data, both for (semi)automatic mapping to the avatar expressions and with our in-game visual scripting language to build custom behavior.
I will be showing off tutorial on how to set things up soon, I'll post the video on my channel once it's ready.
Curious. Have you tried this on any headset other than the vive series. Many including myself want to know if we can attach this to headsets like the Index, or the oculus ;)
Yes I want to know this aswell if possible to use a usb c to usb A adapter on the index and it just working or if htc got software limitations on it 🤔
I haven't tried that sorry. Mounting would require a custom one though. It plugs using USB C though, so you can connect it directly to USB on your computer instead of the port in the headset if you need.
It works on cosmos aswell just the holder doesn't fit quite right so need to 3d print a holder
Hopefully Vive pays you well for ads like this..you deserve it guys.
This is not sponsored content (it would've been marked as such if it was), we have only gotten early access to the hardware for integration and content production.
It's a showcase of what you can do with the tech in Neos VR.
@@Frooxius Ah. Ok. Thank you for sharing this.
hm i wonder how well it works for people whit lip pircings
Cute fox :)
To anyone wondering if this works with any other headset, yes it does. Other youtubers have confirmed that it works with most other headsets, not sure which ones but the Index is one of them.
can i also use it with the valve index or is it only compatible with the HTC ?
Yes it is compatible with most VR headsets :)
I want a headset with this tech naturally inside it
decagear headset
@@anthonygrant-cook5312 I know that is a thing
@@anthonygrant-cook5312 but is it a mobile vr headset just by it self?
@@Projekt_Nightmare no, it as PCVR headset, which however is capable of being used wirelessly with a pc. If you want a standalone headset with facial tracking, you have to wait for the next quests (either quest 3 or 4). Zuck recently said he is working and really wants facial tracking in the near future
@@TZeyTimo alright.
When they are going to finally make something like SAO with a headset which puts you into the game moving on your own but inactive in real! :D Now that is a challenge...
Can you do a human character talking video like when you showed lip tracker first time with the bald character?
Do you now have physics in Neos?
I've got a video coming with a more human characters. They took some time to setup so I didn't have many for this one.
We don't have full physics yet, but it's on the roadmap. Our current focus is on the desktop mode.
Not sure if you've used unreal engines meta humans plug-in. Would love to see a tutorial of lip tracker and eye tracker bring used on those characters in real time.
Just a matter of time :)
yep its gettin there
I would just tell my friends some corny jokes and see if they smile or not
How does this video only have 77 comments?
sweet but does it work in vrchat
You'll have to check their documentation on that, I'm not affiliated with them, so I can't speak on behalf of their platform.
Nope, not at the moment. Only in Neos at the moment.
How is this performance wise? Is it really cpu heavy?
I didn't notice any performance degradation on my end, it's usually pretty good with low latency.
@@Frooxius could you check the usage? On vs off I'm trying to convince developers to implement it into their games but they fear is performance heavy for 10+ people
@@tehgusbus2716 they only need to worry about one, because you can just send the results over the network. (as neos does IIRC)
Next time you do this, you may want to angle the real world camera so that we can see your mouth moving more. The tracking module was blocking our view for most of the footage.
I must go now; my people need me!
Shut up and take my money
Will the face tracker work with an Index headset?
Nice emphasis on furry avatars btw :p
I do wonder, the mounting can be swapped out, as its a screw holding it. It has usb and the software should work independently as far as I heard... sooo. We only need a mount system for the index frunk.
@@Frontline38 Hopefully people on thingiverse can fix that if there isn't anything official :3 I wondered when the "frunk" might come into play.
What is this game
It's Neos VR as the title says. You can find more info in the description.
Making people with social anxiety... more...social... how bizarre
I wonder if he's ever been outside
Outside... Is that world I can visit in VR? :D
They're marketing to furries lol.
The tech involved here is amazing, but wtf those weirdos
your mic sux a bit.
furrys everywhere
Doesn't seem to work very well when speaking. Seems it can't keep up at all.
The speaking is driven primarily from voice analysis. The video was manually synced with the real world footage, so the audio is a bit ahead that way.
When other players see you, they receive the voice data with already performed analysis, so the latency gets erased. It's only perceivable to you when you talk.
@@Frooxius It looked like the lips never closed up at any point.
Ofcourse a furry is showcasing this.
There were no NORMAL models? Why some very poor quality fury?
IDK if you can talk about the unit much but how does it connect to the HTC Headset? I see a cable running from the front to the back, does it plug in via USB? Is this something I can 3d print an adaptor for my index or it is HTC preparatory?
I remember during one of the creator jams you popped in and spawned a giant bald head behind the mountain and pretended like you were going to eat the world. I would like to do something like that with the new furby-like creepy toy I have been working on in neos lol