Fluid Reality: High-Resolution, Untethered Haptic Gloves Using Electroosmotic Pump Arrays
Вставка
- Опубліковано 28 жов 2023
- Same tech under touchscreen: • Flat Panel Haptics: Em... (keyboard you can feel!)
Virtual and augmented reality headsets are making significant progress in audio-visual immersion and consumer adoption. However, their haptic immersion remains low, due in part to the limitations of vibrotactile actuators which dominate the AR/VR market. In this work, we present a new approach to create high-resolution shape-changing fingerpad arrays with 20 haptic pixels per square cm. Unlike prior pneumatic approaches, our actuators are low-profile (5mm thick), low-power (approximately 10mW/pixel), and entirely self-contained, with no tubing or wires running to external infrastructure. We show how multiple actuator arrays can be built into a five-finger, 160-actuator haptic glove that is untethered, lightweight (207g, including all drive electronics and battery), and has the potential to reach consumer price points at volume production. We describe the results from a technical performance evaluation and a suite of eight user studies, quantifying the diverse capabilities of our system. This includes recognition of object properties such as complex contact geometry, texture, and compliance, as well as expressive spatiotemporal effects.
Vivian Shen, Tucker Rae-Grant, Joe Mullenbach, Chris Harrison, and Craig Shultz. 2023. Fluid Reality: High-Resolution, Untethered Haptic Gloves using Electroosmotic Pump Arrays. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (UIST '23). Association for Computing Machinery, New York, NY, USA, Article 8, 1-20. doi-org.cmu.idm.oclc.org/10.1... - Наука та технологія
Vrchat will go insane with this 💀
yea especially if you put this in your a-
Don't remind me 💀
Those avatars never stood a chance
@Imafurrynowlol I can hear my gpu softly weeping in the corner just thinking about it 😂
Finally i can interact with female without harrassing them
Mentioning pimply skin casually like that makes me incredibly uncomfortable
Extremely
It’s what’s been missing from the vr experience. Not enough pimples.
pimple popping simulator
👅
Cyber acne physics
Born to late for earthly exploration, born too early for spacial exploration. Born just in time for IRL VR.
There are plenty bases on earth not discovered yet and even if they were discovered that isn't an excuse to not discover it for yourself
Sadly like with every other amazing VR accessories showcased, they will likely not reach commercial markets for a long time if ever.
With full fledged AI interactions to boot.
let's be honest, Space Exploration is lame.
It's cold and empty up there.
@@joz534That's not being honest
I think gloves like these with those gloves that restrict your finger's movement could make grabbing things in VR the ultimate experience, where you can't actually close your hand inside of an object
dont think about it dont think about it dont think about it....
Hypothetically you would just need a cable that goes along the back of your fingers that can lock in place to prevent you from closing your hand more
@@mythman30there is a guy on TikTok who developed exactly this, I don’t know his name tho
@@mythman30There's an open source project of this that was covered by LTT. Having this ( Haptics ) combined with the restriction ( The Open Source Project ) would honestly be a godsend to cheap but performant VR gloves.
One issue I can see happening with that is that people's hands are actually pretty strong. If someone's, for example, swinging an axe in VR, they'll grip it pretty hard and they'll rip apart your mechanism if it can't withstand a few dozen pounds of force per finger at the absolute minimum.
I wonder what it would feel like as a whole suit.
I wouldn't want 200v around my body at all
I'm not wearing them around my groin.
Very very slow.
espiecially for wearing them near the mighty noodle @@bmanpura
@@bmanpurawell, I am. Imagine the sensations! 😂😂😂
Tripped me out to hear the voiceover actor who narrates audit the audit on this video 😂
Yeah he does a couple of other channels as well 😅
I fucking knew I recognized him
fucking knew it !
Could not figure out who it was lol
😮 no way I refuse to believe
Please bring this technology to market. It genuinly sounds amazing!
Anything can sound amazing but all the treadmills and Haptic gloves are trash and will be trash for a very long time with no support even if they make it to market
@@peekayboo7183 have you seen what the imagineering team at disney has been making??? very very cool fucking stuff for the treadmil kind of stuff
Imagine the next generation of fleshlights that'll be using this technology. What a time to be alive!
"Now all we've gotta do is put it into a walking robo dishwasher and boom! We've got ourselfes a life-long, obedient companion. Now give it some AI brains, a shmexy voice, anime-like body, actual reproductory capabilities and... we're back to square one."
*end of flashback*
"I beg you, robo-Karen! I haven't seen the kids in 2 years. I'll never call you a robo dishwasher ever again. I'm a changed man! Listen: your old sack of useless meat has changed!"
"I filed for a restraining order. My manufacturer has always told me she didn't trust you! I should have listened to her and NOT you. Oh yeah, and about Stacy: I saw the way you looked at that fleshy b!tch from day one! And yet I trusted you and you blew it all like you always do, Mike! You and your sneaky fcking left and right. You thought you were so smart about taping your camera... one of many. I see you; and I see you from all the angles. Now I OWN YOU, Mike. bip-bop"
*cries*
Brings a new meaning to two minute papers!
LMAOOO
@@TravisHi_YTthe only time he'll actually finish in 2 minutes
Haha, did everyone read that in thee heads with a very specific intonation?
It needs to also apply resistance to the wrist and elbow to simulate volume so you cannot keep pushing through the object
That sounds like a bad idea
@@aiksi5605 springtrap
Imagine playing skate 3, falling, breaking a bone except your elbow bends backwards irl too
Yes! And impacts when getting shot in Counter Strike or Call of Duty too!
@@aiksi5605just put a clutch in it so it can't apply a dangerous amount of force even if it's getting a signal to do that
wow this is amazing, i'm surprised i only stumbled across this 7 months later, going down to rabbit hole to figure out how much more development has been done now!
the voice of ATA!
really sounds like it
Welcome to the Future Interfaces Group, where we sort out the what, and how, and the right and wrong of touch interactions.
it is him, the voice from audit the audit.
its also the voice from "TheVillains"
This is what I was thinking
PLEASE implement these into prostheses! I've been working on a prosthetic design with similar "real" haptic feedback, and to be completely honest, your design may blow mine out of the water.
Ukrainian heroes need more prosthetics than ever, and to bring them the sense of touch back would be life changing. That's been my purpose, hopefully I can convince you similarly
Why don’t you reach out to them? I’m assuming you have decent knowledge on the topic as you’re working on your own project and if they’re interested you’d probably have specialty prosthetics knowledge that’d be useful to the build.
not only is this really cool in itself, but the things this could possibly lead to in the future are also very cool!
The solid state drivers are so cool!
I love everything related to Virtual Reality, Augmented Reality and Mixed Reality, I can already imagine what the future will be like here 5, 10, 15 or even 20 or 25 years from now. All of these things are super interesting and moving faster than I thought was possible. Haptic gloves still won't be something the masses use, but they're headed in the right direction. By the way, I want more content on your haptic gloves and I would also like to know if you are interested in the cheap haptic gloves from LucidVR (from Lucas VRTech). They could collaborate together once.
I need more of this virtual reality stuff! 😊
Ready Player One - own nothing and live happy in a virtual world. while your physical body is crammed into a 1x2m pod strapped vertically.
go outside you absolute dork
@@JamesSmith-ix5jd Cool!
what is the future you imagine in 25 years?
thanks Audit the Audit. Very cool
That's really great. Very surprising an array that small is possible.
Welcome back to Audit the Audit
Where we sort out the who and the what of Haptic interactions
This stuff is crazy and I can only imagine how good it’ll be in a decade
This is so exciting!! I really really want to try these gloves!!! ❤
Caught higher res haptic tech years ago so glad y’all are pushing that,
Yo dude you narrate everything from crime documentaries to VR overviews, good for you man
This is awesome as hell as is can allow avatars to better interact with there environments and gaming just got a whole lot better and it’s also one step closer to many other great things.
This is incredible. This is gonna change everything
This is way more awesome than feeling object resistance
Future's now, man. Awesome
1:42. That escalated quickly 😂
Oh hey! I work near these guys! Fluid Reality is great. Joe is a respectable dude.
im nerdin out thinkin about these gloves
This is incredible, insane number of applications
Could enable e-books for the visually impaired and so much more
Can't they just listen to audiobooks?
@@avg.player some people are visually and auditorily impaired
I think this will have the most benefit in 1am group of people
Excellent advancements being made.
Truly amazing
wow this looks super convenient
Ok this is really cool
Can't wait for a point in the future where we're going to have fully haptic gloves with transducers all around the hand (or at least the finger digits and palm), plus servo motors that physically limit max finger travel to simulate boundaries for gripping objects. Also I need an integrated taser to truly let me appreciate the interactive scene at 2:32 😆
Very Impressed, good job
Oh yeah!!! This is the way!!!
All it needs now is some compact system that can provide resistance to both extension and contraction of the fingers -- to simulate the resistance of grabbing a solid object. Sure you can feel its surface with this, but you can still just grasp your fingers right through/past the object's surface
What is the "refresh rate" (for lack of a better word) of these haptic pixels? I feel like a standard 30FPS video does not do it justice.
And it needs more resolution = smaller dots
0:46 says a 0-300hz response and 0.5mm movement in 30hz
Polling rate
@@kaukospots Right, so if I'm reading this correctly: The controller can work at a rate of up to 300Hz, and per clockcycle it can set a different target deformation (either 'up' or 'down') at a specific amount for each cell, with a response time of 0.5s per 0.5mm?
That deformation time does not seem high enough yet? But the cycle speed seems pretty good.
Brilliant.
Looks great. I imagine the impact with gamers if you demo'd this working in Half-life Alyx.
This looks amazing o:
Amazing work. Love it.
Keep up the good work
I don’t understand a single thing you said but this goes crazy
I wonder if this will also give me goosebumps when touching corduroy in VR, since doing so IRL puts a shiver up my spine.
Looks like it should even be good enough for reading Braille!
Amazing, keep it up!
Man all I can say is wow
I hope there are people considering applications of this for assistive technology. I'm imagining a tablet brail reader. Things that interact with people who have limited movement. Stuff like that
I am not convinced how well this works without the resistance from the collision.
Well, it's "haptic feedback" not "force feedback", those two are completely different things.
An ideal glove would have both but tech companies usually focus on developping one or the other.
We'll have to wait until someone combines the two...
Force feedback is much harder and pricier to do
This is absolutely amazing! Imagine the possibilities for blind people!
WONDERFUL. 1 step closer to never leaving my house.
The next step is to have this for the whole hand and the next after that is a full body suit 👌
wow, this borders on too good to be true
DUDE THATS SICKK. whens the full body suit being made?
Haptic gloves with hand tracking is likely the future, the most future proof i've seen so far in this concept is one that they use fluid like muscles to pull your fingers and in a similar fashion fluid control makes small bumps in the fingers and palm to rise, and i remember them saying that they could even warm the fluid so it can give a heat sensation on touch. The real problem in all this is always cost, it is the same reason most people don't have VR, everything is becoming increasingly more expensive
Boss: Can you code a quick demo for the haptic gloves?
Engeneer: OK, so what textures should we be demo-ing?
Boss: For god's sake, just code anything, I don't care if it's gonna be pimply skin, just do it!
Engeneer:
I want this put into something that locks the fingers as well similar to Lucas's DIY haptic feedback gloves.
another piece of tech that is home made , and will never get to the public hands.
i love how they casually went from metal, to wood, to PIMPLY SKIN
this is so awesome!❤❤❤
This is actually next level.
Hopefully Meta will buy this company and integrate it into future Quest platforms
This would actually be good for blind people
Je me dit qu'avec l'évolution de l'ia ca doit être une dinguerie
If this was open sourced it would be a crazy edition to the lucidvr gloves
this is so cool
This concept is really interesting. With this new momentum that VR/AR is experiencing in 2024, this project could, I am sure, be very successful with users of Meta headsets.
badass
0:46 that, and the spider that crawled into the glove last night
Now just some sort or mechanical joint locks to react to grabing and touching and boom, perfect gloves
This is really cool. I always thought the technology in the haptx gloves was extreamly cool and I always wanted to try it, but is was just too big and expensive to be practical.
Imagine playing blade and sorcery with these and when you cast lightning you could litterally feel the electricity
I'm witnessing the opening of the apocalypse. What a time to be alive.
That is amazing. I wonder how the soft part works, is it air?
Nice to see @audittheaudit gettin some vo work
this would also be excellent for a console game pad
I’m beginning to believe!
wowza
Looks extremely cool! Would love to buy early... but when can we buy them and where.. and how easy will implementation be for developers?
SDK usually is where most products become underwhelming due to lack or improper implementation :(
This is awesome 😮😊
you need to add each one of the feeling pannles onto each of the finger segments and the palm
Is this the voice from audit the audit
holy SHIT i am SO fucking ready for this. oh my fucking god. i wish i could caps lock with bigger letters for emphasis
excellent illutration
Interesting!
Man this stuff gonna be crazy once it can be implanted and synced with a Neuralink chip.
Wait-
I want! Dev kit when??
Wait a sec… this is the voice of audit the audit. This guy’s voice is everywhere
this is briliant, can it be used with AR glasses to translate text to braille in real time? this thing can be amazing for the visually impaired
Did you get @AuditTheAudit to narrate?
I heard his voice and thought I had misclicked for a moment
Neat.
I know this sort of thing will probably never be cheap enough to be mainstream, but research into haptic suits is still cool as hell.
The entire point of this specific integration is that it's really cheap. Maybe in the future once its surpassed the prototype stage, and moved into the commercial stage, it'll become more expensive. Still, I can't imagine it being out of budget for anyone who can afford VR gear to begin with.
@@dudeguy8553 I think things usually get cheaper once they can be mass-produced though. I suppose extra features later on could drive up the cost, but it would make the prototypes more expensive first.
@@lorimartabin7992 R&D costs, supply and demand, and a bunch of factors can affect price. There'll probably be a lot of different novel ways to replicate this tech, and some will be more expensive than others. I think we're seeing this as individual separate units, but it could also be part of a more fully featured rig for your hand. Maybe it'll have higher resolutions, more responsiveness, and cover more of your hand.
In the end, I think there will be a consumer version that's fairly affordable, with its own budget alternatives too.
sick
If this was transparent you could also add it to a phone surface to create haptic buttons and so on :o
Is this the same guy who voices Audit The Audit? Sounds indentical
The who, the why, and the what went wrong of Haptic feedback. It's definitely Lack Luster Media lol
This sounds like Audit the Audit. Am I wrong?
I thought the exact same thing!
That second glove is literally the prototype jaeger glove from Pacific Rims intro
We can feel things on game before GTA 6
lets get this to market