Fluid Reality: High-Resolution, Untethered Haptic Gloves Using Electroosmotic Pump Arrays
Вставка
- Опубліковано 28 жов 2023
- Same tech under touchscreen: • Flat Panel Haptics: Em... (keyboard you can feel!)
Virtual and augmented reality headsets are making significant progress in audio-visual immersion and consumer adoption. However, their haptic immersion remains low, due in part to the limitations of vibrotactile actuators which dominate the AR/VR market. In this work, we present a new approach to create high-resolution shape-changing fingerpad arrays with 20 haptic pixels per square cm. Unlike prior pneumatic approaches, our actuators are low-profile (5mm thick), low-power (approximately 10mW/pixel), and entirely self-contained, with no tubing or wires running to external infrastructure. We show how multiple actuator arrays can be built into a five-finger, 160-actuator haptic glove that is untethered, lightweight (207g, including all drive electronics and battery), and has the potential to reach consumer price points at volume production. We describe the results from a technical performance evaluation and a suite of eight user studies, quantifying the diverse capabilities of our system. This includes recognition of object properties such as complex contact geometry, texture, and compliance, as well as expressive spatiotemporal effects.
Vivian Shen, Tucker Rae-Grant, Joe Mullenbach, Chris Harrison, and Craig Shultz. 2023. Fluid Reality: High-Resolution, Untethered Haptic Gloves using Electroosmotic Pump Arrays. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (UIST '23). Association for Computing Machinery, New York, NY, USA, Article 8, 1-20. doi-org.cmu.idm.oclc.org/10.1... - Наука та технологія
Vrchat will go insane with this 💀
yea especially if you put this in your a-
Don't remind me 💀
Those avatars never stood a chance
@Imafurrynowlol I can hear my gpu softly weeping in the corner just thinking about it 😂
Finally i can interact with female without harrassing them
Born to late for earthly exploration, born too early for spacial exploration. Born just in time for IRL VR.
There are plenty bases on earth not discovered yet and even if they were discovered that isn't an excuse to not discover it for yourself
Sadly like with every other amazing VR accessories showcased, they will likely not reach commercial markets for a long time if ever.
With full fledged AI interactions to boot.
let's be honest, Space Exploration is lame.
It's cold and empty up there.
@@joz534That's not being honest
Mentioning pimply skin casually like that makes me incredibly uncomfortable
Extremely
It’s what’s been missing from the vr experience. Not enough pimples.
pimple popping simulator
👅
Cyber acne physics
I think gloves like these with those gloves that restrict your finger's movement could make grabbing things in VR the ultimate experience, where you can't actually close your hand inside of an object
dont think about it dont think about it dont think about it....
Hypothetically you would just need a cable that goes along the back of your fingers that can lock in place to prevent you from closing your hand more
@@mythman30there is a guy on TikTok who developed exactly this, I don’t know his name tho
@@mythman30There's an open source project of this that was covered by LTT. Having this ( Haptics ) combined with the restriction ( The Open Source Project ) would honestly be a godsend to cheap but performant VR gloves.
One issue I can see happening with that is that people's hands are actually pretty strong. If someone's, for example, swinging an axe in VR, they'll grip it pretty hard and they'll rip apart your mechanism if it can't withstand a few dozen pounds of force per finger at the absolute minimum.
Imagine the next generation of fleshlights that'll be using this technology. What a time to be alive!
"Now all we've gotta do is put it into a walking robo dishwasher and boom! We've got ourselfes a life-long, obedient companion. Now give it some AI brains, a shmexy voice, anime-like body, actual reproductory capabilities and... we're back to square one."
*end of flashback*
"I beg you, robo-Karen! I haven't seen the kids in 2 years. I'll never call you a robo dishwasher ever again. I'm a changed man! Listen: your old sack of useless meat has changed!"
"I filed for a restraining order. My manufacturer has always told me she didn't trust you! I should have listened to her and NOT you. Oh yeah, and about Stacy: I saw the way you looked at that fleshy b!tch from day one! And yet I trusted you and you blew it all like you always do, Mike! You and your sneaky fcking left and right. You thought you were so smart about taping your camera... one of many. I see you; and I see you from all the angles. Now I OWN YOU, Mike. bip-bop"
*cries*
Brings a new meaning to two minute papers!
LMAOOO
@@TravisHi_YTthe only time he'll actually finish in 2 minutes
Haha, did everyone read that in thee heads with a very specific intonation?
Tripped me out to hear the voiceover actor who narrates audit the audit on this video 😂
Yeah he does a couple of other channels as well 😅
I fucking knew I recognized him
fucking knew it !
Could not figure out who it was lol
😮 no way I refuse to believe
I wonder what it would feel like as a whole suit.
I wouldn't want 200v around my body at all
I'm not wearing them around my groin.
Very very slow.
espiecially for wearing them near the mighty noodle @@bmanpura
@@bmanpurawell, I am. Imagine the sensations! 😂😂😂
Please bring this technology to market. It genuinly sounds amazing!
Anything can sound amazing but all the treadmills and Haptic gloves are trash and will be trash for a very long time with no support even if they make it to market
@@peekayboo7183 have you seen what the imagineering team at disney has been making??? very very cool fucking stuff for the treadmil kind of stuff
It needs to also apply resistance to the wrist and elbow to simulate volume so you cannot keep pushing through the object
That sounds like a bad idea
@@aiksi5605 springtrap
Imagine playing skate 3, falling, breaking a bone except your elbow bends backwards irl too
Yes! And impacts when getting shot in Counter Strike or Call of Duty too!
@@aiksi5605just put a clutch in it so it can't apply a dangerous amount of force even if it's getting a signal to do that
wow this is amazing, i'm surprised i only stumbled across this 7 months later, going down to rabbit hole to figure out how much more development has been done now!
Man, I had pretty much the same exact idea; but it was the entire glove, not just the finger tips.
I'm glad to see somebody is working on it, though.
I love everything related to Virtual Reality, Augmented Reality and Mixed Reality, I can already imagine what the future will be like here 5, 10, 15 or even 20 or 25 years from now. All of these things are super interesting and moving faster than I thought was possible. Haptic gloves still won't be something the masses use, but they're headed in the right direction. By the way, I want more content on your haptic gloves and I would also like to know if you are interested in the cheap haptic gloves from LucidVR (from Lucas VRTech). They could collaborate together once.
I need more of this virtual reality stuff! 😊
Ready Player One - own nothing and live happy in a virtual world. while your physical body is crammed into a 1x2m pod strapped vertically.
go outside you absolute dork
@@JamesSmith-ix5jd Cool!
what is the future you imagine in 25 years?
Yo dude you narrate everything from crime documentaries to VR overviews, good for you man
not only is this really cool in itself, but the things this could possibly lead to in the future are also very cool!
the voice of ATA!
really sounds like it
Welcome to the Future Interfaces Group, where we sort out the what, and how, and the right and wrong of touch interactions.
it is him, the voice from audit the audit.
its also the voice from "TheVillains"
This is what I was thinking
The solid state drivers are so cool!
That's really great. Very surprising an array that small is possible.
VR Booba is within reach my brothers
Ur so real for this
This is so exciting!! I really really want to try these gloves!!! ❤
This stuff is crazy and I can only imagine how good it’ll be in a decade
Caught higher res haptic tech years ago so glad y’all are pushing that,
This is actually next level.
Hopefully Meta will buy this company and integrate it into future Quest platforms
This is awesome as hell as is can allow avatars to better interact with there environments and gaming just got a whole lot better and it’s also one step closer to many other great things.
PLEASE implement these into prostheses! I've been working on a prosthetic design with similar "real" haptic feedback, and to be completely honest, your design may blow mine out of the water.
Ukrainian heroes need more prosthetics than ever, and to bring them the sense of touch back would be life changing. That's been my purpose, hopefully I can convince you similarly
Why don’t you reach out to them? I’m assuming you have decent knowledge on the topic as you’re working on your own project and if they’re interested you’d probably have specialty prosthetics knowledge that’d be useful to the build.
Can't wait for a point in the future where we're going to have fully haptic gloves with transducers all around the hand (or at least the finger digits and palm), plus servo motors that physically limit max finger travel to simulate boundaries for gripping objects. Also I need an integrated taser to truly let me appreciate the interactive scene at 2:32 😆
This is incredible. This is gonna change everything
Excellent advancements being made.
wow this looks super convenient
This is incredible, insane number of applications
Could enable e-books for the visually impaired and so much more
Can't they just listen to audiobooks?
@@avg.player some people are visually and auditorily impaired
Boss: Can you code a quick demo for the haptic gloves?
Engeneer: OK, so what textures should we be demo-ing?
Boss: For god's sake, just code anything, I don't care if it's gonna be pimply skin, just do it!
Engeneer:
Amazing work. Love it.
Looks great. I imagine the impact with gamers if you demo'd this working in Half-life Alyx.
Haptic gloves with hand tracking is likely the future, the most future proof i've seen so far in this concept is one that they use fluid like muscles to pull your fingers and in a similar fashion fluid control makes small bumps in the fingers and palm to rise, and i remember them saying that they could even warm the fluid so it can give a heat sensation on touch. The real problem in all this is always cost, it is the same reason most people don't have VR, everything is becoming increasingly more expensive
Truly amazing
This is really cool. I always thought the technology in the haptx gloves was extreamly cool and I always wanted to try it, but is was just too big and expensive to be practical.
I am not convinced how well this works without the resistance from the collision.
Well, it's "haptic feedback" not "force feedback", those two are completely different things.
An ideal glove would have both but tech companies usually focus on developping one or the other.
We'll have to wait until someone combines the two...
Force feedback is much harder and pricier to do
I want this put into something that locks the fingers as well similar to Lucas's DIY haptic feedback gloves.
Future's now, man. Awesome
This would actually be good for blind people
Looks like it should even be good enough for reading Braille!
Very Impressed, good job
I don’t understand a single thing you said but this goes crazy
All it needs now is some compact system that can provide resistance to both extension and contraction of the fingers -- to simulate the resistance of grabbing a solid object. Sure you can feel its surface with this, but you can still just grasp your fingers right through/past the object's surface
Welcome back to Audit the Audit
Where we sort out the who and the what of Haptic interactions
Now just some sort or mechanical joint locks to react to grabing and touching and boom, perfect gloves
This looks amazing o:
What is the "refresh rate" (for lack of a better word) of these haptic pixels? I feel like a standard 30FPS video does not do it justice.
And it needs more resolution = smaller dots
0:46 says a 0-300hz response and 0.5mm movement in 30hz
Polling rate
@@kaukospots Right, so if I'm reading this correctly: The controller can work at a rate of up to 300Hz, and per clockcycle it can set a different target deformation (either 'up' or 'down') at a specific amount for each cell, with a response time of 0.5s per 0.5mm?
That deformation time does not seem high enough yet? But the cycle speed seems pretty good.
If this was open sourced it would be a crazy edition to the lucidvr gloves
Looks extremely cool! Would love to buy early... but when can we buy them and where.. and how easy will implementation be for developers?
SDK usually is where most products become underwhelming due to lack or improper implementation :(
Je me dit qu'avec l'évolution de l'ia ca doit être une dinguerie
That is amazing. I wonder how the soft part works, is it air?
this is briliant, can it be used with AR glasses to translate text to braille in real time? this thing can be amazing for the visually impaired
Ok this is really cool
Amazing, keep it up!
Keep up the good work
This concept is really interesting. With this new momentum that VR/AR is experiencing in 2024, this project could, I am sure, be very successful with users of Meta headsets.
wow, this borders on too good to be true
this would also be excellent for a console game pad
Imagine playing blade and sorcery with these and when you cast lightning you could litterally feel the electricity
Man all I can say is wow
1:42. That escalated quickly 😂
Increasing the resolution, adding pressure sensing and replacing the surface with a flexible display, would be a step towards a touchscreen with buttons that could be felt.
Same research team: ua-cam.com/video/j_rErbhxNFM/v-deo.html
holy SHIT i am SO fucking ready for this. oh my fucking god. i wish i could caps lock with bigger letters for emphasis
Nice to see @audittheaudit gettin some vo work
Brilliant.
Man this stuff gonna be crazy once it can be implanted and synced with a Neuralink chip.
Wait-
you need to add each one of the feeling pannles onto each of the finger segments and the palm
I hope there are people considering applications of this for assistive technology. I'm imagining a tablet brail reader. Things that interact with people who have limited movement. Stuff like that
I'm witnessing the opening of the apocalypse. What a time to be alive.
this is so awesome!❤❤❤
WONDERFUL. 1 step closer to never leaving my house.
This is awesome 😮😊
beautifull keep on working on this. Where can i support you guys?
Oh yeah!!! This is the way!!!
I know this sort of thing will probably never be cheap enough to be mainstream, but research into haptic suits is still cool as hell.
The entire point of this specific integration is that it's really cheap. Maybe in the future once its surpassed the prototype stage, and moved into the commercial stage, it'll become more expensive. Still, I can't imagine it being out of budget for anyone who can afford VR gear to begin with.
@@dudeguy8553 I think things usually get cheaper once they can be mass-produced though. I suppose extra features later on could drive up the cost, but it would make the prototypes more expensive first.
@@lorimartabin7992 R&D costs, supply and demand, and a bunch of factors can affect price. There'll probably be a lot of different novel ways to replicate this tech, and some will be more expensive than others. I think we're seeing this as individual separate units, but it could also be part of a more fully featured rig for your hand. Maybe it'll have higher resolutions, more responsiveness, and cover more of your hand.
In the end, I think there will be a consumer version that's fairly affordable, with its own budget alternatives too.
Noting that the pads for the finger tips are solid and flat
Is the plan to have them woven into a second skin style suit at some point with 1 or 2 layers for ultra fine and and outer layer for more coarse haptics
I want! Dev kit when??
Is this the same guy who voices Audit The Audit? Sounds indentical
The who, the why, and the what went wrong of Haptic feedback. It's definitely Lack Luster Media lol
If this was transparent you could also add it to a phone surface to create haptic buttons and so on :o
excellent illutration
Did you get @AuditTheAudit to narrate?
I heard his voice and thought I had misclicked for a moment
this is so cool
I think it would be really cool (pun intended)to have cooling and heat to make iron feel cold to the touch
"with our brand new Tempsense (TM) technology, you can now feel the cleansing flame of the cyber-hell we're sending you all to for tainting our life's work with all of your disgustingly overused privates!"
We can feel things on game before GTA 6
I’m beginning to believe!
Nice to feel textures. But not finger force yet. no trigger mecanism. but we have to start somewhere
Wait a sec… this is the voice of audit the audit. This guy’s voice is everywhere
Is this the voice from audit the audit
When can I buy? Or make because of easy to follow instructions like Slime FBT?
Bit over the top, but was a 6 Node (hardware or software) configuration also thought off? Braille keyboard as a glove? (since they are freaking expensive in a bigger row size)
Interesting!
I recognize this narrator. Audit the Audit
Yooooo this is player 1 movie be showing, fiction becomes reality
The tech that really needs work is the vive tracker. It's been a decade. It can be smaller.
Check out Tundra trackers! I have 3 and they're pretty great~
Yo this technology would be great for the blind!
WAIT, WITH THIS YOU CAN FINALLY MAKE A PRAIL DEVICE
отличная технология, мне понравилась. А не проще ли было реализовать миостимуляцию?
Now, we need the haptics on the palms.
i know what you are
I think you could simulate electric sparks more easily. With a little high-voltage transformer.
With time, y'all might as well increase the resolution. That would be interesting.