Avatar Robot Boxing: High-Speed & Impact-Resilient Teleoperation in Action!
Вставка
- Опубліковано 15 жов 2024
- In this video, we showcase our humanoid robot, Nadia, being remotely controlled for boxing training using a simple VR motion capture setup. A remote user takes charge of Nadia's movements, demonstrating the power of our advanced teleoperation system. Watch as Nadia performs precise boxing moves, highlighting the potential for humanoid robots in dynamic, real-world tasks. Stay tuned to see how teleoperation is pushing the boundaries of robot control!
every day we're a step closer to Real Steel
Xbox 720 anyone?
i was about to comment this..
Yeah, that fighting robot movie was awesome !!!
We had robot combat league, but putting the robot controller shoulders on the pilot's head level makes for janky monotonous fights
Fr fr
Real steel bout to be real
the steel is becoming realer
Real Steel is about to become just Steel
The realest of steel
Bars
More like skynet
Cyberbullying bout to become an even bigger problem
I mean, what type of people are gonna have access to such tech except for rich people and the nerds who built it.
@@dinnerboons1504 REVENGE OF THE NERDS
Wyd when the kid you've been roasting online sends a fucking robot to your house to kick your ass
Give war a chance!!!
@@user-xv9kb2vs5f *WE ARE SO FUCKING BACK*
Arm tracking is nearly 1:1 but leg tracking has a very pronounced latency. This leads me to thinking the robot must be coded to prioritize balance. This is also noticeable when the robot is punching, as it seems to adjust its balance by moving its legs even if the pilot doesn't do so.
Very interesting.
Good observation
The arms are NOT 1:1. The hands are matching the relative position to the operator and the robot arms just trying to compensate.
You can see the arms do not hold the same position. In one frame, where you're talking about his leg movements, you can see the operators arm fully extended, while the robot only does a partial extension.
Makes sense, it can't move it's legs exactly like a human because it's center of mass is in a different place, so it needs to balance differently
@@PanoptesDreams That is because only his hands are being tracked. It would be neat if he used some method of whole body tracking like LIDAR.
Perhaps the distance between the leg captors and headset play in the latency. Putting a cable instead of bluetooth connection could help reduce the latency. Not entirely, but maybe 0.1 - 0.5 s
Finally gonna get that Atom Vs. Zeus rematch after 12 damn years
Was supposed to be based of apollo vs rocky so I'd say atom becomes champion and beats zeus, then atom gets challenged by a random guy with a big robot, then atom gets beaten then the rich family that made zeus offers to upgrades atom to "prime atom" (If you've played the game you'd know who prime atom is) then atom fights whoever the new champion is and retakes his crown.
No Jetsons flying cars, but we've got Real Steel boxing robots. Priorities.
flying cars would be an absolute nightmare tbh
@@chocolate_maned_wolf I’ve never been quite sure what exactly people mean by ‘flying car’ that isn’t just covered by regular aircraft like helicopters or VTOLs.
I personally picture some kind of magical wingless, rotor-less vehicle which can hover and move like a helicopter but which is also somehow almost completely silent and won’t suck you into a jet intake if you stand too close;
This is very different from the image of ‘flying cars’ from things like old Popular Mechanics covers where ‘flying car’ seems like it can mean anything from a tiny one-man helicopter that can fit in a garage to what I would just classify as just a regular airplane with four wheels.
Considering how stupid people tend to be with regular cars all the time, and how crashing aircraft usually ends up with almost everyone on-board dying, I don't think flying cars should ever become a thing. Drunkards are already driving into houses as is, but imagine them flying into buildings.
😂
Bro people can barely handle driving in what is basically 2 dimensions, having flying cars and opening up that 3rd dimension would be a fucking nightmare
Couple years from now this can be a real sport where either the robots box by the trained data you gave them or humans teleoperate them so the humans don’t get hurt during the match 😂
robot sumo has been around for a decade. It's the only sport I watch.
Sounds like a boring bunch of bullshit. Simp.
Why not just box in vr then?
@@erikm9768 machines getting slammed and destroyed in the boxing ring has its own appeals
@@DeimosSaturnThose are small toys, it's very different.
I can see an entire industry popping up in the future of people controlling avatar robots like this for working dangerous jobs or even just using them to be able to work from home
We get one step closer to Mega Man X.
Already do in Japan, have for years
African kids still cheaper tho
You should look up the movie "Surrogates", same idea.
@@cobaltbuster4907i watched It, damm i want to be in that world
Real. Steel.
It is only a matter of time until we can spar and fight against robots. What a time to be alive.
Simp.
Why would you do that. If it's calibrated wrong you'll die.
Legit how would you knock out a robot 💀
Hold on to your papers!
@@s2tb2007go for the battery pack
Looks like so much fun to tele-operate like that. The robot seems so balanced and responsive. Probably took some serious engineering and testing to reach this point. Congrats!
Real Steel was a badass film!
Man. Imagine this robot being made with the same technology as industrialised machines. The power on this would be frighteningly good. 💯
It's so cool that because the balance is different, the legs are being noticeably translated more independently from the rest of the body.
Fun fact the most dangerous part of this whole experiment was actually not using the wrist straps on the controllers
That all the doorman and security jobs going at the local pubs and nightclubs.
Definitely will want them extra water resistant 😅
Fuckin fnaf but the guard is an animatronic
@@starsilverinfinity The patrons do get a bit freaky on friday nights
cue directional input rap battle @@pixelmace1423
@@starsilverinfinitythey have to hide from Certain fnaf fans
The latency is impressive!
ARE YOU READY FOR REALL STEEELLL!! 🔥🔥
Amazing. I see a new foot design that is able to flex centrally. This would mean that when you throw a left hook and the torso twists, the back heel of the left foot would come off the ground a bit. Maybe that would eventually lend to a more human-like walking motion with heel strike and sort of ball of the foot action. Also, when hitting the speed bag, don’t lunge with your hand to hit the bag. You’ll see that on the video playback. It’s a timing drill where your hand moves in a smooth circular motion. I’m not in physics but the hand hits the bag at a certain force which sends the bag away and the returning bag “meets” the hand again rather than the hand extending to strike the bag. When the timing is correct you’ll be able to get the bag going much faster with minimal additional effort. To generate faster control hands make the circular motion elliptical. The faster the hand speed the more elongated the ellipse becomes. That’s how to control the combined timing and power. I believe that control motion would translate from human to robot and get the bag going faster. Again, absolutely spectacular work!
I can see this both used for entertainment, and also military use.
Soldier drones would be terrifying.
1:40 he's hitting the "robot stereo cameras", and not reacting, are they just for show? I'm thinking he has a different point of view
0:22 The Police officer T Bagging the Rioter
It never ceases to amaze me with just how good we are getting at gyroscopically stable humanoid robots. I don't think many people realize how insanely difficult it is to get something that large and heavy to not only stay standing on two legs, but be able to move them, pivot, turn, and all the things that our fleshy and bendable bodies make easy for us. It helps remind me too that no matter how many people may be caught up getting upset with things, progress is still chugging away at an astounding rate!
Imagine if you could rent this robot to do a walk in vr in the another side of the planet and buy things to send later to you, the future is closer
imagine these on the battlefield where soldiers are out of harms way but still funtions like they're there.
It wouldn't work, the most basic jamming by the enemy and your robot soldiers would go kaput like the B1s in The Phantom Menace.
To be even remotely useful in a combat scenario the robot would need quite a fair degree of autonomous capabilities, like most drones have (but more advanced because walking is a lot harder than flying).
Where this system of teleoperation with direct control over the robot could be really useful is in non-combat dangerous situations, natural disasters, fires, etc.
Maybe even bomb disposal but only where the radio spectrum is controlled and safe (or with cable control).
@@qdaniele97the drone operators in Ukraine would like a word with you 🤣
@@qdaniele97 this guy has no idea how drone warfare works lol.
@@qdaniele97I don’t think that’s how it works irl lol, it’s not like that.
@@ferret3046 @MrSoso1050 Ah yes... because there are lots of humanoid drones with AR-like control deployed in ukraine right now.
Most of the "drone" currently deployed in ukraine (or in most other war fronts) right now fall in three categories:
1) Radiocontrolled, semi-consumer grade, small, cheap multicopters with camera used (actually repurposed) for reconeissance. These aren't even really drones (depending on definition) because don't have any autonomous capabilities whatsoever, other than maybe assisted level-flight controls. You could already have bought a multicopter like that in 2010 in a RC-model shop with exact same functions but nobody would've calked it a "drone".
2) Semi-autonomous, relatively small multicopers or planes with some automated flight capabilities (following GPS waypoints and things like that) used for recon and/or kamikaze attacks (strapping some sort of bomb to it).
3) Real-deal large military UAVs, controlled by satellite-links from far away (far less subsceptible to jamming because of the highly directional radio-link), also capable of some autonomous flight (autopilot-like). Used for high altitude recoinessance and air-to-surface misdile strikes. These were used in ukraine but only to a limited extent because are expensive and relatively easy to shoot down by the endmy if it has mostly your same level of technology and equipment.
I don't know what other "drones" you think have been deployed to ukraine, or where ever else (or even think exist at all), but if they are much different thsn any of these then I'm sorry to say, you are the ones with no idea what you are talking about.
i was just looking online about VR remote controlled robots! This is so cool!
I’m paralyzed. Can I get some help to stand and walk ?😅
Someone needs to build this man legs!
someone get this man some legs!
Gotta get that setup that Huey from MGSV has
now this is some real steel
This might be one of the coolest things i've ever seen
we could use these to clean up toxic zones, amazing work here
This hand of mine is burning RED!!!
Latency on the arms is really crazy
Just a quick one, you might want to design the feet in a way that allows the bot to balance and pivot on its toes. This will allow it to generate power in those punches as well as other footwork techniques.
Keep up great work folks very interesting indeed thanks for sharing 😎🤟
This is a great application of humanoid robotics. Teleop always is!
Bro a sport with these things is going to be bigger than the NFL and actual boxing combined.
Is the robot reacting in real time, or did the movements of the operator were done first, and then sent to the robot, and the videos were stitched together? If the camera was moving, and the operator and robot were obstructing each other at one point, it would be obvious, but with them standing on two seperate sides of the frame, and the static camera it would be easy to stitch two shots together.
Regardless, the speed at which the robot can move is pretty impresive!
Real time
You can literally seen them side by side
It's the latency
I wonder if it's possible to make wearable exoskeleton with force-feedback so you could feel the force and movement limitations of the robot? it's kinda like sim-racing motion simulator for your body
Just like Striker Eureka.
@nathanpartridge3565 someone who actually knows pacific rim? Respect
Next step, make the robot 50X bigger so it can take on Godzilla.
Everyone’s talking about Real Steel, but I’m here thinking of VR games
A VR game that's actually Real Steel in augmented reality.
Can you make the robot record the moves, then when you ready, you push a button and then the robot begin to execute the moves? Might be the solution for a mech robot where the driver is affected if the robot gets a blow.
How the hell you guys made the respons so fast?? How to control the inertia/momentum after every single punch thrown?? How heavy is that robot??
I can see how the leg systems and upper body are fighting for motion control whenever it is walking/adjusting stance. Does having a large variance in the gyro moment / center of mass change from the arms make the walking algorithm fail?
It would be super interesting to see someone who moves fast do it!
Also, I wonder if the motors can handle any actual force, or is it still just about precision?
Does he go slow with punches on purpose for the robot to follow?
Nice! Real Steel will be a nice sport for us to watch and bet! :D
wow this is great. you can tell the robot do balance calculation
Imagine Mattel sponsoring a Rock’em Sock’em Robots event utilizing this technology
Ok, but is it able to scratch it's own back because I can't get that upper middle spot on mine and if a robot can't for itself then why did we even build it to be as useless as we are
It has the potential to be a spectacular entertainment show.
Can’t wait to play Rock ‘Em Sock ‘Em Robots with these!
oh look, the beginning of a new sport
Ahh, real steel. They tried to warn us but we never listened IM READY 😎
even if this doesn't bring about a robot boxing sport it'd be pretty gnarly special effects for a movie
I misread that for teleportation and got excited.
it makes me want to know how do they balance the robot 🙏
They show a bot that is roughly the same size as the man but there's nothing stopping it from being designed scaled up or down.
Ive had so many ideas about how this kind of technology could be implemented into a variety of situations that its not even funny. This could be the future of armed conflict, rescue operations, first responders, and so many others. The idea of Real Steel is understandable given the context of the demonstration, but the possibilities are so much larger than just robo-boxing.
For obvious reasons, the hands have low latency but this thing's legs shouldn't move as quickly as the operator's because it's center of gravity and balance is all different. If you try to mirror the leg motion with no recalculation, this thing will just topple. It looks like the legs are programmed to "plant your feet where the operator plants his feet, and act like an immobile platform from there"
So what will this job be called in the US military?
Is there a small robot controlling the big robot rattaouie style?
I like the robot on the left, it's very impressive.
When people ask me what my favorite movie is, the only one I can every qualify to be set as a "favorite movie" would be real steel. I love starwars and the like but on its own real steel is special, and soon everyone will know why, clearly! 😊
I guarantee you. If this company decided to make multiple of these robots and have a robot boxing tv series they would make so much money
This is it!! We're actually in the black ops 2 timeline dear GOD
It seems like a great technology that allows me to work from home globally🌚
It’s crazy how that’s actually less impressive than having it walk upright like a person 🤯
im calling it. 100 years from now we will have walker mecha
i can't wait to saw them send in Space !
And imagine controle it from earth or randome salettelite, by VirtualReality, we can walk anywhere they can land, asteroid, field of asteroide, land, technical operation, & more
ive been wondering why no one has made this technology, finally real steel irl
Gigantes de acero próximamente en la vida real
When do Real Steel championship begins?
can you tell me the basic setup so i can do something similar
This needs to be its own weight class in the UFC.
tracing is alright, but there's still too much lag
Too much latency. But interesting nontheless.
Yeah, the latency is going to last for sure. Try to be more interesting nonetheless. Proofreading before posting is a great way to start!
I guess its a good thing nobody asked you! ☺️
Ah the inevitable let's point out differences between prototype and production as if they can't be optimised
It seems like the only problematic latency was in the legs/foot placement. The rest of the body is up in the air as they weren't showcasing how fast it could move. I wonder how it responds if the pilot threw their punches as fast as they could; more so for the speed bag test and if it would get caught and hit its' own arm.
High speed is something else. But still amazing.
I’d buy tickets for a robot boxing match. If real boxers piloted the robots like this. It’s like a combination of formula one, science fair and gladiator combat without any risk of traumatic brain injuries
What if he jumps or the robot falls but he doesnt
I think he's holding his eyes mostly closed because the camera moment would make him sick, I need his opinion on this
?? watch fpv stunts vids, u get used to it
Why the latency on the legs? the hands seem to be pretty quick by comparison.
Probably got to maintain balance and stabilization checks
In terms of the future of these, these seem like a great advancement for doing dangerous jobs remotely. The part that sucks is how easily society would agree to revert that progress if even just one wrong person were to get one and do something bad with it.
latency is about 1 frame in a 24fps video, or 41ms. That's literally unbelievable for hardware latency.
This has potential for a new sport! Boxing could become something like formula 1 competition! And it does not have to be boxing. It could be some agility competitions. But in order to make it fun I think the robots need to outdo humans in athleticism significantly. Maybe otherwise it might not be appealing to the public. But if this happens, there could be a lot of funds to finance robotics and evolve it.
Would be good to see how ot boxes with footwork added in.
So real steel is gonna be an actual sport in the future!
Wow, I can’t believe they made the robot out of Real Steel and not some other metal
Kalau tidak klik apa2 boleh nampak tak dia akan ke mana?
Does anyone know what vr headset are they using on this setup?
Kinda looks like the Apple Vision
Why is man looking at the floor while punching?
It's about time.
Siii, que lindo!!! 🎉🎉🎉
Espera cuando saquen a tu profesor de boxeo del juego y lo cambien por un émulo de hojalata.
wow, now that is real right there.
Can’t wait for the atom vs zeus rematch
You know, you didn’t have to add the legs. Just have him hang from the ceiling while throwing punches. The piñata that fights back.
put the sadbag part at the end, it spoiled it for me to see what i came for right away and not to see the sandbag swing back and forth after impact, I uderstand the technical limitations and the need for the elastic bottom hook but it made it a little lame to watch, while the rest of the video would have been pretty cool as an intro and made for a nice build up
Robots will take over combat sports in the far future
Video of two of them boxing?👀
Fuck I’ve been dreaming of VR X robotics, I imagine these things being like four inches tall that’d be sick
Excellent news for search and rescue
MAX control range?
Is it skynet.. terminator?