James Bruton I have an excellent idea if you are willing to try it! Attach a camera to the head of the puppeteering rigs, then hook it up to a VR headset so you can see exactly what the robot sees. Then, make a suit that can detect roughly where your body is instead of the smaller controller things. That way, it actually feels like you are the robot. Move your hand forwards, and the robot moves it's hand forwards. Might be a bit strange as there would be a small delay between you moving and the robot moving, but it would be super fun I reckon, even if it doesn't have much of a practical use! I would be happy to help with some of the design and code if you like. I completely understand that it would be quite a large project to attempt, but the result would be super fun! Plus, a human-based controller suit could be SUPER handy for other projects later on
I think the robots can't really move fast enough for it to work very effectively. It would be extremely disorienting to have the robots arm lagging behind yours by quite a bit and I bet it would lead to a lot of nausea. Definitely a cool idea, but I feel like it may not be very possible.
@@matthewcollier3482 True. There would be a lot of minuscule timing issues to spend a lot of time on. It would certainly be tricky to accomplish decently.
Latency of limb movements won't cause nausea, only latency of camera movement if the head is moving in relation to headset tracking. You can just create a fixed viewport scaled 180° and move the "player" viewport across the field of view (which is plenty fast). Easy to solve at a slight cost of resolution, which people tolerate just fine.
I think it would be a fun challenge, where operators would be in a different room than the robots, controlling them with a POV perspective. Maybe doing something like preparing an easy meal (a sandwitch maybe?) or building something with easy to grip blocks. Either way, those robots look awesome! Can't wait for more videos! :D
I love the puppet rigs. I have always thought this approach would make operating heavy machinery like cranes and excavators much more intuitive and precise to control. Particularly if you incorporate force feedback in the axis. Consider putting the wearer "inside" the puppet rig, and allowing them to control an exosuit as an assistive technology for disabled persons mobility.
Love to see you do a similar build for a "robot wars" thing.. dexterous arms could be quite the advantage in an arena pitting spear against silly power tools on wheels.
It would be interesting to see the gripper switches changed to something like a linear potentiometer that would allow you to control how open or closed the gripper is. Then you would still have the gripper stop adding gripping force once the hall effect sensor has reached its desired value and at that point it would ignore the value of the linear potentiometer if it were to move in the direction that would command the gripper to grip tighter.
It would be cool if you could turn them into teleoperating robots by giving them binocular vision and allow them to be controlled by a VR system. You would need to "simulate" the robot's body so it doesn't allow any positions that would cause the elbows to crash into the physical body.
Ok time for some fighting robots!! That would be amazing to see you build. Make the joints compliant so they don’t break, then allow people to fight each other with goggles on. Maybe a points system with sensors on the head and body. They could be smaller so they can punch quicker. Just an idea.
Basic programming is all you need to get started, the more advanced parts are things you learn as you go. You can't wait with doing stuff until you have mastered programming, then you'll never master it. Best way to learn is through actual practice with actual goals and projects. Simple ones that you can complete but are still a bit challenging.
That's true I have an ongoing project in mind with coding but i just seem to struggle getting my head round trying to piece everything into one sketch (I threw myself into the deep end) individually I can work each component in separate sketches which include a motor driver board, leds, Neo pixels, servo and an ir receiver so it should be quite simple
concerning springs... u could just use two preassure springs and end poit switches on each side... move the two finges to another till the switch is activated so the springs are "loaded" -> equal force on both sides (sry 4 my english)
Great explanations and variation of content in this one. Bit of CAD, bit of explanation, bit of demonstration etc. For some reason when I look at those grippers fully open and the rotation... I'm reminded of Maximilian from from The Black Hole.
@@matthewcollier3482 yes, more like slight delays in actuation time. It is not a sloppy build, just seems to be a little less fluid than one could wish for it to be. But great work nonetheless James Bruton!
Hi James, i really like your work.. and you should definitely make turn this robots to vr and glove controlled robots. i would like to see that thing comes up.
You should add a POV VR (like a drone style POV with HMD) camera so that when doing stuff like that challenge you can see where the hands are from anywhere you are
This is awesome! Could you work on your self balancing robot adding SLAM? Maybe on a raspberry pi and use a camera or lidar? I have been working on adding ROS for slam on my self balancing robot but I am having trouble. It would be awesome if you made a tutorial for that! Thanks, big fan!!!
You should add gripper rubber along the inside of the "fingers" so that they could more easily hold on to things.! Can the robotic arms move up over and down to the box? It looked lie you needed to move the elbow joint further our from the body and then turn the joint sideways almost 90 degrees, it is a stiffer way than we humans move, but if the range of movement is good enough it should be doable. Fun challenge by the way, build on that, just change the test a little to require more of the movement the bots are able to do and add more test and you'd have a fun game at shows and such. One test could be to remove a hat from the bot, then push a button in an award spot, pick up and place the balls, blocks and more.
Didn't notice any deliberate pauses in code to slow things down - I expect its just the combination of input lag (it takes some time for puppet rig to read convert and send data) and the decoding and acting on it at the other end. Mostly in that last part as the robot arms do not move all that fast where the little puppet rig can cover the whole range of movement almost instantly, and the robot arms have motion smoothing as well so the acceleration and deceleration will be gradual. Doesn't actually look bad to me though, clearly not 1:1 'real time' matching of the puppets but its pretty swift.
Awesome robot puppets ! But if I had to make a proposition, that would be to adapt either the robot or it's puppet to each other max angle, I've saw quite a few time the puppet reach angles the robot cannot, maybe you could limit the puppet's movement ? Otherwise, really cool, I'm following that !
Yes there are some constrains which are there in an effort to stop the robot destroying itself. I should probably remove those and add pack out the puppeteering rig to stop the limbs colliding.
I suspect a few hours and gauging the latency of the motors would make someone a pro at that. Maybe some rubber bands or other gripping material around or built into the fingers would assist gripping tasks and challenges too. [incoming message....... *SKYNET IS OBSERVING AND INTERESTED* ]
I think the problem you both had in the challenge was controlling from the side so your brain is not only learning how to control the arms but controlling them 90deg out of orientation maybe try controlling them from the back =) great video though
Human hands have fingerprints that help grip things. Your robots' fingers' tips are smooth plastic. You were using them to pick up smooth plastic balls.
Patrons and UA-cam Channel Members already have next week's video - that video is the next part of Mini Robot Dog.
James Bruton Yey ^~^
Eric Lotze it makes me think of Doc Oc
Make a puppet robot bender
Awesome! Now that it has hands, this puppeteering control interface looks like it would be a good fit for the Hacksmith's Power Loader project
I smell a cross-over possibility...
Now that would be a good collaboration
@@kruleworld they’ve crossed over before, if only they crossed over again
James Bruton I have an excellent idea if you are willing to try it! Attach a camera to the head of the puppeteering rigs, then hook it up to a VR headset so you can see exactly what the robot sees. Then, make a suit that can detect roughly where your body is instead of the smaller controller things. That way, it actually feels like you are the robot. Move your hand forwards, and the robot moves it's hand forwards. Might be a bit strange as there would be a small delay between you moving and the robot moving, but it would be super fun I reckon, even if it doesn't have much of a practical use! I would be happy to help with some of the design and code if you like.
I completely understand that it would be quite a large project to attempt, but the result would be super fun! Plus, a human-based controller suit could be SUPER handy for other projects later on
It would be interesting just to see the view from the robots perspective, especially when you have a crowd staring at it.
I think the robots can't really move fast enough for it to work very effectively. It would be extremely disorienting to have the robots arm lagging behind yours by quite a bit and I bet it would lead to a lot of nausea.
Definitely a cool idea, but I feel like it may not be very possible.
@@matthewcollier3482 True. There would be a lot of minuscule timing issues to spend a lot of time on. It would certainly be tricky to accomplish decently.
If you attach 2 cameras, you can have a 3d view
Latency of limb movements won't cause nausea, only latency of camera movement if the head is moving in relation to headset tracking. You can just create a fixed viewport scaled 180° and move the "player" viewport across the field of view (which is plenty fast). Easy to solve at a slight cost of resolution, which people tolerate just fine.
The way the Arduino and the MAX485 module fit on that proto-board so nicely is so satisfying.
I think it would be a fun challenge, where operators would be in a different room than the robots, controlling them with a POV perspective. Maybe doing something like preparing an easy meal (a sandwitch maybe?) or building something with easy to grip blocks. Either way, those robots look awesome! Can't wait for more videos! :D
I'm considering it - "can this robot cook waffles!"
If this had a vr headset and a camera in the head Imagine how cool that could be.
It exist...
The tension mechanism is super clever. It shows a nice application of the decoupling principle.
I still can believe I've been watching this man since 2014
Great job. Now I need plans, STLs.... and your talent! Thanks for sharing!
This is the future... don't stop
Amazing! The two robots look so cool side by side. Thanks for the great videos, truly inspiring!
Thanks!
Brilliant, simple solution for maintaining proper grip pressure! 👍
Nice video. Great engineering and design. Spring tension/hall effects great solution. Mahalo for sharing! : )
Love this project! Maybe have the gripper naturally closed and open with the switch so it’s easier to hold on to things
That's a cool way to do that. So you can even tell have a firm grip or a soft grip on an object. Nicely solved!!
I love the puppet rigs. I have always thought this approach would make operating heavy machinery like cranes and excavators much more intuitive and precise to control. Particularly if you incorporate force feedback in the axis.
Consider putting the wearer "inside" the puppet rig, and allowing them to control an exosuit as an assistive technology for disabled persons mobility.
Just don't apply for that remote surgeon vacancy yet !
These things look like so much fun!
Love to see you do a similar build for a "robot wars" thing.. dexterous arms could be quite the advantage in an arena pitting spear against silly power tools on wheels.
Always amazed at what you come up with! Thanks for the inspiration! Now just need to get my 3d printer under wraps.
Way cool - perhaps a good pre-cursor to remote manufacturing
They use a similar system to do remote surgery...so...
Great @mattdenton / James Bruton .. seem like great fun ,, 👍🏻
This needs VR, for pov object picking mate.
Good job
Please try to use these for telepresence with VR!
I was desperately waiting for the robots to shake hands at the end there :D
Nice build
Outstanding! Excellent addition.
It would be interesting to see the gripper switches changed to something like a linear potentiometer that would allow you to control how open or closed the gripper is. Then you would still have the gripper stop adding gripping force once the hall effect sensor has reached its desired value and at that point it would ignore the value of the linear potentiometer if it were to move in the direction that would command the gripper to grip tighter.
Absolutely EXCELLENT!... Forgive me if I don't sign up for teleoperated surgery just yet. :o)
It would be cool if you could turn them into teleoperating robots by giving them binocular vision and allow them to be controlled by a VR system.
You would need to "simulate" the robot's body so it doesn't allow any positions that would cause the elbows to crash into the physical body.
Ok time for some fighting robots!! That would be amazing to see you build. Make the joints compliant so they don’t break, then allow people to fight each other with goggles on. Maybe a points system with sensors on the head and body. They could be smaller so they can punch quicker. Just an idea.
So cool man, that design is very clever 🤙🏼
Oh man I wish I could do more than just basic programming these look awesome
Just try making stuff, you'll find yourself getting better and better :)
Basic programming is all you need to get started, the more advanced parts are things you learn as you go. You can't wait with doing stuff until you have mastered programming, then you'll never master it. Best way to learn is through actual practice with actual goals and projects. Simple ones that you can complete but are still a bit challenging.
That's true I have an ongoing project in mind with coding but i just seem to struggle getting my head round trying to piece everything into one sketch (I threw myself into the deep end) individually I can work each component in separate sketches which include a motor driver board, leds, Neo pixels, servo and an ir receiver so it should be quite simple
concerning springs... u could just use two preassure springs and end poit switches on each side... move the two finges to another till the switch is activated so the springs are "loaded" -> equal force on both sides (sry 4 my english)
Great explanations and variation of content in this one. Bit of CAD, bit of explanation, bit of demonstration etc. For some reason when I look at those grippers fully open and the rotation... I'm reminded of Maximilian from from The Black Hole.
These robots are very cool
HAPPY HOLI everyone from India
Next challenge, Teleoperated Robot Jenga!
Watch the puppet vs the robot, there's a lot of slop in that setup, I think due to acceleration damping and smoothing
Yeah the "slop" does detract from the wow-factor.
I almost don't think slop is necessarily the right word, but it definitely doesn't seem responsive enough
@@matthewcollier3482 yes, more like slight delays in actuation time. It is not a sloppy build, just seems to be a little less fluid than one could wish for it to be. But great work nonetheless James Bruton!
@@rdoes6696 Yeah exactly, it seems quite rigid just that the motion smoothing and stuff is adding enough of a delay that it seems laggy
FPV would be awesome.
Hi James,
i really like your work.. and you should definitely make turn this robots to vr and glove controlled robots. i would like to see that thing comes up.
You should try doing that with motion capture with a
kinect or something else.
This robots look very nice. How many kg it can lift up in each arm?
This is so so cool.
I think the hands could do with 3 positions, as they look sorta doofy with the fingers just splayed out all the time.
So Open, Rest, Closed
You are a great 3d disigner
Would be amazing if the robots blinked over time or when you held down the grip switch the "eyes" looked like they were focusing
Excellent video.
You should add a POV VR (like a drone style POV with HMD) camera so that when doing stuff like that challenge you can see where the hands are from anywhere you are
Should do a cup stacking competition with the robots.
This is awesome! Could you work on your self balancing robot adding SLAM? Maybe on a raspberry pi and use a camera or lidar? I have been working on adding ROS for slam on my self balancing robot but I am having trouble. It would be awesome if you made a tutorial for that! Thanks, big fan!!!
Amazing work. Haptic feedback would be nice for next step.
The future of robot fights... #cyberpunk
Would love to see some James Bruton haptics involved here! Could you do a similar challenge blindfolded?
That is something I've thought about, it's hard to do all the sensing and feedback required though
You should add gripper rubber along the inside of the "fingers" so that they could more easily hold on to things.!
Can the robotic arms move up over and down to the box?
It looked lie you needed to move the elbow joint further our from the body and then turn the joint sideways almost 90 degrees, it is a stiffer way than we humans move, but if the range of movement is good enough it should be doable.
Fun challenge by the way, build on that, just change the test a little to require more of the movement the bots are able to do and add more test and you'd have a fun game at shows and such.
One test could be to remove a hat from the bot, then push a button in an award spot, pick up and place the balls, blocks and more.
Can’t wait to see these ROBOTS in a DAFT PUNK music video! :)
I'm wondering where the lag is coming from. Is it coded deliberately to prevent people from ripping the robots apart?
Didn't notice any deliberate pauses in code to slow things down - I expect its just the combination of input lag (it takes some time for puppet rig to read convert and send data) and the decoding and acting on it at the other end. Mostly in that last part as the robot arms do not move all that fast where the little puppet rig can cover the whole range of movement almost instantly, and the robot arms have motion smoothing as well so the acceleration and deceleration will be gradual. Doesn't actually look bad to me though, clearly not 1:1 'real time' matching of the puppets but its pretty swift.
It looked as if they had a lot of problems doing precise movements at very slow speeds. The filtering must be hitting the inputs quite hard.
Awesome robot puppets !
But if I had to make a proposition, that would be to adapt either the robot or it's puppet to each other max angle, I've saw quite a few time the puppet reach angles the robot cannot, maybe you could limit the puppet's movement ?
Otherwise, really cool, I'm following that !
Yes there are some constrains which are there in an effort to stop the robot destroying itself. I should probably remove those and add pack out the puppeteering rig to stop the limbs colliding.
I suspect a few hours and gauging the latency of the motors would make someone a pro at that. Maybe some rubber bands or other gripping material around or built into the fingers would assist gripping tasks and challenges too.
[incoming message....... *SKYNET IS OBSERVING AND INTERESTED* ]
Would it be possible for you to connect the robot with an Motion Capture Suit and VR Glasses?
James where do you come up with these designs?? The compliant mechanism is genius!!
hey what if you put a camera inside the heads so they can be compatiple with a vr headset it would help alot of people
Great ingenuity !
James in my country there's not a degree in robotics engineering, what degree de you recommend me?
James how do you keep track of all your projects? what's your system?
I use Trello mostly ;-)
amazing mechanism the one with the spring!!!! Have you thought about building a Suit-up gantry from Iron Man? (doesn't have to be the whole thing!)
James is like a real life Tony Stark if Tony had a UA-cam channel
Imagine what James could do with Stark's funds...!
Correct me if im wrong but isnt the tension in the gripper non linear in relation to the spring due to the way the gripper is jointed?
yes, but it still saves strain on the servo
What software do you use to design your ideas
Is it me or do I really want to watch these people fight with these robots
I think the problem you both had in the challenge was controlling from the side so your brain is not only learning how to control the arms but controlling them 90deg out of orientation maybe try controlling them from the back =) great video though
What is your 3d printer your using is it the taz 6?
Can u make it controlled by human body movements instead of a figure.
Amazing engineering
I need your help on a project I'm working on pls
Maybe the button should open the hand instead of closing it, thus the hand can be normally closed.
Nice, Waldos are a thing now.
Something people normally don't brag about: years of puppeteering.
Wouldn't it be easier if you put cameras in the robot eyes, and used VR goggles?
Yo your amazing
How much did these cost to make
Woah. Level 2 Of Hacksmith. James.
How do you manage to print so many 3d printed parts a week?
Start sooner
Really enjoyed this weeks vid, will you be releasing the 3D printed file to thingiverse? Keep up the good work.
Yes they are on Github along with the rest of the whole robot
Thanks will have a look
bro you are amazing guy
You should make a movie with these
What language are you using?
Just "Wow!!"
Would be cool if it was an exo skeleton that you wear so you can control the robot from your body
I dream of having something like that
So cool!!!!!!
This is how Real Steel robots were made.
The challange part was SO frustrating to watch :D
Human hands have fingerprints that help grip things. Your robots' fingers' tips are smooth plastic. You were using them to pick up smooth plastic balls.
Put a camera in the middle of the robots head and a display on the top of the robot and have the robots on the other side of a wall
Collaborative puppeteering: pass a ball from one robot to the other in mid air.
You inspire me 😶
Why not place a camera in the face, so you have first person perspective?
I'm considering it
Это классно! Мне очень понравилось.
Give it the clamps
can you make fanf robot "Springbonnie"
You could've grabbed the ball from the right hand to the left...