The everything remote is to you what a lock is to LockPickingLawyer, or a pulse jet to Colin Furze. I can't imagine your channel without it. Love the upgrade haha
Ive been working on almost the EXACT same project, except with a pi 3 and a waveshare monitor and some pcbs similar to Nintendo joycons. I'm actually powering mine with just a cell phone battery bank that shows the percentage left on the pack.
i like the way the background is being cleaned up... and looking more professional. but, that being said, i don't care what the background looks like as long as the content continues to be so highly interesting and well done.
I love all these projects and that you make them available open source. Just one thought though: It would be nice if you could also provide a BOM. Like what are the joy sticks? What are the buttons? Where did they come from? Keep up the awesome work!
Instead of publishing a Twist and some separate topic for the buttons, you might want to just publish a Joy-message, specifically made for joysticks. There's a joystick_teleop node that ingests that and outputs /cmd_vel. That setup allows for remapping of the buttons and axes. Also takes care of the deadzone, scaling etc. There's a joystick node that uses in a Linux joystick device to publish Joy-messages. Then, you can make your handheld controller act as a normal joystick device via the Teensy. That way, it'll also work as a joystick if you plug it into a Windows machine, as it's then just a normal plug-and-play joystick device
Do you have any code showing how to move motors on a client requesting servo angles from a server via tcp or udp? for example, I am trying to use a pi as a webcam, do some color tracking on the jetson nano, and send the angles back to the same pi with the camera, which is attached to the servos. A remote tracking cam. I have the video working, and the servo angles outputting. I can bind the socket, but my while True loop locks up when I try to create a data connection. I should know this, but I should also learn ros. This looks very practical.
ROS sounds like it could be a pretty good base for a home automation project, cheap easy touch screen control panel in every room which can all share data and then you can either pass that data to other services or set up "robots" to control appliances/lighting.
A dedicated hat with the Teensy and all I/Os and connectors (I²C, SPI...) could be nice, to avoid USB cable (by directly using the serial port on GPIOs), and allows further developpements.
How is the information from the joystick, computer and robot transferred? Is the ROS system "conversing" over WiFi? Or Bluetooth? Or something else? I'm relatively new to ROS and I've only sent information over USB and Ethernet cables.
Hey James! There's a ROS topic called sensor_msgs/Joy that has an array of floats for the axes and an array of ints for buttons/switches/states. Might be something that could be pretty useful for this application!
Another advantage of 1, 2, 4 and 8 being bits on an int, is that you can press multiple buttons at the same time, and would send something like 3, which would be 1 and 2 being pressed together. Where if you sent 1,2,3,4 for each button, you would never know if 3 is button 3, or 1 and 2 at the same time, so you could never combine buttons.
This ROS stuff is looking amazing! I'd never have imagined that a distributed OS would be fast enough for real time controls but apparently not! One thing I'd be a little concerned about is if the remote runs out of battery while controlling a robot, in case the robot disappears off into the distance with no way to stop it. Implementing a heartbeat/watchdog timer from the remote to say "hey, i'm still here!" that the robot subscribes to, and automatically shuts down if it doesn't receive the message after a timeout?
I was thinking how great it would be if you would make a Puzzle Box. Like the ones on the channel of Chris Ramsey. That would be so fricking awesome. To see your mechanical skills in a Puzzle. Maybe you could do a collaboration!
You do not need the sda and scl wires. I2C goes over the DSI cable. You just need 5V, GND and DSI ribbon connected. EDIT: only pi 1a and 1b required separate I2C connection.
Something like this would also be great for making a portable RPI emulation console, just swap out the joysticks for ones from a regular game controller and maybe tweak the design a bit to accommodate a dpad.
Looking good. Man I should have used those joysticks on my robot controller. Any idea on how easy they are to mod into throttle style sticks by extracting the tension springs? Needed throttle sticks on my 34 analog input controller but would have been nice to have a bit larger sticks like what you are using.
Amazing idea for a controller! I have a suggestion, it would be really nice if you could make some diagrams to show how the RPi interfaces versus the Teensy over serial with the rosserial as protocol and so on, it would make the understanding much more easier. Looking forward for you to push the designs!!!
@@jamesbruton Some nice diagram with devices and protocols would help, you can take some tips from Andreas Spies, he is a master of concise and simple explanations.
I probably would've stuck with a dedicated radio link like the nrf chip so that when you pipe lidar or image or tf data to the pi screen it doesn't delay your control inputs
This is really good stuff. I'm curious as to wether or not this controller could be used, for driving a small, electric vehicle. Like a remote control, go kart. 😊
You can use ESP32 with micropython firmware. It has analog and digital pins, which can be assigned as inputs or outputs. Check also M5 stack core 2 or other ESP32 boards.
Yes, but by default it only works up to Teensy 3.2. Use the one I hacked for the RUR which goes up to Teensy 4.1: github.com/XRobots/ReallyUsefulRobot/blob/main/arduino/ros_lib_modified.zip
@@albertolr98 also eBay may be a good source www.ebay.com/i/302526181730?chn=ps&norover=1&mkevt=1&mkrid=711-117182-37290-0&mkcid=2&itemid=302526181730&targetid=934793862176&device=m&mktype=pla&googleloc=9008143&poi=&campaignid=10460106669&mkgroupid=106723175187&rlsatarget=pla-934793862176&abcId=2146001&merchantid=118841012&gclid=EAIaIQobChMIqvqTtsW-7QIVDYrICh1fBAe3EAQYASABEgJ14PD_BwE
Hi James, if you connect the Teensy directly to the Pi GPIO Pins you could use one of the internal UARTs for serial connection. The Pi 4 has enough of them ( www.raspberrypi.org/documentation/configuration/uart.md ) and you could save space and a usb cable ;-)
It's like a thicker, heftier version of a Switch - you've build the Nintendo Breaker!
I would call it the Super Nintendo Switch
James you j need to interface a tablet/Surface with some joy cons and build a switch-inspired chassis solution!
The switch sets a very very low bar so yeah id say this thing is better
Thicc
Hopefully no joy con drift on this one
James: **carefully designs and prints perfect fit for display**
Also James: **designs and prints additional 15mm bezel around display**
The everything remote is to you what a lock is to LockPickingLawyer, or a pulse jet to Colin Furze. I can't imagine your channel without it. Love the upgrade haha
Arduino: Lets sponsor Jame Bruton!
James:*Using teensy in literally every project*
What
Just so you know, versions of the pi after the original b don't need those i2c wires for the touchscreen. They are already routed over the DSI cable.
"I don't wanna be driving at 500 meters per second."!:D Delivered in perfect deadpan manner:)
Thank you so much for publishing the source for this.
No worries, I'll update it as I go.
I love the transition into the py for more industry standard robotics development! Keep up the amazing work!
Ive been working on almost the EXACT same project, except with a pi 3 and a waveshare monitor and some pcbs similar to Nintendo joycons. I'm actually powering mine with just a cell phone battery bank that shows the percentage left on the pack.
1:52 nintendo switch
Look at this dude
so cool to see things coming like this together. congratulations and thanks!
I love the way you explain ROS, thank you so much... never thought of it was a network before :)
Congratulations 🎉 James now 😀 you have sponors like the great Arduino 🔥🔥🔥🔥🔥
this fella deserves 1million subscribers. Surely!!!
I agree. I happen to be one of the first people, to have subscribed to his channel. I'm a huge fan of his.
i like the way the background is being cleaned up... and looking more professional. but, that being said, i don't care what the background looks like as long as the content continues to be so highly interesting and well done.
Now that's a badass remote! Endless possibilities, Nice work!
I love all these projects and that you make them available open source. Just one thought though: It would be nice if you could also provide a BOM. Like what are the joy sticks? What are the buttons? Where did they come from? Keep up the awesome work!
I love this idea and would like to reproduce it for my own projects. Is there a parts list for the components that are used in this build?
Instead of publishing a Twist and some separate topic for the buttons, you might want to just publish a Joy-message, specifically made for joysticks. There's a joystick_teleop node that ingests that and outputs /cmd_vel. That setup allows for remapping of the buttons and axes. Also takes care of the deadzone, scaling etc. There's a joystick node that uses in a Linux joystick device to publish Joy-messages. Then, you can make your handheld controller act as a normal joystick device via the Teensy. That way, it'll also work as a joystick if you plug it into a Windows machine, as it's then just a normal plug-and-play joystick device
Thx. Always over the top; and always explaining things so well. I love all the details you offer, and insight into your design thoughts.
James every single episode: Oh yeah, it’s big brain time
Do you have any code showing how to move motors on a client requesting servo angles from a server via tcp or udp? for example, I am trying to use a pi as a webcam, do some color tracking on the jetson nano, and send the angles back to the same pi with the camera, which is attached to the servos. A remote tracking cam. I have the video working, and the servo angles outputting. I can bind the socket, but my while True loop locks up when I try to create a data connection.
I should know this, but I should also learn ros. This looks very practical.
I would publish values from 0-1 from the remote. The subscriber (in this case the robot) should then map these to speed values.
i love your videos but it makes me realize just how simple i am lol, i have tinkered with this stuff but you are on another level
I like it. It reminds of the controllers they used in the movie, Real Steel. :)
In love with the amount and quality knowledge you share with us thank you❤
Maybe I missed it, but why did you use the teensy to connect to the buttons and joysticks instead of just using the GPIO already on the Raspberry Pi?
The raspberry pi has no analog inputs. The joysticks need them so he needs some kind of "converter"
ROS sounds like it could be a pretty good base for a home automation project, cheap easy touch screen control panel in every room which can all share data and then you can either pass that data to other services or set up "robots" to control appliances/lighting.
Yes it's pretty much just a framework, so you could control anything with it.
A dedicated hat with the Teensy and all I/Os and connectors (I²C, SPI...) could be nice, to avoid USB cable (by directly using the serial port on GPIOs), and allows further developpements.
I don't know much about the ras-pi hardware/software, but having direct IO access might also help reduce latency.
hey first of all thank you for your video i realy like them, juste wanted to know what os run on the raspberry pi in the remote
What type of wireless connection do you use? wifi? bluetooth? Is it possible to use nrf24l01 or LoRa?
thanks for sharing all this knowledge with us, you are the best! :)
How is the information from the joystick, computer and robot transferred? Is the ROS system "conversing" over WiFi? Or Bluetooth? Or something else? I'm relatively new to ROS and I've only sent information over USB and Ethernet cables.
Such a strong Lemmings vibe from the printing music this time :D
Hey James! There's a ROS topic called sensor_msgs/Joy that has an array of floats for the axes and an array of ints for buttons/switches/states. Might be something that could be pretty useful for this application!
How much cost your robot dog RTR with controller and preprogrammed? Please let me know thanks have a good day
Where can I get those joysticks?
do you ever hear about i/o expander ic you can even make a controller with attiny85 and a I2C io expander
I want to build something like but have the device function both as a game emulator and a controller any leads on it?
@james: What was your source for the three-axis joysticks?
Another advantage of 1, 2, 4 and 8 being bits on an int, is that you can press multiple buttons at the same time, and would send something like 3, which would be 1 and 2 being pressed together. Where if you sent 1,2,3,4 for each button, you would never know if 3 is button 3, or 1 and 2 at the same time, so you could never combine buttons.
This ROS stuff is looking amazing! I'd never have imagined that a distributed OS would be fast enough for real time controls but apparently not!
One thing I'd be a little concerned about is if the remote runs out of battery while controlling a robot, in case the robot disappears off into the distance with no way to stop it. Implementing a heartbeat/watchdog timer from the remote to say "hey, i'm still here!" that the robot subscribes to, and automatically shuts down if it doesn't receive the message after a timeout?
Yes that's a good point. That could just be another ROS message on repeat.
Thats how world makes beter and beter ! This wil be useful for my other robots
I was thinking how great it would be if you would make a Puzzle Box. Like the ones on the channel of Chris Ramsey. That would be so fricking awesome. To see your mechanical skills in a Puzzle. Maybe you could do a collaboration!
Hey @jamesbruton have you any plans to update the remote?
Nice clean prints compared to when i started watching your videos. I spend way too much time aiming for perfect quality for final prints.
Why not use HID to send the joystick and button values over USB natively?
I hope to do this in my upcoming Open Source Hardware GIS Drone (Fixed Wing)
Very good work and cool
You should add a d-pad, one extra button and shoulder buttons. Then it'd be a good retro pi handheld :D
He is very talented.
You do not need the sda and scl wires. I2C goes over the DSI cable. You just need 5V, GND and DSI ribbon connected. EDIT: only pi 1a and 1b required separate I2C connection.
How do you power raspberry pi?
you could also put a microphone and do vocal instruction trough the pie
great upgrade to the remote. what are the details on that touch screen? do you have a link
Something like this would also be great for making a portable RPI emulation console, just swap out the joysticks for ones from a regular game controller and maybe tweak the design a bit to accommodate a dpad.
Never heard of ROS Serial before. Sounds neat! Also you could use the power of 3D printing to make it more ergonomic than that shoebox shape lol
Why not hinge the keyboard and or trackpad/mouse off of the workstation?
Hi! How can I learn to program things like that?
Nice looking JoyCons
Is there a video about the everything remote? i cant find one unfortunately.
Somewhere in the start of the openDog (original) series
@@jamesbruton Thank you!
Where did you get the joysticks from eBay on returns gaming joysticks or PS2 ect
What joysticks do you use?
Looking good. Man I should have used those joysticks on my robot controller. Any idea on how easy they are to mod into throttle style sticks by extracting the tension springs? Needed throttle sticks on my 34 analog input controller but would have been nice to have a bit larger sticks like what you are using.
Amazing idea for a controller! I have a suggestion, it would be really nice if you could make some diagrams to show how the RPi interfaces versus the Teensy over serial with the rosserial as protocol and so on, it would make the understanding much more easier. Looking forward for you to push the designs!!!
The Rosserial Node runs on the Pi, it talks to the Arduino/Teensy over serial using the Rosserial Arduino library
@@jamesbruton Some nice diagram with devices and protocols would help, you can take some tips from Andreas Spies, he is a master of concise and simple explanations.
When do we get an update on ROS robot butler!?!?!?
Next week!
I probably would've stuck with a dedicated radio link like the nrf chip so that when you pipe lidar or image or tf data to the pi screen it doesn't delay your control inputs
Or have the option for both.
I think you are one who didn't believe in small size is great projects or to look cool, large projects are also look cool 🤟🏻
i've worked with Tkinter for some things and that worked great. i also saw some nice things made in Dear PyGui
This is really good stuff. I'm curious as to wether or not this controller could be used, for driving a small, electric vehicle. Like a remote control, go kart. 😊
So im assuming that you are using ros melodic on the workstation are you having any problems if you use kinetic packages in melodic ?
I can't say I've specifically tried it, Melodic support is pretty good.
@@jamesbruton thank you so much for replying pls do more amazing videos like this 🥺.
You can use ESP32 with micropython firmware. It has analog and digital pins, which can be assigned as inputs or outputs. Check also M5 stack core 2 or other ESP32 boards.
would you ever consider building D-0 from star wars ep. 9?
Could you recommend to me a 3d printer?
Aragafar everything is so chunky! My brain is crying everytime
Hi James, Can we use arduino ros library directly on teensy boards?. or is there a separate fork for that?
Yes, but by default it only works up to Teensy 3.2. Use the one I hacked for the RUR which goes up to Teensy 4.1: github.com/XRobots/ReallyUsefulRobot/blob/main/arduino/ros_lib_modified.zip
@@jamesbruton Thanks a lot james! what is the main issue for 3.2 + above boards that needs library upgrade.
Need to make one of these myself
Very Good!
i want a circuit diagram of remote
Omg you made a nintendo switch :D
This is looking sleek :) Cant wait what you do with it.
Which joysticks are those. they look like really good quality kit. have you got a link to them online?
Just look for '3 axis joystick' on eBay - they cost about £10 from China
thanks bud i found them. im think theyll make a great thruster controller for elite dangerous. sort of NASA style
Love your work!
Ho, A new video ! Bam, Instant like !
Ob my first projects I used PyGame as well.
PyQT with QT Designer could be a better option for you programming an GUI instead.
The generalisation ROS appears to provide seems to make everything else overly complex.
Great Controller!!!
Can you share the link of the joysticks?
Where could I buy the 3DOF joystick??
I just put "3 DOF joystick" into Amazon and there are tons of them.
@@Scott_C thank u 😁
@@albertolr98 also eBay may be a good source
www.ebay.com/i/302526181730?chn=ps&norover=1&mkevt=1&mkrid=711-117182-37290-0&mkcid=2&itemid=302526181730&targetid=934793862176&device=m&mktype=pla&googleloc=9008143&poi=&campaignid=10460106669&mkgroupid=106723175187&rlsatarget=pla-934793862176&abcId=2146001&merchantid=118841012&gclid=EAIaIQobChMIqvqTtsW-7QIVDYrICh1fBAe3EAQYASABEgJ14PD_BwE
**comes to comments*, *sees people typing numbers**
> sees people typing
Are you sure those aren't *bots* typing?
@@vallisparmentier9764 are u sure ur not a bot ?
Quality 🤩🤩🤩
Hey James, great video! Have you heard of RemoteXY? its an app based remote control for bluetooth arduino devices with a customizable gui..
why don't use the teesy serial to rpi serial、this sol may be more reliable
Amazing
You can get a 3/4G and SIM hat for the PI.
Do you have a like for the joystick 🕹?
Isnt this just a nintendo switch?
Hi James,
if you connect the Teensy directly to the Pi GPIO Pins you could use one of the internal UARTs for serial connection. The Pi 4 has enough of them ( www.raspberrypi.org/documentation/configuration/uart.md ) and you could save space and a usb cable ;-)
Awesome.
So cool
i thought it was nintendo switch mod from the thumbnail
I thought so, myself. I then saw the size of the thumb sticks. It's the Bruton, robo - pod. 👍
Why not hack a old PSP to run a ROS Node. You get a screen, a joystick, a d-pad, XO buttons etc and Wifi