Making Servo Robot Eyes for YoLuke Webcams - Izzy
Вставка
- Опубліковано 18 січ 2020
- How to make a pair of servo motor controlled robot eyes for YoLuke webcams, resulting in a robot that sees! These are for my robot, Izzy.
Subscribe so that you don't miss new videos as they come out ua-cam.com/users/rimstaror...
Go to the main channel page here / rimstarorg
If you want 3D print these eyes then you can. They're available on Thingiverse here:
www.thingiverse.com/thing:412...
See also:
Convert ATX Computer Power Supply for USB
• Convert ATX Computer P...
Making a Servo Controlled Eyeball for Pi Camera 2
• Making a Servo Control...
Here's where I bought my YoLuke Webcam from:
www.amazon.ca/dp/B016MPIFWQ/r...
Follow behind-the-scenes on:
Twitter #!/RimStarz
Google+ plus.google.com/1163951251362...
Facebook / rimstarorg
rimstar.org - Наука та технологія
Long time no see sir......nice to see u again...
Great breakdown! Such positive, easy to understand, and comprehensive videos, keep up the great work and thanks for sharing!
Please make more videos. This is literally my childhood favourite channel lol.
It's always a good day when Rimstar uploads a new video. As always, well done--thumbs up!
Thanks!
It is good to see another video. I hope everything is going alright on your end. A lot has happened over the past year but, I am glad to see that you are still around.
I see that you have entered a very advanced technology
It's been a billion years since your last upload.
😂🤣
First upload in a year? I forgot I was subbed. Glad to have you back
same same
Thanks. It took a while to get up to speed on my new job (teaching for BlackBerry QNX) and then as you can imagine, it took a while to get this project up to this next stage.
Wow! Looks pretty amazing!
Thanks!
Nice to see you're back.
Happy to see you back, and this is reeeeeeeeally interesting: In the last months I've started too experimenting with Arduino, so I'm quite curious to make some experiment by myself 👍
Yeah, the Arduino's a good one to play around with. It's fairly simple to get something working whether it's an LED or two, a switch, a servo motor or a neat combination of them all!
I have found my childhood favorite channel again.
Bruh if you were my teacher I'd be more wiling to learn since you discuss this so well
Nice to see you back. And I like the differential control as mentioned at 7:00. Nice work.
Thanks. Do you mean the algorithm where I pick a point in the room relative to a point between the two eyes and then calculate servo positions from that? Yeah, I figure when you have two eyes that you want to have looking at the same object, a good way to guarantee that is to start with the single object and work back from there.
Welcome Back Legend
We missed you
Welcome back!
Long time no see!
Happy to be able to give you all something new to see!
Awesome project, definitely already has personality. kinda reminds me of that ventriloquists skeleton dummy where the eyes suddenly focus on the audience.
The Legend Is Back!!
About time!
@@keghnfeem4154 Yesss
Hello sir glad to see you again with your new video.
Glad to see you back! Yay!
Good to see ya back
Yay thanks for information about TEA laser and corona motor, a few months when i watched your video i had no HV power supply but now (after some finishing)i am finally able to make 20kv and test TEA laser an corona- thanks for high quality content, such a gemstone channel
Thanks for watching the videos. I'm glad you found the information helpful. Keep in mind I also found that I could power the TEA laser using just a Wimshurst machine, though you have to crank it for around 20 seconds before it fires ua-cam.com/video/9huUsYDJZrM/v-deo.html (I edit out the long cranking time in the video).
Omg, you're alive!😁
Yup! But I never really left. I've been answering 5 to 10 questions in comments to videos every day this whole time.
Dude, make a stereoscopic 3d (cross eye3d or crossview3d) video with your robot eyes.
I thought about that too after I had it working. I was watching a behind-the-scenes video of Peter Jackson talking about the 3D cameras used for the Hobbit and realized I'd already built a crude version of them. It would be interesting to see how well it would work.
Thanks for uploading again! Your videos are getting better and better. Still miss your old videos on radio stuff though, love how inspirational they are, despite the simplicity in their builds. Would you be posting any RF stuff again?
Thanks. There are a few things I'd like to try, such as lifting an antenna using a kite or balloon and getting a galena crystal for a detector but I don't know when I'll get a chance.
Wow, both ideas sound super exciting! I really hope you get your hands on the Galena crystal soon coz a Galena crystal radio project would be totally epic!
Skynet take note. lol
Thanks for everything but most importantly knowledge. The torque is far on servos motors. You have a phenomenal presentation and project. The voltage must be turned down as it reaches the servos extremities (when robot looks up and down, left and right) to prevent jerking of the robot. You have very powerful motors for small masses, the motors must compensate for the inertial forces. I learned a lot from your video.
Yeah, I'm a little torn about the torque. It does jerk the head around and I've considered adding acceleration and deceleration. But human eyes do the same thing, they only move with rapid moves. They only seem to move slowly, for example, when scanning a scene. But really the movement is made up of multiple quick movements. Maybe once I have a bulkier robot head, it won't be as noticeable.
welcome back man , its been a while
Impressive
good idea. i did not think of that. minicomputer robot with webcams as eyes. that probably could work.
Thanks a lot...its very useful.
My pleasure. I'm glad you like it.
nice sir you could even add object recognition, object tracking and face detention
I'm working on it. It's slow going because I have other things happening too. I at least have the camera drivers working and am displaying the output using the GTK toolkit to verify that they're working. I did do object recognition and reacting to changes in the field of vision (here ua-cam.com/video/K9PUCmdXlQc/v-deo.html) back in earlier versions that used a single Pi camera. For the object recognition, I didn't make a video for here but I did write an article for one of them here hackaday.com/2017/06/14/diy-raspberry-neural-network-sees-all-recognizes-some/
this is cool
Welcome back
Woot!!!
Big fan sir
Your knowledge of electronic is amazing, I am trying to read them by my own, what suggestions you would give to me about how should I study and what should be my thinking process while gaining knowledge about them.
I would love to know this as well because I have so many ideas but so little knowledge
bravo
AWESOMEEE
Is it possible to use wheels to make the eye move?
this is very cool
Thanks.
Any thoughts on making more videos about your bb8? I have just bingwatched it all and am wanting more. It's really impressive
Thanks. I'm glad you liked it. I look at it sometimes and wonder at it myself. I guess anything can be built as long as you do it one step at a time. I'm moving on to this Izzy robot and with my limited time, I don't think I'll be returning to BB-8 anytime soon.
Hi Steve. These videos are really interesting. Beyond my capabilities but interesting nonetheless.
Hi Candice! Thanks, I'm glad you like them. I'm back working full time (same work as before) so I don't have time to do as many as I used to but I do what I can.
if it has eyelid, it gonna be perfect
I literally just now finished assembling the previous iteration of this setup from your older video; before discovering this new video! It worked amazingly well :D
I can now see how your new changes and upgrades come in handy - could you share the updated files on thingiverse?
Currently i'm working on an underwater ROV for a university project, powered by arduino and raspberry pi, and this was such a perfect and simple solution!
That's awesome! I'd love to see it if you have it online somewhere or even if you just email me a photo. No worries if you can't.
I guess the changes you probably like best are the stops for keeping the eyeball from going too far. They are designed to stop at angles which match that of the human eye (roughly 45 degrees left, right, down and 30 up), which probably won't be the same for an ROV. Also, to work with a Pi Camera, the eyeball part would have to be redrawn a bit and I'm not sure it would work. The YoLuke webcam is much lower quality (okay for my application) and probably slower since the Pi Camera has a fast connection and makes use of the GPU on the Pi.
However, it took a little time but it's now at www.thingiverse.com/thing:4128076 in case you still think you can use it. The blender file is there too if you want to try adapting it for the Pi Camera.
@@RimstarOrg Thank you for your reply. I'll be sure to send you a pm when the project is done!
The deadline is in May, so it will be a couple months, but I will upload a video on my channel when its done.
The eyeball cam would be encased in a clear dome, so we might be going for 180 degrees field of view in the horizontal plane. Up and down might not need that many degrees.
Anyways I'll send you a pm when we have some footage!
And thank you for taking the time to update the files!
Thanks! I look forward to seeing it! Good luck with the project.
Hi sir , I have a request that please send the link of the codes of this device
Hello. Very nice material.
I am working in a similar project but using Ucams v1 from 4D systems. I noticed at least in the board and animation that I don't need two servos to tilt the cameras up and down, seems that only one is enough. Just the two servos for left and right side for each camera. Not sure if I am missing something in my calculations. I want to keep power consumptions as low as possible and that's why I will prefer 3 servos. I will see if I am right or wrong xD
I guess you could use only one motor for tilting both cameras up and down, I'm not sure I even considered trying to design that. I probably saw some of those designs when looking at animatronic designs but in those designs, the way the linkages were made to the motors always looked like the horizontal movements could cause some vertical movement and vice versa. For animatronics, precision isn't important. Also, if you weren't trying to fit it inside a human head like I am then I guess it would be pretty easy to make it work.
nice work Steven, same as usual, what was the one year delay about ? how are you holding up? , keep the projects coming friend.
Thanks, Samimy. I started working fulltime again just over a year ago and so I haven't been doing videos since then. There's only so much time in a day. Still having fun though since my job involves teaching.
At this point I think tracking/facial recognition/eye contact is purely software. This hardware wouldn't have to change. Maybe there's some open source out there for it.
I’m trying to make The Funtime animatronics. All of them. For security
Thank you
Sir van de Graff top roller nylon can be used or not? Instead of glass roller
Electro boom has a homemade one aswell
I was wondering if you gave Izzy a face yet? I really like this video. Hopefully come out with a new video soon.
No, I got stuck trying to write from my Raspberry Pi to the Arduino Mega. I'm stubornly trying to use a USB cable so that I can also communicate from a desktop computer or laptop to the Arduino Mega. So I'm trying to do serial I/O over the USB cable. Doing reading works fine, but not writing. Every now and then I get another idea and try but no success so far.
Could use pixy 2 for slightly better results
I am making a social bot. I am going to use a cosplay silicon mask for the head. Still going to need to design a support for the mask, however. Going use an Arduino to control the eyes and for blinking.
Awesome. Sounds like a fun project. You probably want a simpler design for the eyes than I have here though. Look for designs for animatronic eyes. Animatronic eyes are always parallel, so they never both look at the same point in space but you don't notice it unless you look for it. They're simpler to build because they can work with fewer motors. Mine are designed to be able to both look at the same point in space like human eyes can. You probably don't even have to search for "animatronic" eyes since most are that type.
@@RimstarOrg I'm going to use a camera eventually that is interfaced with an NVIDIA Jetson Nano. Not sure where I'm going to mount the camera yet. (It only needs one) maybe a neck pendant so it doesn't look out of place! 😊 Thank you for letting me know about Animatronics, I will look it up.
I just watch one of your video publish 7 years ago about a Electrolytic capacitor i know why the negative side had a oxide layer because the oxide layer never touches the liquid there is another dielectric between the electrolyte and the negative side
I hope this helps a little
Are detailed construction plans, software code, and wiring diagrams available for this project?
I haven't done a detailed write-up. Most of it's in the videos. However, on my website here rimstar.org/science_electronics_projects/izzy_artificial_intelligence_robot.htm you can find the latest source code as well as where to download the files for 3D printing on Thingiverse.
Sorry for the delayed reply... UA-cam doesn't seem to be sending me notification emails lately.
THX
I just found this video and if it would be okay of me to ask could you construct one for my right eye?
Do you mean your actual right eye? That engineering is a little beyond me. Fascinating project though. There are research projects and even products out there for giving some level of sight back to people who are blind.
RimstarOrg I was doing an internet search for technological robotic eyes and I had a plan to at least re-fix half my vision as a pose to almost not seeing anymore so I figured I’d take a look at what I could find
I hear you. I have some macular damage along with other sporadic macular dimming which makes me need bright light to be able to read fine print. If it ever gets bad enough then I'd be looking for a solution too.
Sir put some new video about amateur radio building
what operating system do you use?
The NVIDIA TX1 board has Linux ubuntu-desktop 4.9.140-tegra on it. I have to use that because it comes with the drivers for that board.
@@RimstarOrg oh I see.
are you going to put servos in the focus rings?
I'd like to but for some unknown reason, I want to keep it all fitting inside a human-size head. Knowing the focal distance to an object would allow for knowing the distance to an object with only one eye "open".
Can you make a video about crystal radio with less diameter of roll and less turn cause i don't have that much wire in home .By the way this video is awesome
Sorry I don't know that you have video about lc resonant circuit
Can you tell me in which machine i can find germanium diode
I don't know of any machine that has germanium diodes. Silicon diodes are used most often in machines (which are not good for crystal radios). You can find them cheaply on ebay.com, just go there and search for "1n34a". That's where I get mine.
Rimmy when will you make a spark gap transmitter and receiver?
Probably never. Those things are electrically noisey (on purpose) and I don't think my eyes can handle too much more UV damage from sparks :-).
Yeah they are very noisy and a bit annoying, I made one with a boost converter I bought online, I already created the coils the button and the antenna even added a ground connection, but I still haven't made a receiver lol🤣 that's why I'm here. I really don't know what to receive the signals with
I guess a quick test would be to use a normal radio -- you'd probably hear extra static when you turn on your transmitter. But other than that, I don't know. It does sound like a fun project though.
Sending you a separate email as I am fascinated with this and wondering if you progressed any further. I have one eye made and am working on the other but would love to have it as the head and have the camera eyes follow movement.
I'll answer here so others can see but we can talk in email too. I've been working on the software side of it every now and then. It's all still very much a work-in-progress though. I'm using Video for Linux 2 (V4L2) to get the input from the YoLuke cameras. And I'm working on displaying the images using GTK. That's about where I am now.
You need to fix the angle so you it can easily looking some where
Do you mean to connect the cameras so that they are synchronized to always look using the same angles? That's the way animatronic eyes do it but they don't usually have cameras. What if the object is very close in front? Then the cameras will have to be a different angles to look at it.
@@RimstarOrg i guess yes or maybe...
@@RimstarOrg interesting
What if you made an eyeball that had irises and put the lens in it?
That would be the ideal. As human as possible. The lens should be deformable for focusing, just like a human eye.
Hy. Can you please share how can I make it
The files for the parts are all here www.thingiverse.com/thing:4128076 Once you've printed them then use this video as the guide.
@@RimstarOrg ok thans a lot☺️
Could you provide the Arduino code that you used, Please ........
vharsha.2009@gmail.com
So its possible to put cameras in animatronic eyeballs?
It should be possible given the right design. The tricky part is fitting the camera in the eyeball. Also, when people say "animatronic" eyeballs, the eyeballs are usually parallel, they don't move independently like mine so they can't fixate on the same point in space. The same object may still be in both camera images but the both cameras won't be looking directly at it.
@@RimstarOrg ohh thanks for letting me know
use camera from old laptop, models younger than 5 years have decent 1080p cameras and you can buy them for peanuts. All of them are USB and they are tiny.
Thanks for the tip. I'll keep an eye out for one.
@@RimstarOrg I use them in many projects, for example just now for the automation of my co2 laser.
More BB-8 or expected date?
I'd like to but there's only so much time and I've had to move on. So I'm working on the robot in this video instead.
@@RimstarOrg ok :)
How much your bb8 costs?
Not including all the parts that I already had, I spent around $236. You can see the parts list of what I bought on my website here rimstar.org/science_electronics_projects/bb-8_v2_parts_list_bill_of_materials.htm
Wonder if you've got anything new.
I was stuck for a long time trying to do serial writing and reading over a USB cable between a Raspberry Pi and the Arduino Mega. I only recently figured out the trick to making it work reliably (as part of setting up the serial port on the Pi, clearing the line to reset the Arduino's side by setting and then clearing DTR). I've also managed to do the same from a Windows desktop. Next I'm trying from an NVIDIA Jetson TX1 board that I bought a while ago. Once I've done that, I can move onto processing the camera images on one of those three.
@@RimstarOrg oh man, I can't wait for the jetson integration. Looking forward to it.
Let's hope it works then! I'm not sure how well the serial will work through the UBS hub -- the Jetson TX1 has only one USB port and so I need the hub to get more.
@@RimstarOrg please keep making this videos they are really so nice i have achieved in making an ornithpter because of you thank you!!
No new videos?!
I'm working on one now. It should be out in week or so. Thanks for asking.
@@RimstarOrg I'll subscribe then, do you know anything about building controllers to drive the edrum motors on teslas plasma energy? I'd like to see some videos on that. You know how he made it don't you? Not being a smart alex, i am curious. You seem to know a lot about electronics, but i just saw one of your old videos and haven't watched them so im not sure wether you do or not. Im hoping someone will take the time and build a free energy generator using his plasma energy to achieve the 9000 plus rpms to power a transformer and get us energy independent.
Nope, I haven't heard of that and haven't had time to pursue anything in that direction in years.
Hanzhen harmonic gear , over 30 years experience , robot gear reducer,
Make a full animatronic
...nothing
Tf
can izzy read
Izzy can't read but I do remember checking how well the cameras could display a page of text from a book and the letters were perfectly clear. So the image can be given to a program that can turn that image into letters that I could then give to another program that turns them into speech which I could send to a speaker so you can hear it.
I did a similar thing with a Pi camera once, though I gave it objects to recognize and not text. But it "spoke" the names of the objects it recognized. I wrote about it in an article here hackaday.com/2017/06/14/diy-raspberry-neural-network-sees-all-recognizes-some/
great then make a video about it
It's too out-of-date. The object recognition took around 10 seconds back then. Newer software can do multiple in a one second. Anyway, I'm getting close to having both of Izzy's "eyes" recognizing the same objects and locating them in 3D space. Still hunting for the best software though.
EDIT And I'll make a video once I have that working.
@@RimstarOrg GREAT
Welcome back!
Thanks!
@@RimstarOrg thank you for reply I appreciate please restart our channel so all our subscriber can get knowledge I'm waiting 😇😇😇😇😇