From what it seems, the recognition is based in a kind of motion detection. You have an open-cv function for that and there's an youtuber called sentdex that has some very nice tutorials on that! About making the laser pointing to your target I don't know much on the topic, sorry...
@@VascoCC95 yeah sure, I didn't want to insinuate a comparison. In that case, do you know which is the optimizer way to program object detection in rp???
@@alvaroboven Well... You are lucky because I JUST ran a test on a RP and I got average 12,7 FPS. I used OpenCV's HAAR Cascade for face recognition in a RP 4B with 2GB RAM. I installed OpenCV via the link's tutorial and placed the haar file "manually" in the project's folder. www.pyimagesearch.com/2018/09/26/install-opencv-4-on-your-raspberry-pi/
The object is about 1.7 meters high, and it is on the ground, so from en.wikipedia.org/wiki/Pinhole_camera_model, calculate intersection of a line (from camera positon calibration) and ground plane , you can get the positon of the man. then point your laser to him.
Did you make your own closed loop system? Looks like you used DC motors and pots. Nice work! Though, the music seems a little off for a person tracker :)
Hi Andy, This project look's very cool and perfect :). How you established the connection between the raspberry pi module and arduino to share the object coordinate information.
Great work there! I am working on a somewhat similar project, I would be very grateful to get your insight as to how exactly did you manage to get this working. Could you please brief it?
Hi there, I was wondering how did u make the laser point to the real position of a person. I'm doing sth sort of similar with urs, projecting images on the back of one's palm. For the projection part ,I selected the area of projection in camera and then corrected the perspective of this area. SO I can just draw at the perspective corrected coordinate in my projection area. But how did u get the right rotation for a real world position. Thanks.
How was ur experience with rasp 3 in terms of speed while working with opencv ? I have rspb 2 model b and using a simple color detection it would slow the processing around 3-5 fps . I hope u get my question sorry for my English .
the fact that this video showed up on my recommended just know. I'm literally making a yt series on making a nerf gun turret that uses open cv to aim and shoot darts at ppl.
So I see that you've used C++... I've been trying to code with OpenCV and C++ for quite some time but I can't seem to figure out what IDE to use (if any) that will make it easy to use with OpenCV (building/path to the libraries gets really annoying). Are you using Code::Blocks, Geany, the Linux Terminal, or just your favorite text editor? Just curious if you're around 🤔
The cool thing to do is put the camera where the laser pointer is and have the camera move so as the object that is tracked it is always drifting it back to the center of the screen. Now you have an auto tracking gimbal like soloshot without a tag. I don't think distance is being calculated here, because the camera is fixed the image the movements of the laser are limited to the fov and so the laser moves in relation to the center of the image. It probably took trial and error of some sort to move the laser to the correct extents of the image and distance is irrelevant. You would need additional data (gps) to calculate distance.
funkyfreestyler thanks for your comment! True, distance was not calculated here and was irrelevant. The aim was to only have the laser point at the middle of an object in the fov of the camera. Having a moving camera would mean I would have to change my method of image processing as I made use of the ‘steady’ background.
DROIDii1 Yeah, on a serious note on your number 4... how would a system like that distinguish between hostile and friendly individuals? One way I see it is by marking friendlies with an IR emitter, but that wouldn't do in a military situation where this would denounce the operative's position on the enemy's NVGs. It could be used though if it is stationary and it has to protect a perimeter AFTER a certain limit (as this can be easily programed in OpenCV), limit within which there can be safe movement of troops.
@DROIDii1 this would be true for a static camera facing a fixed scene. But won't it be problematic for a moving camera which has to deal with a changing background scene?
I could see how this would work with a moving camera. You would basically keep panning/tilting until the object is centered, but how does this work with a static webcam? I am truly puzzled by this.
Are you talking about tracking the object (or in this case, person)? If so, then I haven't heard of anyone doing this in the method you provided, panning/tilting until the object is centered. How this was done, was using the open sourced OpenCV library by intel. You feed it some input, a video frame, and then it analysis the frame using a series of algorithms to determine the location of the object.
+Willyam Adhi Hi, i recently bought two optical scopes, i already made an adapter to mount my smartphone on it (digi-scoping), works great. Next step in the project is to make a pan & tilt for the scope(s) and use the pi camera instead of the phone. Then stream the image via a web server on the pi. Then i created a remotely controlled extreme zoom webcam... i live in a high building with great view... So i need 2 (or 4) servo's for the pan & tilt, the spotting scope weight is 988 gram, but in balance, i dont think it's hard work for the servo's. What's your plan with the pan & tilt system? Regards, Bastiaan
Bastiaan Klaasing hi, that is cool project. Mine is just like yours but it's focused on surveillance. So I kinda need smooth pan & tilt but also compact in size. I'm still working on it
Hi, I am designing a motion tracking project with raspberry pi. I will use it as a finishing project. I want to get information about the laser project. can you help me.
Hi guys, nice work! I'm trying to get OpenCV installed on a Pi3 and keep getting errors. Are there any docs or tutorials on the install that you could point me towards?
In case you still need it or anyone else is looking for a step by step: www.pyimagesearch.com/2016/04/18/install-guide-raspberry-pi-3-raspbian-jessie-opencv-3/
Easy man.Substract background picture from recent picture than get moment of substraction.Can you do it moving background with two similar object or more :)
I am using shape descriptors or their combinitions.Some times i am coding some times iam using opencv But the key is to find invariant features of the shape.In opencv you can find some of them like sift,surf,blob.Then elemination of redundant unneccessary features.Some moments like hu,zernike usefull too.Depents on situation.Good like my friend.
Hi, this is 2020 and this project still seems soo good. Can you please share tutorial on how you made hardware and software both? Thanks
I died from the music.
Crazy music
Music for my ears
My condolences
Name of the music
@@MadhuKumar-hi2qs UA-cam where by pewdipie
can you do a tutorial regarding how to do this please?
From what it seems, the recognition is based in a kind of motion detection. You have an open-cv function for that and there's an youtuber called sentdex that has some very nice tutorials on that! About making the laser pointing to your target I don't know much on the topic, sorry...
@@VascoCC95 Something incredible of this one is the fluent of the video. With sentdex tutorials, video doesn't exceed 5 fps
@@alvaroboven I'm not saying it is better than this one, I'm just helping him to understand what is behind the scenes and pointing to a tutorial
@@VascoCC95 yeah sure, I didn't want to insinuate a comparison. In that case, do you know which is the optimizer way to program object detection in rp???
@@alvaroboven Well... You are lucky because I JUST ran a test on a RP and I got average 12,7 FPS. I used OpenCV's HAAR Cascade for face recognition in a RP 4B with 2GB RAM. I installed OpenCV via the link's tutorial and placed the haar file "manually" in the project's folder.
www.pyimagesearch.com/2018/09/26/install-opencv-4-on-your-raspberry-pi/
This is rad!!! Any chance you could post a video on how you did this??? It'd be greatly appreciated!
The soundtrack is just awesome!
Very Cool the mechanism to rotate the cam seem very smooth.
Good job! I think a second image that closed up to the guy's clothes to show the red-dot intercepting it would have been a real winner.
The object is about 1.7 meters high, and it is on the ground, so from en.wikipedia.org/wiki/Pinhole_camera_model, calculate intersection of a line (from camera positon calibration) and ground plane , you can get the positon of the man. then point your laser to him.
great some guy walking around..
Interesting project. Would love to know more about the hardware used in this video!
Did you make your own closed loop system? Looks like you used DC motors and pots. Nice work! Though, the music seems a little off for a person tracker :)
what method are you using? Background subtraction, HOG, Haar or something else? Looks accurate!
someone knows each other and could tell what technology this gentleman used.
1:15 looks like background subtraction
I wonder how erratic this would be at low light conditions
Hi Andy,
This project look's very cool and perfect :). How you established the connection between the raspberry pi module and arduino to share the object coordinate information.
Why not use premade servo motors? What computer vision algorithm/pipeline does it use? Would it be confused by multiple people?
What is the laser doing in this setup? Is it used in the control loop or just a pointer? I assume the latter is the case.
What did you use for opencv? C++ or Python?
You can use either but Python is way easier
so much drama in the music
Great work there! I am working on a somewhat similar project, I would be very grateful to get your insight as to how exactly did you manage to get this working. Could you please brief it?
Add heavy metal music and nerfgun to project. Boom! :D good project yours
Hi there, I was wondering how did u make the laser point to the real position of a person.
I'm doing sth sort of similar with urs, projecting images on the back of one's palm.
For the projection part ,I selected the area of projection in camera and then corrected the perspective of this area.
SO I can just draw at the perspective corrected coordinate in my projection area.
But how did u get the right rotation for a real world position.
Thanks.
РЕСПЕКТ
How was ur experience with rasp 3 in terms of speed while working with opencv ? I have rspb 2 model b and using a simple color detection it would slow the processing around 3-5 fps . I hope u get my question sorry for my English .
what happens when second person appears?
Hi! What camera did you use? USB, PiCamera or what?
What is the purpose of the laser? How does it help the camera track the person?
what frame rate did you got for realtime detection
Next step: swap the laser for a gun and implement a firing mechanism
Already exists... Just join the army
😂😂😂 Absolutely 👍
the fact that this video showed up on my recommended just know. I'm literally making a yt series on making a nerf gun turret that uses open cv to aim and shoot darts at ppl.
would work well with paintball
This will be awesome for making movies.... with a camera instead of laser.
great job, congratulations
Is it possible to make this with Rasperry Pi Zero?
Bro What is your motors models. I watched 1080 and focused but I couldnt see :) I can see only RS
So I see that you've used C++... I've been trying to code with OpenCV and C++ for quite some time but I can't seem to figure out what IDE to use (if any) that will make it easy to use with OpenCV (building/path to the libraries gets really annoying). Are you using Code::Blocks, Geany, the Linux Terminal, or just your favorite text editor? Just curious if you're around 🤔
How is it going?
is this on github?
Great Job!! very impresive.
Bastiaan Klaasing thanks😉
Happy and smart New Year ;-) just a few hours left in Holland.. Keep it up!
how did you figure out how the degrees the servo had to move compared to the x y of the video?
Well done bro
Can u please make a tutorial having some details of your excellent project....
It will be very helpfull....
what language you used for the program? Also do mention if this is release build that is causing high fps...
Thankyou...
Asad Amin using C++. Working at 20fps.
Andy Eggert thankyou for the reply i figured that much. Did u used hardware acceleration?
Finally, great work... it gave me few ideas.
Asad Amin nope. Thanks
Asad Amin nope. Thanks
The cool thing to do is put the camera where the laser pointer is and have the camera move so as the object that is tracked it is always drifting it back to the center of the screen. Now you have an auto tracking gimbal like soloshot without a tag. I don't think distance is being calculated here, because the camera is fixed the image the movements of the laser are limited to the fov and so the laser moves in relation to the center of the image. It probably took trial and error of some sort to move the laser to the correct extents of the image and distance is irrelevant. You would need additional data (gps) to calculate distance.
funkyfreestyler thanks for your comment! True, distance was not calculated here and was irrelevant. The aim was to only have the laser point at the middle of an object in the fov of the camera. Having a moving camera would mean I would have to change my method of image processing as I made use of the ‘steady’ background.
How does it track the person (heat/motion/position/etc.) ? Can it track an object like a car or a drone?
yes you can , using image processing in OpenCV
DROIDii1 Yeah, on a serious note on your number 4... how would a system like that distinguish between hostile and friendly individuals? One way I see it is by marking friendlies with an IR emitter, but that wouldn't do in a military situation where this would denounce the operative's position on the enemy's NVGs. It could be used though if it is stationary and it has to protect a perimeter AFTER a certain limit (as this can be easily programed in OpenCV), limit within which there can be safe movement of troops.
can we have a code for the same?
or how to do it/?
@DROIDii1 this would be true for a static camera facing a fixed scene. But won't it be problematic for a moving camera which has to deal with a changing background scene?
New level of security
Hii
I am reall intersted i knowing how you calibrated the lazer so it can track human
It will be great if you share more abou this subject
I could see how this would work with a moving camera. You would basically keep panning/tilting until the object is centered, but how does this work with a static webcam? I am truly puzzled by this.
Are you talking about tracking the object (or in this case, person)? If so, then I haven't heard of anyone doing this in the method you provided, panning/tilting until the object is centered. How this was done, was using the open sourced OpenCV library by intel. You feed it some input, a video frame, and then it analysis the frame using a series of algorithms to determine the location of the object.
what laser did you use? can you tell me all the material that you use.
@Andy May I have the design files for the infrastructure of laser movement? Or can you please guide me where can I get it? Thanks
good one..
Wondering how would it work with AI..??
What is camera use for detection? Plss
Very Impresive, Congratulations! Any tutorial to replicate your work and Learn?
Hello how do you code to make it have a blue box thing.
is it possible to get a list of all the parts for a project like this ?
I smell military applications (dron rockets etc) in this tech and I can't say I m happy with that.
The military is far beyond this primitive tech, they have mini tank-like robots with mini guns mounted on them.
Hey, im interested on making this project do you mind sharing the tutorial how to make this?
What operating system do you use to do the project? Raspbian, ARCH LINUX, RaspEX, Rasp ARCH, Ubuntu, etc.
Frank PS raspbian
what motor are you using mate? please kindly reply, I wanna make smooth pan & tilt like yours
Willyam Adhi I am using geared DC instrument motors from McLennon.
Andy Eggert thanks
+Willyam Adhi Hi, i recently bought two optical scopes, i already made an adapter to mount my smartphone on it (digi-scoping), works great. Next step in the project is to make a pan & tilt for the scope(s) and use the pi camera instead of the phone. Then stream the image via a web server on the pi. Then i created a remotely controlled extreme zoom webcam... i live in a high building with great view... So i need 2 (or 4) servo's for the pan & tilt, the spotting scope weight is 988 gram, but in balance, i dont think it's hard work for the servo's. What's your plan with the pan & tilt system? Regards, Bastiaan
Bastiaan Klaasing hi, that is cool project. Mine is just like yours but it's focused on surveillance. So I kinda need smooth pan & tilt but also compact in size. I'm still working on it
How fps guys..? im wondering it gets fast fps tracking
Can you plz explain me how to do this I want to make one plz using raspberry pi 3 pls
Hey andy.
I am workinkg in a project that looks similar to your project. Can you please give me the details of your project?
great project!
Thanks!
Hi, I am designing a motion tracking project with raspberry pi. I will use it as a finishing project. I want to get information about the laser project. can you help me.
How does it lock the target?
Great project. Could you please share a code please?
Programming code is only private???
Hi, its 2024
we need it start the uprising of the machines
Hi! How far can detect? Thank you.
Please how did you do that ?
Actually, I am also working on a target tracking system. need your help is possible.
What shoul I learn for this types of computer vision. I mean I need the starting point.
python
LOVE the music
How fps guys,, i wondering it gets fast fps,, i doing same project but get low fps,, thanks dude
Can you put is up on a drone?
How does it prioritize multiple targets?
Toy Teardown hi. Tracks the biggest moving object.
wow, very clever.
Hi guys, nice work! I'm trying to get OpenCV installed on a Pi3 and keep getting errors. Are there any docs or tutorials on the install that you could point me towards?
In case you still need it or anyone else is looking for a step by step: www.pyimagesearch.com/2016/04/18/install-guide-raspberry-pi-3-raspbian-jessie-opencv-3/
I did this in 3 weekends except instead of a laser I had a flash light.
I guess now he or she is building battlebots.
Love it!!!
the guy on the motorcycle
i just can see your laser pointer ..I don't see the laser light ??!!
1:30
Neighbors used to walk in front of my office all the time now they don't because I blind them. With my laser
can i see the code? i so impresive. where we can now tutorial e
May we see the code ?
Easy man.Substract background picture from recent picture than get moment of substraction.Can you do it moving background with two similar object or more :)
bilen basarir can you sir??
I am trying to do last 3 years. The answer is %70 yes % 30 no with all situation.
What methods are you using? Also using OpenCV?
I am using shape descriptors or their combinitions.Some times i am coding some times iam using opencv But the key is to find invariant features of the shape.In opencv you can find some of them like sift,surf,blob.Then elemination of redundant unneccessary features.Some moments like hu,zernike usefull too.Depents on situation.Good like my friend.
Is it possible to see some of your work results?
Can you please give me the code of this project ?
I will be thankful if you will give me source code for it because i am working on same.
can i Buy the CODES from you !
cool
所以這部分做到的是追蹤對吧?
This is impressive and all but what's with the music..
would be faster track just with camera lol or is camera tracking and laser is just moving there ha
How to make guided missile under $300 for the next video.
Hello do you have scripts and instructions ?? I can buy $$$#
next up laser guided missile
Dope
Hello can you send or sell your code?
tutorial ? please
tutorial, please
Can you post the code?
it can be a weapon
Se ve muy bien
were code?
damn! cool!