Laser Tracking System -using OpenCV 3.1 and Raspberry Pi 3

[@supersonic2101]

Hi, this is 2020 and this project still seems soo good. Can you please share tutorial on how you made hardware and software both? Thanks

[@jeffbeck6501]

I died from the music.

[@zulqarnayeenschaftler9323]

Crazy music

[@FIREMAN-ff3cj]

Music for my ears

[@ANGEL-mb9yx]

My condolences

[@MadhuKumar-hi2qs]

Name of the music

[@jyotiradityakumar1174]

@@MadhuKumar-hi2qs UA-cam where by pewdipie

[@tashrif4444]

The soundtrack is just awesome!

[@junyang1710]

The object is about 1.7 meters high, and it is on the ground, so from en.wikipedia.org/wiki/Pinhole_camera_model, calculate intersection of a line (from camera positon calibration) and ground plane , you can get the positon of the man. then point your laser to him.

[@mxcollin95]

This is rad!!! Any chance you could post a video on how you did this??? It'd be greatly appreciated!

[@glegoo195]

can you do a tutorial regarding how to do this please?

[@VascoCC95]

From what it seems, the recognition is based in a kind of motion detection. You have an open-cv function for that and there's an youtuber called sentdex that has some very nice tutorials on that! About making the laser pointing to your target I don't know much on the topic, sorry...

[@alvaroboven]

@@VascoCC95 Something incredible of this one is the fluent of the video. With sentdex tutorials, video doesn't exceed 5 fps

[@VascoCC95]

@@alvaroboven I'm not saying it is better than this one, I'm just helping him to understand what is behind the scenes and pointing to a tutorial

[@alvaroboven]

@@VascoCC95 yeah sure, I didn't want to insinuate a comparison. In that case, do you know which is the optimizer way to program object detection in rp???

[@VascoCC95]

@@alvaroboven Well... You are lucky because I JUST ran a test on a RP and I got average 12,7 FPS. I used OpenCV's HAAR Cascade for face recognition in a RP 4B with 2GB RAM. I installed OpenCV via the link's tutorial and placed the haar file "manually" in the project's folder.
www.pyimagesearch.com/2018/09/26/install-opencv-4-on-your-raspberry-pi/

[@cosmicallyderived]

Good job! I think a second image that closed up to the guy's clothes to show the red-dot intercepting it would have been a real winner.

[@tinkmarshino]

great some guy walking around..

[@AlanMedina314]

Very Cool the mechanism to rotate the cam seem very smooth.

[@willzyxw1422]

so much drama in the music

[@kentvandervelden]

Did you make your own closed loop system? Looks like you used DC motors and pots. Nice work! Though, the music seems a little off for a person tracker :)

[@tuncfreeman]

Add heavy metal music and nerfgun to project. Boom! :D good project yours

[@kostasnikoloutsos5172]

New level of security

[@tha531]

This will be awesome for making movies.... with a camera instead of laser.

[@foti4822]

Interesting project. Would love to know more about the hardware used in this video!

[@laurentmichalski7171]

great job, congratulations

[@prakashchandran1416]

Hi Andy,
This project look's very cool and perfect :). How you established the connection between the raspberry pi module and arduino to share the object coordinate information.

[@bmk5019]

Great Job!! very impresive.

[@andyeggert8578]

Bastiaan Klaasing thanks😉

[@bmk5019]

Happy and smart New Year ;-) just a few hours left in Holland.. Keep it up!

[@duartedias3460]

Next step: swap the laser for a gun and implement a firing mechanism

[@VascoCC95]

Already exists... Just join the army

[@carunyazx950]

😂😂😂 Absolutely 👍

[@MilesVranas]

the fact that this video showed up on my recommended just know. I'm literally making a yt series on making a nerf gun turret that uses open cv to aim and shoot darts at ppl.

[@BlensonPaul]

would work well with paintball

[@TheRealJackfrog]

LOVE the music

[@KulbirAhluwalia]

Well done bro

[@TheSephrn]

what method are you using? Background subtraction, HOG, Haar or something else? Looks accurate!

[@FIREMAN-ff3cj]

someone knows each other and could tell what technology this gentleman used.

[@Brickkzz]

1:15 looks like background subtraction

[@Brickkzz]

I wonder how erratic this would be at low light conditions

[@mahirshafiyev9863]

what happens when second person appears?

[@mysteriouslymysteriousmyst9139]

great project!

[@andyeggert8578]

Thanks!

[@sayomshakib4965]

Love it!!!

[@IDoNotLikeHandlesOnYT]

Why not use premade servo motors? What computer vision algorithm/pipeline does it use? Would it be confused by multiple people?

[@navar45000]

The cool thing to do is put the camera where the laser pointer is and have the camera move so as the object that is tracked it is always drifting it back to the center of the screen. Now you have an auto tracking gimbal like soloshot without a tag. I don't think distance is being calculated here, because the camera is fixed the image the movements of the laser are limited to the fov and so the laser moves in relation to the center of the image. It probably took trial and error of some sort to move the laser to the correct extents of the image and distance is irrelevant. You would need additional data (gps) to calculate distance.

[@andyeggert8578]

funkyfreestyler thanks for your comment! True, distance was not calculated here and was irrelevant. The aim was to only have the laser point at the middle of an object in the fov of the camera. Having a moving camera would mean I would have to change my method of image processing as I made use of the ‘steady’ background.

[@prakhardixit1597]

Great work there! I am working on a somewhat similar project, I would be very grateful to get your insight as to how exactly did you manage to get this working. Could you please brief it?

[@ianchan2624]

cool

[@ahmeta.112]

What did you use for opencv? C++ or Python?

[@kalebakeitshokile1366]

You can use either but Python is way easier

[@lol-et1fz]

РЕСПЕКТ

[@amitgoel6830]

Can u please make a tutorial having some details of your excellent project....
It will be very helpfull....

[@gomenaros]

I smell military applications (dron rockets etc) in this tech and I can't say I m happy with that.

[@montanacaleb]

The military is far beyond this primitive tech, they have mini tank-like robots with mini guns mounted on them.

[@programming_hut]

what frame rate did you got for realtime detection

[@fernandorivdev1389]

Very Impresive, Congratulations! Any tutorial to replicate your work and Learn?

[@gnimoay7489]

Hi there, I was wondering how did u make the laser point to the real position of a person.
I'm doing sth sort of similar with urs, projecting images on the back of one's palm.
For the projection part ,I selected the area of projection in camera and then corrected the perspective of this area.
SO I can just draw at the perspective corrected coordinate in my projection area.
But how did u get the right rotation for a real world position.
Thanks.

[@MrProzaki]

How was ur experience with rasp 3 in terms of speed while working with opencv ? I have rspb 2 model b and using a simple color detection it would slow the processing around 3-5 fps . I hope u get my question sorry for my English .

[@heel57]

What is the laser doing in this setup? Is it used in the control loop or just a pointer? I assume the latter is the case.

[@wobbuffet8791]

I could see how this would work with a moving camera. You would basically keep panning/tilting until the object is centered, but how does this work with a static webcam? I am truly puzzled by this.

[@Schmuck]

Are you talking about tracking the object (or in this case, person)? If so, then I haven't heard of anyone doing this in the method you provided, panning/tilting until the object is centered. How this was done, was using the open sourced OpenCV library by intel. You feed it some input, a video frame, and then it analysis the frame using a series of algorithms to determine the location of the object.

[@sachingarg8429]

Dope

[@burakhandogan2856]

Is it possible to make this with Rasperry Pi Zero?

[@spencer998]

So I see that you've used C++... I've been trying to code with OpenCV and C++ for quite some time but I can't seem to figure out what IDE to use (if any) that will make it easy to use with OpenCV (building/path to the libraries gets really annoying). Are you using Code::Blocks, Geany, the Linux Terminal, or just your favorite text editor? Just curious if you're around 🤔

[@diegooriginalesmontoya5863]

How is it going?

[@jui-yanghsieh381]

What is the purpose of the laser? How does it help the camera track the person?

[@Omkar_Srivastava]

Can you plz explain me how to do this I want to make one plz using raspberry pi 3 pls

[@edinsonst2939]

Se ve muy bien

[@mm168mm8]

i just can see your laser pointer ..I don't see the laser light ??!!

[@oSJmee]

I guess now he or she is building battlebots.

[@XwitterEye]

the guy on the motorcycle

[@Quarkburger]

I did this in 3 weekends except instead of a laser I had a flash light.

[@jean-pierregergie1847]

Hii
I am reall intersted i knowing how you calibrated the lazer so it can track human
It will be great if you share more abou this subject

[@pokerspace_pro]

damn! cool!

[@weswest2654]

How does it track the person (heat/motion/position/etc.) ? Can it track an object like a car or a drone?

[@nextronicCasablanca]

yes you can , using image processing in OpenCV

[@danielf950]

DROIDii1 Yeah, on a serious note on your number 4... how would a system like that distinguish between hostile and friendly individuals? One way I see it is by marking friendlies with an IR emitter, but that wouldn't do in a military situation where this would denounce the operative's position on the enemy's NVGs. It could be used though if it is stationary and it has to protect a perimeter AFTER a certain limit (as this can be easily programed in OpenCV), limit within which there can be safe movement of troops.

[@rohitkarle]

can we have a code for the same?
or how to do it/?

[@khtan5531]

@DROIDii1 this would be true for a static camera facing a fixed scene. But won't it be problematic for a moving camera which has to deal with a changing background scene?

[@ashkanikov3269]

is this on github?

[@edith_1232]

What is camera use for detection? Plss

[@ayeyefookinw0tm859]

how did you figure out how the degrees the servo had to move compared to the x y of the video?

[@ISHANSDungeon]

next up laser guided missile

[@muhammadhanifudin2666]

How fps guys,, i wondering it gets fast fps,, i doing same project but get low fps,, thanks dude

[@BlensonPaul]

good one..
Wondering how would it work with AI..??

[@mustafardk]

Hi! What camera did you use? USB, PiCamera or what?

[@enesozdinc8441]

Bro What is your motors models. I watched 1080 and focused but I couldnt see :) I can see only RS

[@nicorudikan8844]

Hey, im interested on making this project do you mind sharing the tutorial how to make this?

[@hritiksoni]

@Andy May I have the design files for the infrastructure of laser movement? Or can you please guide me where can I get it? Thanks

[@sasadamin]

what language you used for the program? Also do mention if this is release build that is causing high fps...
Thankyou...

[@andyeggert8578]

Asad Amin using C++. Working at 20fps.

[@sasadamin]

Andy Eggert thankyou for the reply i figured that much. Did u used hardware acceleration?
Finally, great work... it gave me few ideas.

[@andyeggert8578]

Asad Amin nope. Thanks

[@andyeggert8578]

Asad Amin nope. Thanks

[@arifikhsanudin9987]

it can be a weapon

[@YellowOysterCult]

This is impressive and all but what's with the music..

[@yeshacroe9354]

Hello how do you code to make it have a blue box thing.

[@jalan4524]

How does it lock the target?

[@digioasis4832]

Actually, I am also working on a target tracking system. need your help is possible.

[@suleymankocamaz3743]

Great project. Could you please share a code please?

[@wayneolaya3572]

what laser did you use? can you tell me all the material that you use.

[@brendethedev2858]

Neighbors used to walk in front of my office all the time now they don't because I blind them. With my laser

[@zohebsajid3627]

is it possible to get a list of all the parts for a project like this ?

[@giorgosiotis1557]

Programming code is only private???

[@bhaskarjyotidutta3253]

What shoul I learn for this types of computer vision. I mean I need the starting point.

[@ayeyefookinw0tm859]

python

[@alicanozkum6290]

Hi, I am designing a motion tracking project with raspberry pi. I will use it as a finishing project. I want to get information about the laser project. can you help me.

[@FRANK2810]

What operating system do you use to do the project? Raspbian, ARCH LINUX, RaspEX, Rasp ARCH, Ubuntu, etc.

[@andyeggert8578]

Frank PS raspbian

[@bilalunes]

Hey andy.
I am workinkg in a project that looks similar to your project. Can you please give me the details of your project?

[@enzopulido2579]

Can you put is up on a drone?

[@Anton-sz6ef]

Please how did you do that ?

[@anam_nadir]

Hi! How far can detect? Thank you.

[@marinenav8]

tutorial, please

[@annas.227]

Hi guys, nice work! I'm trying to get OpenCV installed on a Pi3 and keep getting errors. Are there any docs or tutorials on the install that you could point me towards?

[@probibably]

In case you still need it or anyone else is looking for a step by step: www.pyimagesearch.com/2016/04/18/install-guide-raspberry-pi-3-raspbian-jessie-opencv-3/

[@raisbastomi]

can i see the code? i so impresive. where we can now tutorial e

[@spotdoit6047]

I will be thankful if you will give me source code for it because i am working on same.

[@aimless3827]

How to make guided missile under $300 for the next video.

[@claudioLuna02]

tutorial ? please

[@toyteardown5722]

How does it prioritize multiple targets?

[@andyeggert8578]

Toy Teardown hi. Tracks the biggest moving object.

[@toyteardown5722]

wow, very clever.

[@guardrepresenter5099]

Easy man.Substract background picture from recent picture than get moment of substraction.Can you do it moving background with two similar object or more :)

[@andyeggert8578]

bilen basarir can you sir??

[@guardrepresenter5099]

I am trying to do last 3 years. The answer is %70 yes % 30 no with all situation.

[@andyeggert8578]

What methods are you using? Also using OpenCV?

[@guardrepresenter5099]

I am using shape descriptors or their combinitions.Some times i am coding some times iam using opencv But the key is to find invariant features of the shape.In opencv you can find some of them like sift,surf,blob.Then elemination of redundant unneccessary features.Some moments like hu,zernike usefull too.Depents on situation.Good like my friend.

[@andyeggert8578]

Is it possible to see some of your work results?

[@deepakpv8537]

Can you please give me the code of this project ?

[@jarisipilainen3875]

would be faster track just with camera lol or is camera tracking and laser is just moving there ha

[@user-lb9dd8et9v]

所以這部分做到的是追蹤對吧?

[@insonia-somdomundomusicasp3128]

1:30

[@fullmoon6661]

what motor are you using mate? please kindly reply, I wanna make smooth pan & tilt like yours

[@andyeggert8578]

Willyam Adhi I am using geared DC instrument motors from McLennon.

[@fullmoon6661]

Andy Eggert thanks

[@bmk5019]

+Willyam Adhi Hi, i recently bought two optical scopes, i already made an adapter to mount my smartphone on it (digi-scoping), works great. Next step in the project is to make a pan & tilt for the scope(s) and use the pi camera instead of the phone. Then stream the image via a web server on the pi. Then i created a remotely controlled extreme zoom webcam... i live in a high building with great view... So i need 2 (or 4) servo's for the pan & tilt, the spotting scope weight is 988 gram, but in balance, i dont think it's hard work for the servo's. What's your plan with the pan & tilt system? Regards, Bastiaan

[@fullmoon6661]

Bastiaan Klaasing hi, that is cool project. Mine is just like yours but it's focused on surveillance. So I kinda need smooth pan & tilt but also compact in size. I'm still working on it

[@muhammadhanifudin2666]

How fps guys..? im wondering it gets fast fps tracking

[@ShivaniSingh-jc4pg]

plase help me i need a tutoriall

[@extrem2497]

Turret

[@grodarh]

Waited for an accurate laser headshot but no.

[@lezbriddon]

-50 points, no nerf gun.

[@dqalitz]

Can you post the code?

[@JaydipPatelindia]

can i Buy the CODES from you !

[@ganstagirs]

were code?