Target lock and tracking on FPV drone video | Autonomous Drone Object Tracking OpenCV Python
Вставка
- Опубліковано 25 лип 2023
- Can my homemade object tracking code handle real FPV drone footage in real-time? Watch to find out. This is a test for a point-and-click homing system, allowing the guidance system move the drone to wherever it is needed..
[Warning: The test clips are videos that might be sensitive and objectionable to some users. Viewer discretion is advised.]
Want to see more like this? Click: / @timelapsecoder
SUBSCRIBE to see if a solo, independent amateur can replicate product features that big tech companies and the military-industrial complex take years to develop.
#drones
#objecttracking
#opencv
#computervision
Curious if I can convert these software projects into real homing drones? I'm getting there, but still saving for hardware and logistics. SUBSCRIBE to support me. Ask like-minded friends to subscribe also.
yeap, if you live in Ukraine)
There are many teams in Ukraine that are interested in technology like this. We can provide you with the necessary equipment for testing and development, engineering resources that can physically implement this in iron. Ukraine needs this for its defense. If you are willing to discuss this topic in more detail, please let me know.
How we can get connected ? It's looking very promissing. Please, ping me, it's would help us much.
@artempogorelov7145 how can you be trusted? how do we know you are not russian ?
@@artempogorelov7145 Still needs a lot of work before becoming a real working software. Will keep on testing on more drone footage.
I would like to develop a civilian use case for something based on this type of tracking. Sounds like an interesting concept with commercial potential
You can experiment with existing OpenCV trackers and some lightweight ML models for object detection. From there, you can sell drones that follow its owner, like DJI for example.
I see a different timing. did you speed up your video recording when the tracker activated?
Haven't look at this in a while but I have a timer sleep when the tracker is off so the video does not go by in a blink. So I am guessing my delay estimate (to approximate 30fps) is actually slower than the speed of the tracker processing logic, so the video looks slower when the tracker is off.
hey can you share the code for the HUD only? i have rest of the things, just missing a good HUD
You managed to program a drone with computer vision object tracking but are uncapable of drawing some green boxes on an image with opencv?
Great job! Just wonder what initializations are done when you click on the target.
No initializations, other than maybe basic ones like approximate size of target, but even this is not that important. The algorithm has to immediately figure out what it needs. This is the 'magic sauce'. :) It does not work correctly all the time, so not so magic.
1. did you develop the algorithm to track and shoot them down?
Can you post the process of creating such a system, I'd love to learn.
2. Did you fly it by hand? Or is it an automated tracking flight?
1. just the algorithms to track. can't share, private research. can only share demo.
2. neither. these are pre-made videos. just testing the tracking on fuzzy videos. automated tracking flight can be easy or hard. if simple flight commands, easy. if rapid maneuvering, hard.
I'm actively teaching myself flight controller development from scratch. I have already developed a homing sensor for a certain application and it needs to get airborne. I can't find any other way to get it done other than designing it myself.
Nice. Writing PID flight control software would be a good learning project.
But if you wish to avoid the trouble, would Ardupilot or similar open-source software help your situation?
@@timelapsecoder Ardupilot is designed mainly for GPS-guided waypoint navigation. There will be no GPS signal where my sensor will deploy.
@@PeterA650 Maybe you can find the core PID code from university labs working on indoor autonomous drones. They probably won't share their vision, path-finding and navigation algorithms, but maybe they already shared their PID.
Do you have a model/discussion somewhere in github posted?
This is not ML-based so no models. The problem I am solving is to track anything, not just pre-trained objects.
Why not making laser guided systems ? can you do that like in rockets?
It should be doable in theory. Replace the camera tracker with a laser tracker, plus a lasing unit to mark targets. Beam riding is a little different.
Great job my friend, can you share the code with me?
Hello. Tell me where to get this code? I want to experiment with this. Thank you
its private lol
@@SolitaryElitethis is a Ukrainian beggar
Great
What is the tracking algorithm this time?
PF with some secret sauce! :)
@@timelapsecoder can you recommend a good resource to read about it?
@andreyl2705 i think szeliski's computer vision book is considered very good. also forsyth's (haven't read both so don't know which one is better). i am recommending them because they are used as reference in cv classes. very math heavy though. if you just want cv concepts, i am sorry i do not know a good easy to digest resource.
if you look for these online, you would also find many related links to cv lecture slides from the best cs schools. check them out and see which one is to your liking. you might understand the concept even if you gloss over the math.
you can also study computational photography.
@@timelapsecoder thank you sir, very comprehensive answer) Have a nice day.
hhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh
@@timelapsecoder
The next challenge is to learn a drone to precision bomb drop to a moving target and fly away to save itself.
Accurate free-fall physics can be hard. :) Better to have a motherdrone with mini-drones like this. The motherdrone has high-power processing capacity for target identification, selection and designation. The mini-drones would be like this, using disposable homing tech.
Are you using goturn tracker 😊
no, i made my own private custom algorithm
Hello, where do you collect your materials from?
Hello, if you mean the video, same as where we find random things... the internet. :)
But sometimes your tracker loss the track of the object and jump to other locations, in real world you will miss the target.
The tracking loss is often due to the static from transmission on these test videos. That is assuming the tracking calculation is remote. Transmission is subject to jamming.
In real application, the drone will have very clear video that feds an onboard tracking system. It can still miss due to algorithm limits, but far fewer and smaller errors than the big jumps you see here. Also, I am still improving this system. :)
Finally, small errors can be manually overridden. Military grade drones tend to have terminal manual adjustments to help correct final approach trajectory (see Lancet, Spike, etc.; the last second aim adjustments do not correlate with a vision system, so they must be human corrections).
@@timelapsecoder also you need to handle some delays from the time you select the tracker position in the ground system and the time it update back to the drone, sometimes due to link delay it may place the tracker on the wrong position. The is solution for this problem be have buffer of frames in the memory of the drone and run from past till current time and place the tracker in the correct position.
@@withlovearoundtheworld4496 I am taking it further (not shown). Selecting a moving target is hard. But I can freeze the frame and select a non-moving target, then have the tracker catch up to the live frame. This of course requires a faster than FPS algorithm, which this does.
Є можливість поділитись кодом? Я займаюсь схожими задачами, але з ШІ моделями.
I actually did this 12 years ago. The concept almost same with yours, But not self suicide drone.
People like to watch, and The Algorithm promotes, videos that are like this. If I track something harmless like a balloon, no one will click.
Maybe I'll track a cat next.
hey can we communicate?
only through here :)
Hello. Your work would be very useful to Ukraine. Would you be willing to share your code if contacted by the official representatives?
Working on developing this into maybe a hardware system instead of plain text code.
I would like to speak with you. How may I contact you?
If you are not a Russian citizen, we can do a joint project with you
Cool project! I am wondering if you have any public code for the autonomous target tracking. Also, would it be better to run target tracking at a ground station and send the control information to the drone or can the tracking be done directly from the flight controller?
Thanks. Just private code. Ground station is great for better tracking computations, but video transmission might be poor sometimes.
@@timelapsecoder Yeah the video transmission is the only issue im worried about. Thinking of using the Eachine ROTG02 so I can just use anything with a USB port for a video display.
Well that and powering two small magnetic actuators but I might be able to use the extra esc pads or change some flight controller pads around.
you are ironman 0.1 lol
mk0.09
Я уже написал программу, которая наводится по упреждающей метке, теперь буду стараться сделать такой дрон, для того, что бы внести свой вклад в победу над неонацизмом
This technology is of great importance to both sides
This future was predicted long ago
Its fake video
It's real, bro. trust me bro.
you taking russian money to make fake videos@@timelapsecoder
You’re not programmer, you won’t understand. Try to learn hello world app first
first video it's STERNENKO video(left up angle), he showed first using Target lock several days ago, before it all user controlled, including this one. It doesn't work like on video.@@phamnhuthai6847
fake and post FX.
Fake=no, post=yes, but you are free to interpret however you want. Good luck to you.