So basically this is what you need: -- A drone. Basically any drone that has a pixhawk or similar flight controller that runs ardupilot wil work. But if you are building from scratch you could build something like this: - Get 10 inch drone propellors and motors (t-motor is one of the best brands). A motor between 400 and 1000kv should work fine. - 30a Esc’s. Any brand is fine but t-motor or hobby King make good ones. - 4s lipo battery. 3s is possible but 4s will increase flight time a lot and also give the drone more power for faster following. Tattu makes good batteries. - flight controller that can run ardupilot and is released after the pixhawk. The chineese clones of the pixhawk can be really bad sometimes. A more expensive unit but which I really like a lot is the cube orange. Otherwise a radio link pixhawk is also good. I would recommend buying a flight controller in a kit. This will make sure that you get everything you need like wires, speaker, safety button, telemetry system etc. - gps + compass module. Get a radio link module if you are on a budget or a Sirius f9p from dronetek. Don’t buy a cheap unit. Gps and compass is one of the most important sensors for a drone. Getting a cheap one will result in crashes! - for the frame a dji f450 or tarot clone of this frame is good. Going with quad motors is the easiest and cheapest. -- beside a basic drone we also need some specific parts. These are: - jetson nano 4gb module. (Dont buy the 2gb model it is not good) - a 1080p csi camera. I like modules with the imx219 sensor a lot. Easiest would be to just buy that one. - a step down converter like the LM2596 I used. - a tf Luna LiDAR module from benewake. - a 3d printer to print some custom brackets located on GitHub. - adding a usb wifi module to the jetson will enable remote debugging of the system using ssh. Definitely recommend this. That would be it! Good luck trying to make it. Definitely send me a video if you have it flying.
@@sieuweelferink6852Hey, where I live the pixhawk and similallars are out of stock. Do you think I would be able to crete something like that with a beta flight FC? I know they are more focused for racing but I wonder if I could create an autonomos drone like that. It is a FC Omnibus Betaflight F4 PRO V2 Flight Controller STM32 F405
@@sieuweelferink6852 Hey buddy Even I am working on the similar project using ML in it. Can you suggest me the best controller in the Pixhawk exactly so that I can get the documentation and really use it. And also I want to add the sensors to it like air pressure sensors etc. Is there a provision to add those sensor and if it is possible then which sensors are available in the market for it. your Guidance will be Valuable
Oh man, this is genus. I watched another video on a similar project using the Jetson and it wasn't even close to as smooth as this solution. Very elegant, and it's python!
Very nice E46 man I really like it it's a coupe, I have the sedan (4 doors) 330i, I'm an embedded system engineer I do some PCB design for IoT devices, I'm also a ROS enthusiast actually I was watching some videos on PX4 MavROS and I found your video. Keep up the good work bro you are amazing I really people like you
I will try as much as possible! But my projects are complicated and thus will take time. I will now focus 100% on the autonomous vehicle V2.0. So stay tuned for that!
Great work and solution! Carry on, and you could have a great future, by doing this as your future job! On question, if possible. Do you think it could be possible to integrate a library of objects the drone has to track and follow? For example Cars,, Bikes, People or equal, or is therefore AI needed? I mean something same like the Autel Evo Max is offering?
Yes definitely. The model I used is trained on the imagenet dataset. So basically the drone could track every object which is in this dataset. I think there are over 50 different objects. I just simply filter for only the object type person. But changing that line to a list will enable what you want.
Great job This is something which is very useful in industries.I have been planning to build like one of these for autonomous tracking. Could you please suggest me the PC configuration required to run a yolo model at 30FPS for custom object. Thanks in advance
@@sieuweelferink6852 how do you make the image run on 25fps i tried everything (im a beginer) and the best i got is i open image and than close it and repeat and its slow,garbage,stuppid,annoying.any sugestions?
Hello Sieuwe, it is a great work. I have the M690L hexacopter from Align. It is a bit older one, so i intend to use an additional hardware/software to update the AI possibility of this drone. Is this O.K. that you could check what is possible with genuine flight Controller of this copter?(APS M). Is there a way to contact you (PN)?
Nice work. A little over engineered 😅. I had a follow me function in my drone 10 years ago. It wasn't based on AI obviously. My phone, that's always in my pocket, sends its GPS data to the drone as a new destination and tadaa, drone is coming 😂
Why did you connect lidar to jetson nano but not to PX 4? In this case, it would be possible to connect the Jetson to the Pixhawk via a serial port. And you don't need a USB to Serial converter. Data from the lidar can be obtained using the Mavlink protocol
Hi @sieuweelferink6852, I love what you've done here. I'm aiming for a similar project which includes a net launcher for a final year engineering project. I've run into a dead end trying to develop an autonomous drone under a betaflight system. The plan now is to flash ardupilot to my existing SpeedyBee F405 V4 and pretty much run your code. However, I want to offload the processing to a ground station PC and not use a Jetson. Could you provide any tips to make this work seamlessly? The idea is to have identical functionality to your system, but tracking drones not people, and having a pc process the tracking and following code.
Hi so it is really easy. First build a drone with a pixhawk flight controller. Just search online on how to do it. Then mount a jetson nano and rgb and tf luna lidar on the drone. Install all software on the jetson nano and run main Python program.
Thanks for the video. I am really interested and i want your guidance in making a full drone if you don't bringing your help forth, I would I appreciate
hI! im interested in using your crowd analytics project as a foundation in a project me and my classmates are currently trying to develop. is there any way i can contact you if we have questions? emails or discord calls?
what if instead of jetson nano I transfer this information ground station (laptop) and perform algorithms and command back to my drone. Is it possible??
Hey beginner here. Dumb questions if anyone doesn't mind answering. Is a Pi Pico, MicroPython, and Flight Controllers like Pixhawk PX4 essentially provide the same function in combination with an NVIDIA Jetson? In other words, NVIDIA can be programmed to run Python image recognition programs such as OpenCV. Then a flight controller, Pi Pico, or MicroPythob can be used to send commands to a drone or any bot for that matter. In combination both can be used say to provide image recognition and send commands to the bot using the image recognition outputs. Am I understanding this correctly? Also, if the above is correct, does that mean that one or the other is the main board i.e. Pi Pico runs the commands, but receives the instructions from the NVIDIA Jetson?
1.What courses, what structures one should use, to make a drone fully autonomous? 2.How to start this work? How did you started? I am completely a beginer in drone programming, even i have no idea what micro-controller is best to use, and how to control the peripherals attached to the micro-controller, can you suggest any channel, any source or any helping websites, from where you prepared yourself for this outstanding work? 3.Please let me know where to learn about the drones and AI for drones, Thanks in Advance.
Hi I think most of your questions will be answered in the video! It will be ready saturday. Just as a sneak peak you need a drone with pixhawk flight computer. Also get a embedded ai processor like a jetson nano for the ai stuff. This is how I made my drone in the video!
I'm a subscriber just today and i will watch your video and share it and i can send you what I'm need, i just bought TELLO DRONE and i will like to program it using free open source opencv.. Like you are doing
Tello drone is a really good choice for simple opencv based projects! You can probably change our code to use with Trello drone and have good results👍 only you will have to change lidar distance to use for example bbox area as distance value
@@sieuweelferink6852 You are great.. Please I'm at other continent here where things for technology are very scanty but we are managing small resources, here even university have not resources except we check through Internet and i will be glad to be learning seriously from your channel... Apart from UA-cam do you have any plat form again? Really amazing job sir you have done..
Thanks for sharing. Can you also post the hardwares/materials to build this drone including the sensors and everything? Thanks.
So basically this is what you need:
-- A drone. Basically any drone that has a pixhawk or similar flight controller that runs ardupilot wil work. But if you are building from scratch you could build something like this:
- Get 10 inch drone propellors and motors (t-motor is one of the best brands). A motor between 400 and 1000kv should work fine.
- 30a Esc’s. Any brand is fine but t-motor or hobby King make good ones.
- 4s lipo battery. 3s is possible but 4s will increase flight time a lot and also give the drone more power for faster following. Tattu makes good batteries.
- flight controller that can run ardupilot and is released after the pixhawk. The chineese clones of the pixhawk can be really bad sometimes. A more expensive unit but which I really like a lot is the cube orange. Otherwise a radio link pixhawk is also good. I would recommend buying a flight controller in a kit. This will make sure that you get everything you need like wires, speaker, safety button, telemetry system etc.
- gps + compass module. Get a radio link module if you are on a budget or a Sirius f9p from dronetek. Don’t buy a cheap unit. Gps and compass is one of the most important sensors for a drone. Getting a cheap one will result in crashes!
- for the frame a dji f450 or tarot clone of this frame is good. Going with quad motors is the easiest and cheapest.
-- beside a basic drone we also need some specific parts. These are:
- jetson nano 4gb module. (Dont buy the 2gb model it is not good)
- a 1080p csi camera. I like modules with the imx219 sensor a lot. Easiest would be to just buy that one.
- a step down converter like the LM2596 I used.
- a tf Luna LiDAR module from benewake.
- a 3d printer to print some custom brackets located on GitHub.
- adding a usb wifi module to the jetson will enable remote debugging of the system using ssh. Definitely recommend this.
That would be it! Good luck trying to make it. Definitely send me a video if you have it flying.
@@sieuweelferink6852Hey, where I live the pixhawk and similallars are out of stock. Do you think I would be able to crete something like that with a beta flight FC? I know they are more focused for racing but I wonder if I could create an autonomos drone like that. It is a FC Omnibus Betaflight F4 PRO V2 Flight Controller STM32 F405
@@sieuweelferink6852 Hey buddy Even I am working on the similar project using ML in it. Can you suggest me the best controller in the Pixhawk exactly so that I can get the documentation and really use it. And also I want to add the sensors to it like air pressure sensors etc. Is there a provision to add those sensor and if it is possible then which sensors are available in the market for it. your Guidance will be Valuable
He is a type of guy I am searching my whole life to be friends with.
suprisingly, robots hunting people down scares most people
This is the kind of youtube channels WE want to be recommended to 🙏.
I have subscribed
True
Thank for sharing this and the breaking it all down! I have been wanting to make my own from scratch as well and make it fully autonomous!
Oh man, this is genus. I watched another video on a similar project using the Jetson and it wasn't even close to as smooth as this solution. Very elegant, and it's python!
Nicely done! Don't give up sharing your content. Even if there are similar projects out there.
Very nice E46 man I really like it it's a coupe, I have the sedan (4 doors) 330i, I'm an embedded system engineer I do some PCB design for IoT devices, I'm also a ROS enthusiast actually I was watching some videos on PX4 MavROS and I found your video.
Keep up the good work bro you are amazing I really people like you
YOU ARE OVERPOWERED!!!
This is brilliant work !! Well done!
Really good work man!
That was fantastic man . Please upload more❤️
I will try as much as possible! But my projects are complicated and thus will take time. I will now focus 100% on the autonomous vehicle V2.0. So stay tuned for that!
@@sieuweelferink6852 great man. good luck.
What happened with this project? Did you stop working on it?@@sieuweelferink6852
Great work and solution! Carry on, and you could have a great future, by doing this as your future job!
On question, if possible. Do you think it could be possible to integrate a library of objects the drone has to track and follow? For example Cars,, Bikes, People or equal, or is therefore AI needed? I mean something same like the Autel Evo Max is offering?
Yes definitely. The model I used is trained on the imagenet dataset. So basically the drone could track every object which is in this dataset. I think there are over 50 different objects. I just simply filter for only the object type person. But changing that line to a list will enable what you want.
great work. thanks for sharing. do upload more of your work. you are such an inspiration for drone developer.
Keep it up bro, well done.
Very cool, this is great stuff man. Keep it up and thanks for sharing.
Thank you for using 3s. My favorite battery size. :)
This is too cool, thank you for making it open source
i had Deja Vu @6:58😱it felt like i already watched that part of the video🤯
I wish no one will come and buy you out becos we need you in these forums :)) !!
opened my eyes to a pretty cool hobby my dude thanks :D
I would like to see two or more drones follow the same target in synch with each other.
Looking forward to this!!
Great man! What about HOME position update in INAV, or any other soft. to actual transmitter position, when transmitter is moving?
Now way!
You should make a home security drone. That would be awesome!
Thanks for the video 🤙
That’s a really good idea! He should do that.
nice project, when is your part 2 coming, (autonomus obstacle avoidance drone) ?
Thank you🙏
You're really a good kind and helpful young man👍
Cheers🕊️
Great job This is something which is very useful in industries.I have been planning to build like one of these for autonomous tracking.
Could you please suggest me the PC configuration required to run a yolo model at 30FPS for custom object.
Thanks in advance
Jetson nano 4gb is fine for tiny yolo model. Otherwise look at jetson Xavier. Can run at a couple 100 fps!
@@sieuweelferink6852 how do you make the image run on 25fps i tried everything (im a beginer) and the best i got is i open image and than close it and repeat and its slow,garbage,stuppid,annoying.any sugestions?
Great job! Could u please refer to the sensor models? which rgb camera and lidar did u use?
Brilliant video, inspirational!
I was literally looking for this exact thing for delivering packages to my friends in my neighborhood
Hi. Where did you connect the Lidar to? To Jetson? Thanks
Great job buddy, learned a lot🙏🏼🙏🏼🙏🏼
Thanks for sharing. Could you post a new line follower drone using pixhawk?
a line on wall with arrow direction to move up down left right n yaw to go behind the wall
Hello Sieuwe, it is a great work. I have the M690L hexacopter from Align. It is a bit older one, so i intend to use an additional hardware/software to update the AI possibility of this drone. Is this O.K. that you could check what is possible with genuine flight Controller of this copter?(APS M). Is there a way to contact you (PN)?
Can you please make a project on gps and navigation UGVs for agriculture!🙏
wow you re crazy, keep going!!!!
Nice work. A little over engineered 😅. I had a follow me function in my drone 10 years ago. It wasn't based on AI obviously. My phone, that's always in my pocket, sends its GPS data to the drone as a new destination and tadaa, drone is coming 😂
Great project! Thanks for sharing with us
Wow, waarom ben je gestopt met video's maken? Je bent een genie!
Why did you connect lidar to jetson nano but not to PX 4? In this case, it would be possible to connect the Jetson to the Pixhawk via a serial port. And you don't need a USB to Serial converter. Data from the lidar can be obtained using the Mavlink protocol
Did he connect the lidar to Jetson?
Hi @sieuweelferink6852, I love what you've done here. I'm aiming for a similar project which includes a net launcher for a final year engineering project. I've run into a dead end trying to develop an autonomous drone under a betaflight system. The plan now is to flash ardupilot to my existing SpeedyBee F405 V4 and pretty much run your code. However, I want to offload the processing to a ground station PC and not use a Jetson. Could you provide any tips to make this work seamlessly? The idea is to have identical functionality to your system, but tracking drones not people, and having a pc process the tracking and following code.
I think you need rtmp to get the video feed from drone and apply the object detection to detect person and then use the tracking code
thanks for sharing, this is so wonderful
Couldn't you use the bounding box size instead of lidar?
Any updates on that obstacle avoidance?
please keep uploading
Bro can you make a complete AI powered fpv drone building from scratch it would be alot of helpful for me please bro I want that so badly
Good Job Sieuwe
Thanks for the support!
Thanks for sharing
Amazing. You are genius.
Great job but you need more recognition 👏👏👏👏👏
Thank you for watching!
Great thanks 👍
Bro, can i use raspberry pi 5 instead of jetson nano?
Are there any cheaper alternative for jetson nano board
Sieuwe you are great person ❤✌👋
Amazing work
Can i do this project without a lidar sensor and by using a raspberrypi5
How hard would it be to switch from tracking mode to a "kill mode"? Where drone will collide with tracked target at full speed.
which library is used for drone control? it doesnt seem that you have used drone kit
Can you please confirm that this will work on a PX4 stack as well .
Hi Sir,
This is very great project!!
May i know the spec of motor you’re using in this project?. It is very much appreciated
nice job man...
You should post a full tutorial
Is it possible to complete the task with more cheap flight controller?
hes got the jetson nano
How were you able to calibrate both rotations and forward movement for the right PID control?
Awesome project!
sir which country u from,very good
Really nice . Thank you.
Just amazing
Uber Cool.
Nice work man need to try this my self. Can you make tutorial fron no drone to fully automated drone. Building and programming
Hi so it is really easy. First build a drone with a pixhawk flight controller. Just search online on how to do it. Then mount a jetson nano and rgb and tf luna lidar on the drone. Install all software on the jetson nano and run main Python program.
@@sieuweelferink6852 thank you so much you are very helpful
please i want the schematic diagram
Thanks for the video. I am really interested and i want your guidance in making a full drone if you don't bringing your help forth, I would I appreciate
Is it even possible to simultaneously implement the mav condition yaw (for yaw) and mav frame body ned (for forward)?
so cool. thanks
I need your help regarding autonomous flying drone without gps pls help n reply
Oh yes, that what i need😍
Thank you!
are you still using the PS4 Stereo camera?
hi! are you still working on this? part 2?
Can we control pitch yaw and roll without using pid control in program?
Engels zeer on point😂
How long did it take u to master python?
Thank you very much for your efforts.
Thank you for watching!
hi my drone need to detect a box and pick it up its similar to ur project can u help me out
Great job! Will it work on raspberry pi 4?
No. The fps will be too low. Only 4 frames per second is possible. I tried.
hI! im interested in using your crowd analytics project as a foundation in a project me and my classmates are currently trying to develop. is there any way i can contact you if we have questions? emails or discord calls?
Hi you can just ask your questions here so everyone can use the information i give you!
what if instead of jetson nano I transfer this information ground station (laptop) and perform algorithms and command back to my drone. Is it possible??
hello bro i need help
Amazing 👏👏👏
Hey beginner here. Dumb questions if anyone doesn't mind answering. Is a Pi Pico, MicroPython, and Flight Controllers like Pixhawk PX4 essentially provide the same function in combination with an NVIDIA Jetson?
In other words, NVIDIA can be programmed to run Python image recognition programs such as OpenCV. Then a flight controller, Pi Pico, or MicroPythob can be used to send commands to a drone or any bot for that matter. In combination both can be used say to provide image recognition and send commands to the bot using the image recognition outputs. Am I understanding this correctly?
Also, if the above is correct, does that mean that one or the other is the main board i.e. Pi Pico runs the commands, but receives the instructions from the NVIDIA Jetson?
Where to get the same drone?
amazing
WOW HAMZING!!!
love it
1.What courses, what structures one should use, to make a drone fully autonomous?
2.How to start this work? How did you started? I am completely a beginer in drone programming, even i have no idea what micro-controller is best to use, and how to control the peripherals attached to the micro-controller, can you suggest any channel, any source or any helping websites, from where you prepared yourself for this outstanding work?
3.Please let me know where to learn about the drones and AI for drones, Thanks in Advance.
Hi I think most of your questions will be answered in the video! It will be ready saturday. Just as a sneak peak you need a drone with pixhawk flight computer. Also get a embedded ai processor like a jetson nano for the ai stuff. This is how I made my drone in the video!
You are clever🎉🎉🎉🎉
I'm a subscriber just today and i will watch your video and share it and i can send you what I'm need, i just bought TELLO DRONE and i will like to program it using free open source opencv.. Like you are doing
Tello drone is a really good choice for simple opencv based projects! You can probably change our code to use with Trello drone and have good results👍 only you will have to change lidar distance to use for example bbox area as distance value
@@sieuweelferink6852 You are great.. Please I'm at other continent here where things for technology are very scanty but we are managing small resources, here even university have not resources except we check through Internet and i will be glad to be learning seriously from your channel...
Apart from UA-cam do you have any plat form again?
Really amazing job sir you have done..
Hi I only upload on UA-cam and sometimes explain my projects on instructables .
@@sieuweelferink6852 Thanks
Dear sir, i will try to use your code and if there is problem along the way, please i will be glad to get your help sir🙏
why you are not working in that field
genius