NVIDIA JetBot: Jetson Nano Vision-Controlled AI Robot
Вставка
- Опубліковано 31 сер 2019
- Jetson Nano “JetBot” machine learning robot review and demo. Includes hardware, software, Jupyter Lab notebooks for executing Python code, collision detection examples, and some introduction to training a neural network model.
The JetBot shown was supplied for review by NVIDIA, but this is not a sponsored video. If you are interested in getting a JetBot, I would strongly recommend starting on its NVIDIA web pages here: developer.nvidia.com/embedded...
The JetBot Wiki, which contains all of the information required to build, setup and run vision recognition and machine learning on a JetBot, is here: github.com/NVIDIA-AI-IOT/jetb...
There is also info on full JetBot kits here: www.nvidia.com/en-us/autonomo...
My previous review of the NVIDIA Jetson Nano SBC is here:
• NVIDIA Jetson Nano
And my “Jetson Nano: Vision Recognition Neural Network Demo” video is here:
• Jetson Nano: Vision Re...
I also have an introduction to AI video here:
• Explaining AI
More videos on single board computers and broader computing topics can be found on the ExplainingComputers channel: / explainingcomputers
You may also like my other channel, ExplainingTheFuture, at: / explainingthefuture
#JetBot #JetsonNano #NVIDIA #ExplainingComputers - Наука та технологія
All I can say is "Wow!" Very impressive hardware and software package!
nVidia: "It just works!"
Explaining Computers: "After extensive assembly and configuration it does."
So true. NVIDIA were very helpful during production of this video, but production lasted longer than on many other videos. :)
@@ExplainingComputers Probably starting when you first plug it in and Ubuntu thinks you have a black and white TV
Jetson nano is a ridiculously powerful platform for the price. I'm using it for high speed machine vision to monitor manufacturing process in real time and this beauty can record 200fps in 720p and it can easily process 100 frames per second with a simple detection algorithm. We are living in the future. 10 years ago this would be a huge challenge even for a desktop PC not to mention that there was nothing in place to capture such high frame rates in real time and process them simultaneously.
Great feedback, thanks for sharing. I share your appreciation of the Jetson Nano -- it is a really great board.
how do u make that simple detection algorithm is is based on those green square u defined in the algorithm?
How is it going on, after 3 years? Have you been using it to date in other applicationa too?
Actually it's not powerful at all. A nvidia tegra T210 with a GM20B GPU it's a toy. Also the OS on the board is way to heavy for the system.
This video helped me appreciate my Subaru's "Eyesight" system even more. Thank you Chris.
Sundays are exciting; I never know what Chris will present to us next. Great as usual!
I have a nano sitting on my desk for a month or so now... finally I found something cool to build with it! thanks for the video!
I have about 16 SBC sitting under my desk, so I laid off the Jetson until I'm mature enough to go on eBay unsupervised.
A useful presentation you have given us, pointing out that AI can be other things apart from analysing numbers or text ! In fact you've made us sit up and take notice ! So THAT'S how a self-driving car parks itself ! Thank you for this enlightening demo !
Excellent review & demo Chris of the Jetson. Interesting to know the amount of pictures you took to train the Jetson. Well done
This is quite interesting. I worked as a Field Engineer for a company call Intelligent Reasoning System Inc. back in 2001/2002. They made capital equipment for installation on an electronics manufacturing line for use in Automated Optical Inspection of PCBs. We used an early form of image training (the founders of the company also wrote the software for the terrain tracking algorithms for the Tomahawk cruise missile and adapted those to this application) with statistical analysis within a set standard deviation. The system worked well and it is very similar to what you demonstrated here with the Jetbot. We would train examples of good images and bad images of electronic components on a PCB and for each false call, we would train that as a bad actor. Over the course of the manufacturing run, the system would become more and more accurate. Good stuff indeed.
Keep the good material coming! I am considering getting one of these to teach my daughters not only Python, but machine learning in general...
Congratulations on your first trained neural network!
I thoroughly enjoy your videos. This one in particular is one of the coolest I've seen on your channel. Thank you for the hard work you do.
Amazing !! I bought the Nano today and I am very excited to start experimenting with Deep Learning on robots. This is a very motivating video. Thank you.
Good luck with your Nano. It is an amazing board. AI is tough to get into on any platform, but Jetson has better support and resources than anything else I've come across.
Very, very interesting. I finally got at least a general idea of how neural networks are trained.
Thank you!
Great to hear this -- that is what I was trying to convey. There is a fair bit of process between gathering the sample data and having a final trained model, but the essence is what you see here.
@@ExplainingComputers Thank you. While I did in general understand the purpose of neural networks I was always very hazy on how you would actually train one.
I was just leisurely watching, but instead I learnt something that I need for my school assignment :D
I just learned from your video how to train a data set for visual detection! Thank you so much!!
That's awesome! Thanks for making my Sunday again!
Since watching your wonderful channel my "want to do " list never ends. Thank You!
Thanks Ted. For anybody seeking a complex maker project with a lot of possibilities, the JetBot is really interesting. And I'm sure we are going to see more and more SBC-related machine learning and robotics stuff.
Mr.Barnatt another great video. I learn so much watching your videos. Thank you.
Fascinating and well presented. Thanks Chris.
"Bring me to your leader...!" All right, all right.... We're not there yet with the NVIDIA JetBot! Quite interesting prospects, though. Thank you for the educational presentation!
Truly fascinating to watch! Thank you.
This is very interesting. Great video and demonstration.
Thanks for sharing the project Chris. I sure hope Nvidia makes these kits available for educators as this really is the Lego Mindstorms of the 21st century!
Love it!! Thank you for your time!!
Thanks for another interesting video. I always learn something new after watching an episode of Explaining Computers.
Alright, this is a bit more challenging. Definitely have to try this one. More of this please!
Keep those great videos coming. Really enjoy them.
Thanks for this! Sadly this video has not been that popular . . . :(
@@ExplainingComputers Sorry to hear that. But it doesn't surprise me. This looks like a quite advanced project. Not for the a broad audience like an Arduino (or at least, that is what I think is the reason). Anyway, happy you took to time to share this.
A great class room project platform. Computer science lab now has a low cost system to work with. Thanks for sharing this wonderful SBC computer Chris.
I totally agree Dale. The JetBot is a fantastic learning tool -- for all ages!
Chis i got your coffee mug and added it to my collection! very nice and proud to display it!
Great to hear. :) Thanks for being part of the EC community.
Fascinating! Nice little robot. Never would have guessed it uses an image library to navigate. Like the table too!
Every ExplainingComputers video where I look at any hardware is shot on that table. :)
@@ExplainingComputers My good man this is way to complicated for mm. Arthur here:
Well technology has come a long way. I remember a robot doing obstacles course about 20 years ago. It took a long time just to move. The ultrasound sensor is a lot faster back than. Now it has catch up. Great video as always.
This old man never get old
Fascinating. Absolutely Fabulous. Thanks
"Something like that" is a buzz phrase I will be using from now on.
Back again with another interesting video. The Nvidia Jetson Nano is interesting
What a waste of time!
@@AnthonyCook78 How?
If Mr. Scissors found a way to mate with it and breed, they would rule Earth by Thursday
1st choice: Ruke the world. 2nd choice: make lots of unboxing videos!
Meh- they can have the earth. Kids will be a bunch of little cut-ups, though.
@b gg Explaining Computers does. ;D
Gives a whole new meaning to the term "hardware porn"
I'll grab my coat.
This is one of your BEST videos. I'd favor the company creating a kit of parts. Like Heathkit used to. Then you'd know the parts should work after assembly. I'd also like a BEGINNER's PRIMER on programming the neural net robot. But overall, "Bravo!"
There are now kits -- see links in video description! :) Glad you like this video. It is not one of my most popular. :(
Totally mindblowing video! I just wish that Nividia sold pre-assembled JN-AI Robots versions so that we can just focus on building the software and learning more about training a neural network which is for me the main goal. Thanks as always for an interesting video!:0
Since I made this video there are some suppliers selling kits, which makes things somewhat easier. I've added the link to the video description.
@@ExplainingComputers thanks
I can imagine networked robots of this sort, each perhaps in a different school, racing around a common virtual racetrack or in battling in a common virtual battlefield. In actuality each school's robot would be operating on an agreed upon real physical space (a school gymnasium), but playing on a common virtual space, populated by virtual robots being generated by the physical robots in each location. The winning robots would be the ones with the best-programmed algorithms supplied by the students.
Very Cool! Looking forward to your next video.
Thanks Perry.
Hello Chris👋🏻
Great job you did here. Amazing little robot!
I recently included ML and NN in my learning schedule, so this is most beautiful example I've seen and a excellent ground for tinkering/experimenting/learning!
Fascinating!
Hi Elvira, it is always good to hear from your here. :) I too have it on my list to learn more and more about ML and NNs. It is so different from traditional computing! Sadly, on the channel, it is not that popular a topic to cover. But I will persist on occasions like this one.
ExplainingComputers
Yes! Please do cover this topic. 🤩
At least occasionally. 😁
Hi what job u r doing
Elvira what job u r doing
Great video. Thanks for sharing!
I hadn't seen this video before. I must have been on a trip then. Great video as always. Greetings.
Hi Nico! :)
Thank you, Mr. Barnatt, Explaining Computers, My jet bot would be using vintage fisher price contrux.
Short Circuit S.a.i.n.t robot Johnny 5!
Wow, I wanna play with that. Plus the commands seem rather intuitive. The commands kinda remind me of that old graphics program called Logo Writer.
This would be a good project to use to train an autonomous lawn mower. The direction changes need to be in a bit smaller increments so it doesn't just turn too much at once but just a little and retest for obstacle. If all the information can be stored on SanDisk card and saved then the trained brains/program can be moved to a bigger robot and have the "Blades of Death" (lawn mower blades) installed and turned loose safely to mow the lawn.
I like this video sir, very informative..I made a terminal controlled rover but I without microcontroller or SBC ..
Impressive, I managed to write a simple IA script this week, as in copy it and get it to run, and that was a real first. It didn’t really do anything as such, but I could see the code working and that helped me get my head around things. Really, I struggle with all this and always will but just making some sense of it helped.
My 10-year-old son will hopefully do better and having something like a robot will be more meaningful than my naming game. A £100 price point seems about right for this, especially as it should be extensible and it is the code that is what it’s all about, and you need affordable so there's access. Hopefully you can have say a team of 4 kids with one Jetson to build a project. £25 each isn't a complete killer over a year, say £1 a week- even those on very low incomes should be able to support that.
To be honest though, I’ll always be a hardware man at heart so the Jetson is a bit lost on me, I’ll only turn it into a Kodi box or games emulator.
EDIT: I do wonder what Raspberry will come up with, clearly it won't be Jetson standard as Nvidia are miles ahead on this stuff and have massive budgets. The same for AMD, I just wonder there, they have supposedly invested some money in IoT/Embedded but I think they will be in a very different direction- could be wrong but more 86 64 and industry utility stuff- certainly not self driving cars.
another amazing video!
Thank you yet again! THAT IS PART OF MY "KING PROJECT". i want to automate lawn tractor mower to mow lawn using visual and distance sensor for obstacles but program to mow in a pattern. Learning properly to go around objects on eventually both sides to keep mow pattern. One thing I have not figured is to read where grass has been cut verses the next cutting row of taller grass. Unless it uses "mapping" and location to determine the next row. That would make sense. The servo motors for steering and such I have to figure out with experts in that area.
There is one company that has pattern mowing already. I am discussing selling "kits" to install on older mowers already purchased. They seem interested. but that will have to wait as I have to many automation things to complete first.
Also paint a workshop barn/office. Insulate, run wiring, and interior walls and set up work table, hand tool storage organized on wall. (I am building skeletal arm that requires servo motors camera and nvidia to run it. Helper Arm to pull tools and put them up when finished.
I have 4 months to also setup garden, water retention, sensors pumps water lines. This year with no garden I grew the most delicious Pineapples, Lemon grass, tomatoes, and seasoning herbs...playing around.
I need some automation interested people to assist with this project. amazing the blue print for automation has grown substantially. I guess it will take 2-3yrs to implement fully. I would prefer that 24hrs a day over any other option to spend time on.
Use bluetooth adapters in the corners of the garden as "gps-beacons". Now you can use the mower to print text or pictures in your lawn like a big plotter.....?
I was hoping for a jet-powered robot, but I suppose making machine vision robots easier to use is pretty cool...
(btw, using a powerbank as the battery is a really smart idea, makes battery management easier for newbs)
Interesting video as always
Thanks for sharing :-)
Great to see that NVIDIA uses PyTorch!
Pretty amazing.
Very interesting video....thanks.
great channel, i love all your work, thank you!!
Thanks for watching!
I am finding sponsors! The used mower I purchased. The brand Company has not produced in 7+ years. However, without asking they shipped me many new parts they had stored for that model mower. I will purchase the remaining 3-4 small items from them. Mower will be better than NEW.
It is very nice Video and usuful for us to learning about AI project. Many thanks.
Ty for the video :)
It's Firmware OS and Camera sensor Blocked 100 to 0.00 if 70> Blocked change direction, excellent thank you so much.
It's alive, it's aliiiive
Now I no longer need a Tesla for self driving car. I can make my own haha
This was a great video, please do more videos on AI and programming
Thanks. I hope to return to AI, but so far -- and after many attempts -- it has never really taken off on this channel.
@@ExplainingComputers it's quite different and interesting to see it in action, the experiments that you do in your style of breaking them down into easy to understand components is what always draws me to watch your videos. As well as replicate them with my own configuration.
@@ExplainingComputers I want EDGE! No seriously, after you teased EDGE I've been reading up on it and looking forward to your planned video, I an see a direct use for EDGE computing in my life more so than IA, despite things like Amazon Dot or what have you. I think IA is a hard sell full stop, because of people like me, I get the concept but I don't get the access- as in I'm a bit thick and just don't get it and don't have the coding skills to get it. It won't go down well but I'm finding some of the MS stuff a bit easier than the Linux stuff- with the proviso I am on about stuff targeted at complete novices. And I'm not making any claims that MS W10 embedded is in anyway better, I just found some of it more accessible to me- probably because you get W10 as a base to build on. And all it is a doorbell that can tell you if it is a bear at the door or it isn't a bear at the door and that's it. There aren't many bears at my door (a few wolves maybe).
Good robot. Robot move only straight and turn left. For this hardware its not poor. Again nice video.
The robot can move/turn as required, the code here just says "straight forward or turn left if the neural net reports blocked".
the birth of the jetbot whisperer ;-)
wait a second, i got a 1hour ad before this video? wow. interesting stuff but wow.
Hi Chris. Nice video. I caught the pun EYE instead of I, Robot, nice one. Robot vision will interest me more when I can be inside a self-driven car. Cheers.
It í very nice video and useful for our project.
Glad it was helpful!
Interesting..
I like this product..
Thanks..
Greetings from indonesia..
Greetings back from the UK. :)
Thank you sir 🙏 🙏 🙏
nice one. after 5 year, those things can be much easier
Brilliant.
i like your videos , thank you
Thank you for this video. The definitive test would be to train it to follow the voice command : “Robot, get me a beer!”
7 years later he hasn't changed at all :D just watched the big data video
A very interesting video.
that's really cool.
fascinating
Lovely. Awesome..
thank for share
Would love to see you expand on this robots capabilities! :D how about a hand that can grab drinks from the fridge? Okay a little ambitious, buuut possible I guess :D
Hello UNCLE how are u
Your this video is amazing
Very very good project thank you
Pretty cool.
I like robots and AI I wouldn't mind having Mr. Scissors as a AI robot
(Blib #6336 in the EC digiverse.)
"...to see what it can do. So let's go and take..."
_time passes_
_much time passes_
_years in fact_
"... a closer look."
Great video Chris, as always! One question, though - during the "table top" demonstration, if you were to place a blockage in front of it, would it still attempt to change direction? I ask this as it seemed you gave it specific examples to work with during that activity.
It might -- I actually never tried! -- as the trained net is still based on an initial model. But it would probably not be as good at avoiding objects, as I did not show it other objects. In the first collision avoidance demo, the robot was running using a pre-trained neural net, where it would have been shown a variety of blocked and free situations, from which it learnt enough to be able to operate in a space it had never seen before. Which is rather amazing if you think about it. It is also possible (although I have not tried it yet) to run multiple programs together -- eg one for collision avoidance (to keep the robot safe, as NVIDIA put it), and another for object tracking.
This can keep you busy for hours! This is a nice toy (with an excuse) in the name of science!
Amazing...If anything, AI shows us how we take for granted our own complex cognitive abilities.
www.3dmaxprinter.com/shop/do-it-youself/rc-robot-car-with-ultrasonic-sensor-for-education-robotics-robotic-car/
Move aside laser pointer, the cat has a new toy.
This is very cool! Now can you program it to search for a rabbit?
Greetings Chris!. Expecting some review about the up-board.
If they send me one . . . :) Their new stuff does look very good: up-board.org/
years from now our robot overlords are going to remember your kindness to one of their little ones.... they will be merciful to you
:)
A while back, I got an Idea… This is how it goes… You have an Artificial Neural Network (ANN), that is having trouble with a task that requires a perception of Time. What is a simple way to give it a perception of time? Answer: Give it memory. What is a simple way to give it memory? Answer: Use data from its sensors, taken at consistent intervals, and give them a “memory slot” in a cache. Use a small number of memory slots for progressively older sensory data samples. Whenever a new sample is added, delete the oldest sample, and shift the contents of all the other slots to the slots representing the sample that is one interval older than them, until the slot representing the newest data sample is empty, so that the most recent sample can occupy that empty slot. Feed the ANN from whatever is in the memory slots, as a separate sensory input. It will then be able to compare old vs new, and perceive changes from as far back as the memory slots go.
This will need careful optimization, to avoid overwhelming the memory capacity of the hardware that it's all being run on, and to not require a ridiculous number of “neurons” in the ANN to be dedicated to input.
One method of optimization, may be to also perform a resampling operation on saved sensory data, to step it down in size, every time the data is shifted to a new slot, whether immediately after it first enters memory, or if it meets the condition of being past a certain age, so that it loses fidelity, but still exists for reference for much longer within a given memory size constraint.
Some care should be given to choosing a good resampling filter. It should probably be a balance between accurate and lightweight for processing. And accuracy brings up another subject: Resampling images while stored in the sRGB color space, is mathematically proven to distorting the overall energy of an image. All camera input should be converted to linearRGB colorspace, if it's going to be subjected to resampling. sRGB is meant to make efficient use of digital memory, for cases where an image is meant to be shown to humans, by matching assigning more importance to ranges of the color spectrum that the human eye is most sensitive to perceives differences in. So sRGB is completely unnecessary for computer vision.
Another optimization method is to simply start with a smaller sized resolution for sensory input, or to use a color model other than RGB, such as Lab, where there is one color channel for Lightness, and two color channels for chromatic data. Then, you can aggressively down-sample the chroma channels by a positive whole number.
I've mentioned resampling a lot, but I think I should mention that I'm not 100% sure how useful it would be to save processing power overall. I'm quite certain that it will save memory, though.
What I would suggest is to put a sensor under it where it can detect edges, I have a robot made years ago that goes to the edges then stops because of the edge sensor it works like a charm!
But the point here is a demonstration of a vision recognition neural net that can be taught. :)
@@ExplainingComputers right :) I guess both does the trick!
that is awesome
Impressive. I was wondering if the nano module can be used on Xavier NX developer kit, as the Nvidia documentation state they share same pin out. Already have the nano module but eyeing the NX development board with it support for M.2 drives support
Great video as usual. Thank you for sharing and explaining the whole operation of this demonstration. I noticed that the machine turn in one direction only. Is this usually the case? Or can it choose to go the other direction if needed?
It turns one way just because the sample code here just says "straight forward, or turn left if the neural net reports blocked".
Looks like a smart vacuum cleaner.
Another fantastic video but perhaps it helps to highlight the problems of current AI approaches.
Bandwidth and data hungry, non transferable knowledge. Whereas a simple symbol based heuristic solution would probably suffice.
wow very nice project. 🥳 I sure miss the old Heath-Kit days. When it was a turn-key project with everything in a box and a great manual. Need a Teach-Kit company to replace Heath-Kit?
Tesla Model 3?
We don't need no stinkin' Tesla Model 3.
We've got JetBot!!
Hi Christopher, Thanks for the great video. Did you find the bot to be energy efficient? Or did running the NNs drain the battery quickly?
The battery lasted really well -- JetBot can run for periods of many hours on one charge.