Small Brain, Big Think: AI on the Edge
Вставка
- Опубліковано 6 вер 2020
- Cram deep learning in your pocket with these clever hacks. Discover how to stuff artificial neural networks into your favorite underpowered microcontroller!
Rad video about my Somatic data glove: • AI Data Glove: Somatic
Download my gawd-awful code: github.com/ZackFreedman/Somatic
I'm on the Instagram! Come look at my projects: / zackfreedman
Recipe for an Artificial Neural Network (Blue Mai Tai):
1.5oz hidden layers (white rum)
1oz transfer functions (fresh-squeezed lime juice)
0.75oz training data (blue curacao)
0.5oz input/output layers (Plymouth or American gin)
0.5oz validation data (orgeat)
1. Fit the model to the training data (shake all ingredients with a handful of crushed ice)
2. Load trained model in TensorFlow (pour into tall glass, ice and all)
3. Optional: Convert model to TensorFlow Lite (strain drink into a smaller glass)
4. Optional: Embed in firmware and run with TF Lite for Microcontrollers (strain into an even smaller glass, discarding excess)
5. Optional: Verify accuracy of quantized model (garnish with cocktail umbrella)
6. Run inference with the model (drink)
I learned this stuff from "TinyML: Machine Learning with TensorFlow Lite on Arduino and Ultra-Low-Power Microcontrollers" by Pete Warden and Daniel Situnayake. Jeez, O'Reilly, what a title. You can read the important bits RIGHT NOW on Google Books: books.google.com/books?id=tH3...
Thanks to my gorgeous wife Brooke for her tireless help in filming, editing, and cocktail testing.
Licensed and public domain assets:
Glass break, explosion, horror atmosphere SFX - ZapSplat.com
Interference SFX - Partners in Rhyme
"Self Driving" by Sro - FreeMusicArchive.org
"Colonel Bogey March" - Wikimedia Foundation
Thomas the Jerk Engine voice clips - TTSMP3.com
Russian EVA GoPro footage - Public domain, DL'ed from Archive.org
"Incredible Machine" - Public domain, DL'ed from Archive.org
"Threads of Technology" - Public domain, DL'ed from Archive.org
"Zip Codes with the Swingin 6" - Public domain, DL'ed from Archive.org
TV glitch stock footage - Videezy
Copyright holders:
"Scanners" - Criterion Collection
Thomas the Tank Engine - Gullane Ltd
Juicero - Who knows. Some VC?
"Nope" voice sample - Valve Inc. - Наука та технологія
I totally agree with the sentiment that "smart things" don't need to be "internet of things".
The thing about shmart IoT shtuff is: If the company that made my cheap ass "smart" electrical socket plug thingemagings goes out of business, I essentially have a very overengineered in-line power switch sitting there, pinging a site that may be bought by any random troll for cheap for all of of eternity. Once I got a job I'll invest in some Ubiquity plugs or even find the time to learn how to solder my own. With a VPN tunnel into my home network it'll be exactly as useful as before, but without the "sending random data to china" part.
@@fredwupkensoppel8949 lol
@@fredwupkensoppel8949 that was very specific
@@fredwupkensoppel8949 that's sounds more like an anecdote
Tasmota is great 😉
Dude, this is amazing quality content. I don't know how this video only has a few hundred views.
You're too kind. I'm still a new channel, and I think UA-cam's great and mighty Algorithm is still figuring out who to show my videos. I built it, so hopefully they will come!
Well it’s up to 13k views now
Agreed. Excellent content for the inquisitive hardware hacker. Subscribed.
@@Jianju69 I don't think he's hacking stuffs...
@@queenoffaygo it's up to 29k views. almost tripled in 4 days
Build a shoulder mounted turret that reads targeting info from the glove so when you flip someone off it shoots them with 3D printed nerf cannons
That would RULE
@@ZackFreedman I know the perfect partner for this project: Michael Reeves
The US Military has entered the chat.
DARPA has entered the chat.
@ShroudedPanda yeah...this glove could have an extra capability...electrifies people just with thinking 😬
You're the type of person I want my friends to be.
5:32 As someone working in a research lab, I felt personally attacked. In my defense, I was on a lunch break when I watched the video.
Keep up the good work!
As someone who works in full stack web development, your description of us is at least 80% accurate
LOL'ed at, "Get back to work! You've a virus to sequence!". Loving these videos.
Bro we looked identical
You both look like the ends of q tips
@@gravestoner2488 hahahaha 🤣🤣🤣
This guy is such a joyful combo of careless carefree humor and actual hardcore smarts.
As a brand new engineering student, your channel makes me excited to see what is possible with a little understanding. Keep the good content coming!
Agreed, we stand on the shoulder of giants with a LOT of understanding.
@@favesongslist omg why is everyone here thinking the exact same thing I'm thinking
Until your bachelors you will merely have covered the basics for all of this. They are importan and all, but its even more important to educate yourself with awesome content like this to see, as you already said, whats possible with stuff that you will think is useless (linear algebra and so on)
sry, just reread my own comment and almost suffered a freaking stroke. all i mean is that, you will hear yourself say "what do i need this for?". See all that crap you will cover are the fundamental basics upon which alot of more adanved stuff is built upon. I suffered the price for not paying attention in the beginning, i hope you dont get discouraged as quickly as me.
I understood the word "glove" and that's about as far as I've gotten.
Nice I thought I am the only one by looking at the comment section. Looks very interesting though :D
Same
Same
When youtube suggestions actually works well for you! I've binged 4 of your videos so far!😂😁you got good humor and projects brother! I appreciate you! #goals
Thanks a lot! I appreciate that. Enjoy the show!
I just binged the whole channel instead of sleeping
@@h3Xh3Xh3X it's the obvious thing to do.
I have nearly same lab like you. 90% of the tools is identical. I use a prusa printer too :) And i working on an AI controlled mini robot. So now i'm happy, because i found a same crazy guy like me. :)
I see you have good taste!
Should add content
@@dull218 I'm work on it.
@@gyorsomogyi Its been a year, get on it! I demand more mad inventor content.
lol! I am a "researcher working on sequencing a virus" watching this video for it's quality content!
As a musician I have often dreamed of a MIDI controller where I could sing a bass line then percussion then whatever into a loop and have the software pick an instrument to play based on the sound im making and parse simple verbal commands like pause and play.
Some time ago I thought AI would help me realize my dream but as I looked into it the process, huge computer / cloud requirements shot the whole idea down.
Thank you for making me realize it's now not only possible but portable!
Great channel. All the best.
Dude, pleasantly surprised by the quality of your content! I came to the video expecting some guy rambling on about general ideas on the subject, and was faced with a full all-out guide on how to embed AI. Hats off!!
New sub here... Just finished a 4 episode mini-binge and I am impressed with how you are able to present technical subjects with a humorous flare, so much so that watching episodes where I already know about the subject matter, such as circuit boards, was still bery entertaining. Here's to 100k subs! Almost there....Amazing, but well deserved, growth rate.
Jesus Christ just subscribed to the first video that I viewed. A few years from now on and this channel is going to blow haha. Good luck!
Californian's may not know this but.... lol. that right there got you a new subscriber.
We have surprisingly bad internet access in the heart of Silicon Valley. Comcast owns everything, so you have to sell a kidney for 100 Mbps.
@@EricLaspe here in Germany, i am happy, to have WiFi, since i would need to go up the next hill, just to send a SMS
@@EricLaspe Facts
_cries in Indian_
@@javidfarhan1675 cries in African
While i wont be tackling orignial projects on a scale that you do , your videos of your projects and a few other youtubers have got me into playign with electronics again , thanks :)
Humour is absolutely brilliant. More videos on edge devices please - thanks for the cocktail recipe :)
Here is a cool ideea: this glove can be used to communicate better with deaf people. You can make it to display words based on what you are doing with your hand in sign language. I think this would be pretty cool. I came from instagram by the way, keep up the good work!
Thanks a lot! That’s totally possible, especially with how flexible the machine-learning architecture is. If I trained it with words instead of letters, it might just be doable!
@@ZackFreedman Some university kids did this recently. Well I don't know if it uses ML, but they're gloves that translate sign language. It was cool, but I need to actually read the article sometime.
@@eatcomics That sounds rad. If you can find it, I'd love to read it.
Magical translating ASL gloves are a perennial idea. Unfortunately, it is generally a perennial idea of hearing people, and not always well-researched with linguists and native signers...
Anyone wishing to pursue this should start here: www.theatlantic.com/technology/archive/2017/11/why-sign-language-gloves-dont-help-deaf-people/545441/ grieve-smith.com/blog/2016/04/ten-reasons-why-sign-to-speech-is-not-going-to-be-practical-any-time-soon/
That project was very cool! And the TF Lite for micros looks very promising. So glad that found your channel! I'm enjoying every one of your videos!
From myself I'll add that if even after all optimizations you still cannot fit your model you can try to "distile" your network. It's a technique when you train a smaller network using the big network as an input. Sometimes it works and decreases performance by tiny bit but also deceases the model size significantly.
This really is one of the best programming/build videos I've ever seen, will definitely be watching the rest, amazing content
I have no idea what you're saying, but you're sense of humor is worth the brain scratching! this channel smacks of early "This old Tony". I love it!
The explanation, the tech, the guy from Scanners getting mind blown? I'm an instant fan. Subscription confirmed.
honestly if you could turn this device into a mouse pointer/replacement this could be a game changer. I currently struggle with hand pain and basically shouldn't use any kind of mice, not even ergonomical ones and thought about alternative input methods for quite a while to help with the recovery.
Might need to look into building one of these gloves to try it myself :D
Man, YT recommendation algorithm nailed it today. Fantastic work and love the production quality of the vid.
First time viewer and I know this video is 4mos old. Can't wait to watch more innovations! One thing I'd add if you haven't already is to add a segment of you specifically using the build as intended. THANKS FOR THE AWESOME CONTENT!
"stop watching youtube, ya slacker"
aight, damn!
3:52 I never expected two italian liquors in a machine learning video...
Why the devil NOT?
My man, you create such good videos and have such great ideas for content. Super proud of you and happy I have been subscribed for so long! I always look forward to them! For this project I knew how to do everything except the machine learning part and you explained that super well. I am still learning in that area but there is a lot of fun things we can do with it! Keep up the great work!!!
Absolutely delighted I found your channel! Maybe the algorithm is finally giving you the recognition you deserve. Really quality content. 🤘
Man I just found some high quality content here.
Please, please, please build a mosquito carpet bomber (with ai)! LMAO
Ooh, the wife is a mosquito magnet. She'd love that.
@@ZackFreedman I heard about some project using IR cameras, retroreflective tape and blu-ray lasers to zap mosquitos in midair. High-tech equivalent of mosquito netting that gets rid of those blood-suckers permanently.
@@ZackFreedman make artificial chameleon tongue mosquito killer
I've probably never been so glad for clicking yt recommendation as I am now. Amazing video, awesome projekt.
I had a project with edge machine learning this autumn and this video would have saved me so much time understanding it all.
Was refreshing to watch this after tho, awesome!
10:37 I see what you did there.
See, the real problem is you can't build a subscription model on embedded AI.
Incredible stuff! Subscribed! This is actually going to help me with a project I’m actively working on. So glad I stumbled across this video and your channel. Thank you!
I'm glad I got this on my recommend. Leaving a comment for the algorithm and also for the insane content. You're an inspiration !
Fun video, love the sass
Thanks my grid-shaped breakfast pastry brother
I saw the juicero in either this video or the one before it, and heard you mention chooching.
I see you. Also, subbed several videos ago.
Fun fact: I didn't intend the Juicero to be an AvE reference. I was just researching examples of ridiculous IOT devices, and every list had it. It's just such a ridiculous device.
@@ZackFreedman Truly, the Juicero as a product was such a bizarre concept. Really, I guess the device itself wasn't too strange, but their obscene super elitist consumerist business model certainly was ... special.
Thank you for teaching me how to make a cocktail 🙂
A high quality super duper amazingly one of the best content on UA-cam ❤️😎
You are awesome, Zack! I mostly only understand 10% of what you are saying but the humor, you skill and the content is awesome. Keep pumping out the projects! Best luck to both of you (:
Midway through I felt that there was something weird in his face and after a while I realized it was that he didn't have his screen classes on 😂😂😂
You are awsome! Can youtry to teach sign language to the glove and then make an integrated speaker voice them?
Loved it man❤️ I hope you get millions of views, cause you deserve it.💯
Good stuff man. as a layman, i feel like I'm learning a lot watching your videos. my favorites are the start to finish projects.
I’m a computer engineering major and I don’t learn how to do any of this in school, if you see this please tell me how you started and what you learn to figure out stuff like this
You should have access to a machine learning class. I took a ML class during grad school. If you don’t, MIT has some open courseware stuff for ML.
Dude, you remind me of a friendlier and funnier version of the Russian villain in Iron Man 2
Man, i love the content and also the presentation of it.
But I'm soo glad that this exists
Now I trust the UA-cam recommendation algorithm,
This is the best Chanel to start the year with! Great contents!
I wish I could understand whats going on. Great video, I guess?
This is way beyond my skill level but I love it. Keep up the funny vids, and don't get lured to the silly youtubers side, but I know you're too clever for that.
Silly? Me? Never. This is a serious channel.
No dislikes. Of course, well deserved! Awesome stuff as always. Glad you are growing so quickly and I wish you the best of luck in this youtube adventure!
This video! Amazing. Years ago I was trying to get NNs working on rPi, and it was nearly impossible as training took forever. This sidesteps it all and user the big beasts where required, and then you put it into a tiny uproc to really knock it out the park!
I'd love to see this as a device for translating ASL.
Omg yes! ASL live translation gloves
Pretty sure that they could cram GPT into this in a few years lol!
Isn't the whole point of GPT-2 and GPT-3 to have so many parameters that somehow it works?
Man the youtube algorithm realy loves you, you are gaining like 1k-4k subscribers per day with a channel sub 100k subscribers. Im not complaining love your content :)
This was a great video. I am an older computer guy that has a very small programming background (but growing) and I even followed this fairly well. Hell it was so entertaining that I will watch it a couple more times. Thanks man!!!
why am i watching this at 2am? i cant even code
yet...
Wow mate... I don't know how UA-cam recommended me this video but I was like in a dream while watching. Amazing content, thanks for doing it. I will definitely subscribe you, share you, and watch all of videos of you. Great work.
I have finally found a likeminded person. Thank you. I hope to follow your footsteps with the knowledge of data science machine learning and to combine it with my mechanical engineering / manufacturing experience
Extremely cool project. I might give something like this a shot as well to start getting more familiar with ML. Especially now that I know it's possible to pull things like that off on microcontrollers.
As an embedded engineer I'm usually kinda scared to veneer in higher level abstractions where I don't know exactly what my hardware and code is doing but it feels like that's where the future lies so this "locally done ML edge computing" on microcontrollers might be a good place to start.
I also liked your video about PCB evolution throughout history. I expect your channel to explode one day.
Great episode! I love this techy stuff 👍🏻👍🏻
Oh boy. The amount of effort you put into your Projects AND videos is breathtaking! Great Work!
I wish I knew enough about all of this to replicate your project but I am only a hobbyist and studies cell biology sooo...
Love the video! Tried to do this 5 years ago for a project which indeed couldn't rely on a stable internet connection. Amazing to see how far we've come! At the time I had to use a prototype sipeed risc-v microcontroller and 3 different chinese compilers to get the job done 😅.
Subbed and liked, great video! After watching 40+ videos on Tensorflow(light) the last 12 months, the UA-cam-AI didn't have to crunch too many numbers in order to decide that I'm probably in the target audience haha :)
This is pure golden knowledge. Thanks for the video, mate, this can level up anyone's microcontroller game.
Thanks a lot... I just ordered 2 Teensy 4.0's lol. Oh, and I binged all of your other videos. And linked them to all my friends and discords. You've got a lot of the same projects I do! Except... you finish them. And know how to do it... lol. Epic channel. Nice fast paced presentation which is great for my ADHD. I need to make a glove similar to yours.. but different
I don't know anything about programing yet found this so interesting and entertaining, this is Quality content bro!
1:03 - "...as they hammer away on their 60% ortholinear keyboards..." Never have I been called out so directly in a UA-cam video. You sir have earned this like and subscribe.
I didn't understand one bit of this video but sure loved this guy's passion and cool stuff he did❤️❤️❤️! Keep going brother ❤️
I used to be completly clueless to this world and now little by little this guy has taught me so much
I got your video suggestion, never saw your video this was first time, first time i subscribed to a channel on first video i watched. your awesome man
Thank god, youtube algorithm sending me this marvel. Great job mate, really love the idea and the no-fuss/friendly approach/
I'm so happy I found your channel!
This video should’ve more views and like. Thank you for sharing this.
Cool stuff. Nice project! Looking forward to see more notes from the front.
Right now I am working on a project that is very similar--I am aiming to connect a touchpad to a microcontroller which will translate the touchpad inputs into letters, and print them on a computer like a keyboard. This video is perfect! I have to pretrain a network to classify characters and then cram it onto a microcontroller (my choice was a Teensy 4.1, what a coincidence). Your video is exactly what I needed. So glad I found someone else on the internet who is doing something similar to what I'm doing AND made a great video on it.
It's totally doable. You also don't need to get hung up on configuring the touchpad for absolute input, since the network doesn't care. It should actually be much easier now than when I made this video, since TFLite has developed significantly.
Loving the film on the oscilloscope
You are incredibly talented
In my career as an assembly language programmer I use to love taking sample code from a software engineer that was megabytes of Matlab generated algorithms and reducing it down to only a few lines of assembly instructions.
The sneaky reference to the 1000$ bag squeezing cashgrabbing "robot" as an analogy of the overkills crippling nowdays technology... You made my day sir
Juicero hits different when you build products. From my end, the high-pressure juice press mechanism is incredible, and the Wi-Fi fruity DRM is the dumbest part
Night sight turned on in the middle of the video and the programmers tan turned into jaundice.
Keep up the good work!
Just excellent, thanks for sharing all the hard work!
Wow, I recently started watching your more recent videos over the past month and just found this one. Damn that is really really impressive !!
This has to be turned into a proper VR input controller, goodbye overpriced valve knuckles, this is going to blow them out of the water !!
And you just added a couple more memetic pixels to my understanding of real world AI programming ! Thanks ! I feel like I could almost make one of those tensorflow thingy if I really had to.
I am so happy this video showed up in my feed
I have almost zero experience with coding but I found that I could almost follow all the way along. You explain things very well! Thank you!
I am learning a lot. And loving every second
Never ever stop uploading
I'm going through all your stuff since I found you and I gotta say I love the run dmc parody shirt haha
I remember when Amazon came out with a paper describing a way to make big neural networks small with similar performance by quantizing down the values. Neat to see it applied! :)
One of the best vids I’ve seen on the Ytube
OMG!!!
That's just amazing !!
I hope you reach a million subscribers soon
Great work. Keep it up man. Respect.
First of all, Zach your channel is A+ godlike froth. Second of all, check out the oscilloscope video from Smarter Every Day about drawing with sound waves if you’re not already familiar. Thank you for sharing and I look forward to all of your content yet to come.
Slick video! Amazing work there!
Love this video bro, very nice👌, killer content!!!
I'm really enjoying your content. Thanks!
Really nice video. explanation of edge computing was perfect.