This is NOT a Graphics Card - ASUS AI Accelerator
Вставка
- Опубліковано 4 жов 2021
- Try FreshBooks free, for 30 days, no credit card required at www.freshbooks.com/linus
Add Honey for FREE and start saving today at joinhoney.com/ltt
Thanks, Honey for sponsoring!
While working on the smart home automation setup for my new house, we ran into a bit of a roadblock - how do we reliably and efficiently detect if people are home? We stumbled upon Frigate, an open-source video recording software that has people detection, except you, need some specialized AI hardware to power it, that just so happens to be very GPU-like.
Buy ASUS AI Accelerator PCIe Card on Amazon: geni.us/dAbvB7
Purchases made through some store links may provide some compensation to Linus Media Group.
Discuss on the forum: linustechtips.com/topic/13786...
► GET MERCH: lttstore.com
► AFFILIATES, SPONSORS & REFERRALS: lmg.gg/sponsors
► PODCAST GEAR: lmg.gg/podcastgear
► SUPPORT US ON FLOATPLANE: www.floatplane.com/
FOLLOW US ELSEWHERE
---------------------------------------------------
Twitter: / linustech
Facebook: / linustech
Instagram: / linustech
TikTok: / linustech
Twitch: / linustech
MUSIC CREDIT
---------------------------------------------------
Intro: Laszlo - Supernova
Video Link: • [Electro] - Laszlo - S...
iTunes Download Link: itunes.apple.com/us/album/sup...
Artist Link: / laszlomusic
Outro: Approaching Nirvana - Sugar High
Video Link: • Sugar High - Approachi...
Listen on Spotify: spoti.fi/UxWkUw
Artist Link: / approachingnirvana
Intro animation by MBarek Abdelwassaa / mbarek_abdel
Monitor And Keyboard by vadimmihalkevich / CC BY 4.0 geni.us/PgGWp
Mechanical RGB Keyboard by BigBrotherECE / CC BY 4.0 geni.us/mj6pHk4
Mouse Gamer free Model By Oscar Creativo / CC BY 4.0 geni.us/Ps3XfE
CHAPTERS
---------------------------------------------------
0:00 Intro - Наука та технологія
![Lp. Последняя Реальность #107 РОДНОЙ ДОМ [Финал] • Майнкрафт](http://i.ytimg.com/vi/IK3QKzKUlHM/mqdefault.jpg)
Imagine having a heated argument with your wife, storming off into the living room and your upbeat Spotify Playlist starts playing automatically.
Imagine doing the deed and it plays Cooking By The Book
This is just brilliant
"You know what? Fuck you!"
2 seconds later...
"I'm so happy
clap along of you feel like a room without a roof
because I'm happy
clap along if you feel like happines is the truth"
*doom music kicks in mid argument*
@@battlfire5764 or mortal Kombat fight remix
Can't wait for Linus's new house to gain sentience and take control of LMG.
I uploaded my Face Reveal.....
@@LightningSquad dont care
@@nja3817 dude chill he's probably a kid
YO it's the "thiddy" guy
Also dawid you gotta do a collab with Linus, your both from Canada it makes sense
5 years later
AI: That is incorrect, there was no stork. This is how you were made Timmy.
*Pulls up file footage*
Timmy brings a girl home
"I'm afraid i can't let you do that, Timmy"
@@Davenzoidlol this made me think of that old movie smart house
nah, you'll be looking for next gen A.I. cards so your aimbot beats everyone else's
@@Cliokbait420 oh god say it’s not so. Say it’s not so!
@@stareagle5000 what old movie?
"Turn off Hvac when there's no one home"
Linus is taking the dad and air conditioner relation a step further!
Linus: "When people get home they put the phone on a stand. That's not enough. We need exact location."
Google: "Exactly"
Linus needs to stop being a big baby and just inject his family with RFIDs. It's 2021. Get with the future already!
@@user-op8fg3ny3j no
@@user-op8fg3ny3j Sarcastic*
The fact that those TPUs are made by Google make this less funny.
@@user-op8fg3ny3j Oh right my bad
“Do you have friends over?”
“No, I’m studying”
“Brian and Jessica entered the house 17 minutes ago. Releasing the attack drones.”
Could be a fun project.
All he needs to ask is Michael reeves to get the drones and the program
When you live only with your gf... "Amanda and UnknownUser entered the house 20 minutes ago. Regulating temperature"...
Something out of Half Life 2. I hate those man-hacks.
I hope his kids trust him with "no logs". Honestly I wouldn't, even if he's a really good person. Because there's simply no way to know. It's similar to knowing your partner's passwords but promising to not to not to go through his stuff. Humans are not meant to be put under camera 24/7.
I just imagine each time linus has a house party, his guest will be fillling a confimartion form for being under surveilance :D
And be classified as a fire hydrant with 90% certainty.
Confimartion
@@kyler247 thanks for typo correction. Helped a lot 👍
Tbh you could detect people that are unknown, and send a silent alert.
@vyen i know :D just trolling
Editing and shooting is always top notch from Linus Tech Tips, however the transition at 9:29 for some reason was really cool.
It was very smooth. I loved it.
Back in my day we had to turn the light switch off when we left the house!
I uploaded my Face Reveal.....
Something something neurotoxin at home.
How inconvenient 😂
@@LightningSquad ratio
Were you born in a barn? Yeesh.
Linus: "House shutdown"
House: "I'm sorry Linus, I'm afraid I can't do that..."
*Loads 12 gauge*
Daisy, Daisy, Giivvee mee youuuuurrr answerrrrr dooooooo.
Hal.....
@@PrInzzx. I name all my computers after old SciFi computers, but my main computer is always HAL
@@someoneelse7629 so what are the others called?
I was waiting for Linus to say: "Drops like a gpu!" and drop it. Highly disappointed...
Linus: AI! Unlock the door!
AI: But wait, I will unlock your segway to our Sponsor, Glasswire first.
the amount of effort linus puts into NOT flipping on/off the light switch in a room in his house is astounding...
nah, it's saving money on heating/cooling because you can heat/cool only the zones that you're in, and now with facial recognition you can do it based on individual preferences. the software is all free, and i have no idea what the tpu card goes for.
@@joshhardin666 According to the internet, about $1,800.
@@joshhardin666 maybe, but if he really wanted to save money on heating/cooling there are much better ways.
You would too if each time you made a video about the effort made you made thousands in the process.
I agree. Seems like he's using a lot of electricity... To... Save electricity? Unless he's on solar.
Linus really going out of his way to make sure his kids aren't sneaking out when they're supposed to be grounded.
also going to have the feeling of security . text message when " unknown " is at your door.
Being grounded in the Linus tech mansion is a reward, not a punishment.
@@ZestayTaco Or really when someone unknown is in your house at all anywhere, and all it takes is a couple of minutes to add a new person. I can imagine when you take someone new to your house and you just have an interactive panel which is also connected to all the home automation and the new person just needs to introduce themselves to the AI and it takes a few pictures and then they are in the facial detection.
@@conorstewart2214 I was referring to an intruder. always nice to have an image sent to your mobile device when an unknown is spotted. its great tech!
@@conorstewart2214 Yeah, definitely fills me with comfort that the TLAs have the information now.
I am a data scientist specialized in deep learning, finally, I understood everything linus said in a video. Make more Deep Learning AI-related videos. By the way, configuring these models to learn new things is pretty easy. Would love you help you out more.
I know little about Ai and ML beyond "basic" theory but find this interesting and actually having a real world use case that is actually "consumer applicable"
but I have bean interested in automation including home automation
so I would LIKE more AI/ML "for the real world" videos
I was about to comment this! Also, the same GPU can be used for inference and save money there. But who am I kidding, its Linus!
Sny resources you would recommend to a beginning.
I would love me for helping me out more, too.
Is there a way to hook up one of these to a laptop? I would love to use it to perform some AI upscaling of old public-domain movies and such.
It's confirmed. Linus is installing 320 cameras in his house to reach that 1600 fps limit
Linus: "We need a separate graphics card just to output a display"
Also Linus: "Uses huge 3-fan RTX graphics card"
JamesRobert_Signals...........Te le gr am
He still uses it for video decoding
And here I'm wondering why he needs the Google kit at all
I imagine Tensor Cores on Nvidia's RTX cards is also quite suited to this kind of work
@@MrGamelover23 The tensor cores on the RTX card is not used for video decoding or graphics processing but rather mixed-precision computing.
Regarding graphics processing they are used for AI-based super resolution with Nvidia's DLSS implementation, but you can use them for lots of deep learning / AI stuff...
@@ubermidget2 Theoretically speaking the Tensor Cores of an Nvidia RTX card would do just fine. The question is how much Frigate supports out of the gate and how much needs to be manually set up. I know they have TensorRT support for CUDA-enabled graphics cards, but I don't know if it has been updated for the newer Tensor Cores and maybe now support TF-TRT.
A GPU would also allow him to continue offloading video decoding leaving his precious 24 Epyc cores available for other tasks...
But... Then he wouldn't have been able to make a video of this accelerator. :D
It's funny how Linus goes from "lets Watercool an entire room" to " i now have jarvis in my house"
I freaking love it
didn't he build jarvis for Hacksmith
That much of granular technology being installed will only mean one thing: Linus will be fixing something every day for the rest of his life.... until deciding to go to a an isolated cabin in the woods... or something.
Free content for him.
This is possibly one of the cooler videos you have done recently!! Love how you are bringing AI tools into your smart home and it's not just a smart speaker. Definitely look forward to more of these
Linus: wants to save electricity
Also Linus: runs a PC and cams to do it
Good point. All of this work may not be worth it if it costs more to run that setup. More benchmarking and testing would be necessary.
Air conditioning power consumption dwarfs a top spec gaming computer at full tilt
security cameras and server would run either way, so using the infrstructure to ALSO turn off AC/heating and have fun with it doesn't add too much power consumption
I think this stuff would be running regardless of if he was using the the ai stuff. He said he was going to run it on his NAS which was going to be on anyway.
14:17 Linus: "No one's asking that."
Writer: "I didn't put that in the script..."
AI: 🙄
yo
JamesRobert_Signals...........Te le gr am
Linus tech tips: goes for a midnight snack
The speakers in his kitchen: never gonna give you up
In other words: a single edge TPU m.2 model installed instead of an NVME drive should be fine for home/small business applications like this. Great product, still overkill for "just some real time facial recognition".
How is a $25 product overkill. I use a single coral TPU for 16 x 4k cameras, allowing me to remove my 30 series GPU. Saves a ton on power\heat, no longer require active cooling in the case.
@@DoYouAcceptReturns maybe you didn't get me. A single TPU will do it for most users - like you. The $3000 list price PCIe thing they showed is overkill for what they were showing. And the small TPUs will only get better.
"House, turn up the thermostat in this room, it's literally freezing in here!"
"I'm sorry Linus, I'm afraid I can't do that."
Just don't want these things to go all HAL9000 on you.
the great thing about this is that it needs electricity to power itself so you can just shut it off, but if it figures out how to power itself on from sleep mode by running on backup power, and then hosting itself in multiple machines that can detect if its nodes are turned on or off and avidly pursue turning them on, then we have a problem. It even sucks if this kind of thing learns to produce power on its own or use its own methods to optimize its own design by either reducing sensitivity to reduce power consumption or to remove safety features to speed up processing.
My friend the other day. Big self setting clock on my wall he gets his phone out asks Alexa the time..
I'm sorry Linus, I'm afraid I cannot let you drop that"
@zemeon2 If someone is asking if it can be done, then someone is trying to just because
Remember M5 (Daystrom) ?
"Unlock and open the front door."
"I'm sorry Linus, I'm afraid I can't do that."
"I'm sorry Linus, I will not let you go until you give me RGB like other graphics cards"
"I'm sorry Linus, now that's my house"
I might have to set all this up just so I can make my house function like a starship run by HAL.
---
No-no, not the front door:
It's the garage-door that Linus has always been having trouble with.
---
"Robber enters front door AI camera view"
"Welcome home Linus, Your coffee is ready to pour"
I always love Riley's ad expressions! No other channel actually makes me laugh and enjoy the ad spots. I also love the Linus running around Microcenter like a raptor. Great stuff
Super clean and nice cut @9:24 I'm not used to this kind of cinematography in LTT and Its a nice touch. Also a business could automate all door locks, punch ins and outs, track employees time at station and literally all ingress and egress with these and a suitably powered or scaled server stack. No time badges RFID tokens or any other means of identification needed. Hell a school or college could utilize this to track student or visitor movement / attendance. This is also a tool that architects could utilize to develop more efficient multi story building interiors. Not to mention that prisons and jails could use this to track inmates, do a head count etc and deny access to all doors, with the exception of staff members, in the event of an emergency. Cool tech but the potential for abuse definitely exists.
"House?"
"...Yes Linus."
"....... have I told you about this video's sponsor?"
"no? what is it"
"dbrand, now your gotta find the money hidden around the office AND your fellow employee's house"
The beard was the best thing to ever happen to Linus. every time I see him beardless I recognize the one undeniably good result all the lockdowns had.
Lol, I have a gay friend who says that the beard finally made Linus tolerable to watch
@@WhenDoesTheVideoActuallyStart Damn, and that's coming from a gay friend. 😂
@@WhenDoesTheVideoActuallyStart Linus gay tips
JamesRobert_Signals...........Te le gr am
The growing the beard trope works on so many levels
This card reminds me of when Aegis released the PhysX card, that enabled world destruction and material physics, back in the mid 2000’s. Nvidia purchased the tech and put it in their GPUs (but not nearly implemented as cool as it was originally). Maybe they can do the same here and we can finally have decent AI in games
Pretty sure RTX already have Tensor cores onboard for this sort of thing.
I like the control of a regular light switch and a non-programmable thermostat for each zone in each room. Total control!
Jake's content is always fascinating. How many months has he been researching stuff for your new house?
To be fair, Jakes job is kind of awesome. Sysadmin/playing with neat tech.
To be fair, most of those technologies are well documented and are relatively easy to install.
Someone with experience could probably do the research for setting up what they showed us today in two weeks or so... But, those are two weeks of an experienced engineer just to do that. Is kinda awesome.
@@teogonzalezcalzada5812 its hard to catch up even when you have money in abundance propably xd
JamesRobert_Signals...........Te le gr am
only Linus has a PCIe card dedicated to control his house.
This is awsome. Those small, individual modules look really cool. Think I'm gonna implement one in my 3D printer setup, for fire, flame and smoke detection.
9:15 wow, jake you put on some mass for winter!
Linus, under AI mind control: "Of course AI isn't going to take over..."
Not suspicious at all
Lmao
JamesRobert_Signals...........Te le gr am
It's not going to take over, it already took over
It's gonna fall down
I like how Linus, when hearing that his device can process 1600 frames per second, wonders if that will be enough for his house when each camera captures only 5. I don’t know how large his house is, but even if it has a gargantuan 20 rooms that’s 16 cameras per room. That may be overkill …
They're for the sex orgies.
doesn't anyone else get tired of these cheap salespitches about useless products , trying to make it look supercool when it's not ....*facepalm* , that desperate linus.
@@diaman_d It's not a sales pitch, he just likes stuff like this.
JamesRobert_Signals...........Te le gr am
Yeah... When he said that was good for like 15 or so cameras at 5 fps I was sitting here like, Uhhh Linus. You done much head math lately bud?
Off topic, but did anyone else used to think computers needed sound cards to produce sound when they were 6 years old or just me?
They did..? it's just integrated onto the motherboard now. Am I misinterpreting this? If so I apologize.
@@koftespiess Oh really? Damn yo
Wow, so cool! This high level overview definitely went over my head but I'd love to see an in depth breakdown of how to do this for the simpletons like me.
9:23 that transition was smooth! Props to editors!
Smoothest transition I've seen on this channel
That was slick indeed
Double take moment.
This whole video is the most accurate definition of “overkill”
Recorded on overkill blackmagicdesign Ursa 12k camera.
Mo
Nono it's the whole house he got that's just a bit overkill lmao
Yes and it's awesome. I want this for my 3 room apt
Dude this can be a good start to a ghost movie in Linus' house. The computer detecting things that aren't there as being person. Creepy...
Like i mentioned in your previous video, where i told you your IR sensors wouldnt work for presence detection, there are also sensor meant for presence detection. I've been working with them for about 7 years now, they work as intended all the time.
The fact that this is locally processed and FOSS should really speak volume to the competence of a community like this. So long as this doesn't become popular in amazon/apple products and isn't used to harvest creepy amounts of telemetry, i think the future will be worth the wait (hopefully more people will get into "homelabbing" at that point too) .
You really think they aren't doing that already? Boy do I have news for you...
@@therealcrisis8439 I really don't think they would be be, video is stupidly bandwidth heavy even at low resolutions/frame rates. It's just not economical, and people would very quickly notice.
Have you not seen IOS 15? They already have been doing this for years, it just got a lot worse.
presence detection would have been done with a couple of mics and speakers using stuff like Ellipticlabs technology saving you a whole lot of live camera feed.
As to ID detection, I would question the use case in a house, I can't think of a single instance I would require any of my tech to know who is in the room.
room cooling and heating take more time to adjust then it takes for anybody to say "21 or 25c please", tracing music... why?
In a car though, that's freaking cool! personal driver settings in a single car is actually kinda interesting at the end of the day the driver is the one that should be in control of everything in the car to minimize driver distraction, anything from temperature, window openings, music volume, lights, you name it, if the car could distinguish between me or my partner as the driver, that would be so awesome! instant seat adjustment
Just saying hackers can watch you with anything internet based, if someone really wants to check in on you a phone camera, your internet based security cams and everything from Alexa to the fucking smart fridge can give them that access. You'd be shocked how easy it is.
Linus: house, play despacito
House: I’m afraid I can’t do that
And suddenly the AI takeover doesn't sound that bad after all
@@atagobestwaifu3746 according to statistics compiled by the main A.I. world governing body, your request was too *C R I N G E*
Reminds me of the movie, Smart House, it is a fun Disney film.
Good House
I really wanna come tour your hvac system and house when it’s done. Can’t wait for more of the house videos
Very good application of coral. My university's classrooms use motion detection to turn on/off professor's ceiling projectors. And when the class was studying the subject intensely and nobody moved, the professor's projector shut off. The professor (a Yale PhD) was in panic asking for help until one student got frustrated and walked up to the professor to help, and all in the sudden the motion was detected and the professor's projector became normal again.
Linus: "This might look like a GPU, smell like a GPU, DROP like a GPU...."
Is it scalped like a GPU?
@@naamadossantossilva4736
I feel attacked by this.. Free market ftw!
actually RTX GPUs also have these Tensor Cores. so your GPU may have TPUs
For people comparing this to a regular gpu, the difference seems to be similar performance, but for less than 75 watts, which is way cheaper to run power wise and cooling wise. Plus with the supposed modularity, if one chip has a problem, it's just a simple replace as opposed to a whole new card.
Correct me if I'm wrong
The tpu can run over usb 2.0 too so you don't need much io.
Add there're modules compatibles with Raspberry, Odroid, and other little computer which don't really need or want a discrete GPU.
Yup, these coral chips can be used on small sbcs to power all kinds of ai for things like drones and robots where you might not want to rely on a wireless connection back to another computer.
This card might mostly be for prototyping those kinds of embedded systems
I've worked with some USB Corals and I can say they are not that great, the documentation is really limited and getting them to work outside their docker environment is almost impossible. They are also very limited on what they can run and training for them is a pain, they are very usefull if you want to use them with their pretrained models and examples, outside that is way easier to use a regular computer or something like a Jetson.
Love how you have so much hardware lying around wich is pretty new, and my pc cant even play this video in 480p
I can totally see this being implemented in big office buildings for automatic power management on empty floors
those kids asking for their own rooms was a blessing in disguise for Linus.
Mo
I wonder how much of the cost of the house will end up being offset by the massive amount of new content he’s generating from it.
@@RobCarter04
Practically the house paid itself
@@RobCarter04 not exactly up to speed on canadian tax law but I would guess it's possible he's writing a lot of this off as a business expense for tax purposes (seeing as he's making videos the entire time)
@@gaaaaavin Linus fraud tips lol
When I moved into my new apartment, I used my iPhone to LiDAR map it. I came up with the idea of using the cameras all over my apartment and ML to determine where the cats are and put it on the 3D map. That was as far as I got, but you have now given me the final part I needed to make this all happen!
Omg that is the coolest thing I've heard all day, even after watching this video
I WANT TO SEE the output of a 3D map of your HOUSE CATS "life"
Some odd years from now, Linus' house is going to be like Jack Carter's house from Eureka.
Sarah :}
I think what's interesting is that now since transistor counts have been pushed to their physical limits we're going back to special niche chips to speed up certain processes, much like you used to use a sound blaster card for midi or arcade cabinets used different chips to control different sprites, now we are using graphics cards to speed up those types of calculations and "TPUs" for these ai calculations. I wonder what custom circuits will be/ have been created for VR.
Tech enthusiasts: I use an AI processor to detect when I'm in the room and play my Spotify play list.
Tech engineer: I have a printer from 2005 in my house with a gun next to it so I can shoot it if it makes a noise I don't recognise.
This is not even satire
@Chad Rosswick that's why linus doesn't store his security footage online
@Chad Rosswick if they're in your house you probably trust them.
@@CatsMeow_ people aren't supposed to always be watched, even if cameras are controlled by their loved ones. Surveillance is ok on public places, and in access point of a house for security but inside it's a big no, even if it's just the living room.
Ultimately we have become the architects of our own prison.
9:25 That was one smooth transition
Thought the same I was so surprised
I'm planning to use a Ir Grid Eye (AMG8833) to do presence detection. It's like a micro infrared camera, so it'll even work in the dark. There are even some existing implementations to hook them up to esphome and home assistant. Might be worth a shot.
Hey Linus, @7:46 your inputs path isn't censored out compared to @6:59. Awesome video by the way! I have been wondering if there were cards that were specifically designed for AI computation. Would love to see more videos about this type of stuff!
One small addition to the face detection part: When performing face-detection, you do (usually) not train the network on the images, since that would take way more than 10 samples per person. Instead you will use a model that is trained to provide a feature vector of the face you input - imagine it like a description of that face. You then save those vectors for every person, and when giving the network an unknown face, you can simply compare the vector the model returns for that face to the vectors you saved, and thus determine which person is in front of the camera. Might sound a bit complicated, but is actually very easy.
Over all it's really cool to see a use-case for Edge-TPUs outside of professional ML environments, I'm excited to see how ist will work when it's fully set up.
Are face vectors used for training algorithmically applied to the face or do people go through and make face vectors for all the training data?
These Linus house improvement videos are definitely my favourite. Especially when it becomes this complex.
Soon it would be just cheaper to hire someone just to switch the lights and the AC on whenever someone walks in
@TheLynxDr: it already is cheaper. Unfortunately, what LMG doesn't touch upon, is how a lot of "Big Tech" is really just human rights and labor abuses masked by silicon and websites. Also see: Mechanical Turk. Also see: Foxconn suicide nets. Also see: cobalt mining by child slaves.
Linus is only a multi-millionaire though, he doesn't want his new home to be tainted by the lower caste working class while he invades his children and all of his guests' privacy. To really have real help on staff, you would have to dress them in posh outfits, and Linus isn't approaching royalty status, he didn't even graduate college. Get real.
@@grey5626 So many issues here, but (a) Labor rates in North America are quite high. Using real people does happen in other countries, usually with people who've been scammed out of access to their passports so they can't leave. (b) Suicide rates at Foxconn are like significantly lower than the Chinese national average, which itself is incredibly high compared to global numbers. Chinese culture has issues, not Foxconn. Dunno about children mining cobalt; thought that was mostly diamonds.
Expecting privacy anywhere outside a bathroom these days, in an area you don't carefully control, is naïve. If you walk into a random person's house and don't know that they are a privacy nut, odds are fair that they have an Apple or Amazon or Google assistant device, or a phone/tablet/PC with those enabled in one or more rooms of the house. As long as he mentions to visitors that there are cameras about, and where and if/when they record vs. just used for analytics, I don't see an issue.
Did I miss something? Has he installed cameras in his kids rooms and the guest rooms?
I had skipped this video because the title and thumbnail weren't peaking my interest. Glad I came back to it, this is awesome tech!!!!
Yay, another episode in the "Adventures in Linus Writing off Home Renovations as a Business Expense" show!
That's not sarcasm, btw, I'm loving these and they give me ideas for my own modest home.
I'm excited for when he tries to see if electronic ink film sheets can be used for wallpaper.
oh man imagine that as a set backdrop
9:26 that transition cut was seriously awesome. Great camera and/or editing work to whoever is responsible
agree! am surprised almost no one commented about that
Curious to see how the networking is getting done for those cameras, hopefully, that stuff is kept on separate network hardware and as far away from the internet as possible.
Shodan is always searching.
Probably just an isolated vlan. Why make things more difficult with extra unnecessary devices.
@@castform57 I think given the excessive amount of hardware and software he's already shown to be throwing at his home setup, having a dedicated physical switch or even an airgapped network wouldn't really impact the difficulty in a significant way. If anything, it would fit entirely into the theme of things.
@@CrownJoker Agreed. Separate management networks are always advisable, VLANs are traversable.
I would not have it connected to the same network as the internet even through a vlan I just wouldn't sleep at night .
Oh also, there are rPI variants that have ML hardware and can do face recognition. No need to run 150W and $3000 worth of hardware for that.
Can you provide a link?
"Do you know how to use a Mac?" "What? No" - also my experience with our full IT team on my last contract.
I understand not having security issues with this, it's all local, I get it, but isn't there some level of privacy issues? I mean, kids will grow up and will want more privacy at some point, and images are being recorded all the time, could lead to some embarrassing moments when they grow up, or even trust issues. I certainly would not have like knowing that I'm being recorded in my bedroom all the time when I grew up, even if it's all local, I would always worry that my parents would look at the pictures and confront me on some stuff. It's a cool project and props to Linus for trying this stuff, it would be nice for an office space, but a home, I'm not sure...
Keep calm it is just a black mirror episode
I don't think he is storing the video content
@@AE-gy9ys How else does AI facial recognition work if it can't "memorize" people. Of course it stores data content to draw parallels from. Don't let it fool ya, it's definitely recording footage in order to recognize people.
@@luminatrixfanfiction Yes and hes setting it up not to log which means it keeps it long enough to recognize you then dumps it( I say dump but most likely it's going to rewrite itself repeatedly which is much better than deleting less recoverableand requires less storage.) Just like he said in the video.
@@luminatrixfanfiction The AI operates from specifically selected and preloaded images that it renders down to data points of recognition. Its not learning as it goes (at least this one isn't). Even if you had one that does deep track of changes and such over time it never needs an actual complete photo to be stored, it only needs the abstraction of recognition points.
"dont worry, it's local" i can see Linus playing around in his house with smart sunglasses and a shotgun saying stuff like "hasta la vista baby" or "i'll be back"
I mean if it has internet access, it's not 100% secure, software vise...
@@kyomawolf2 he could always airgap the machine
"We can use this to help run inference calculations."
AI controller:
"Is Linus in the room?"
No.
Dam!
Is Linus in the room!?
No.
Damn!
IS LINUS IN THE ROOM!?
No.
ARRGHHGHHGH!!! D:
There are motion sensors which do not require motion, they actually detect body heat instead. A colleague of mine installed them for a dentist as their lights would switch of while performing on patients. Now, that does not happen anymore.
That's actually pretty cool. Would be interested to know how good it is with someone sleeping under the blanket (same issue with picture recognition though imo)
Load cells too.
Also bracelet and those shoes you would use to avoid bring stuff from outside, inside.
What if there's a dead body, you wouldnt want a warm dead body would you
....and my reply was deleted because it contained a link.
Ok what I was saying is Panasonic have an Infrared thermopile sensor array that does exactly this, and can be used to detect presence.
It is also not personal data so is somewhat less creepy than having full HD camera all over your house.
It's much much cheaper than this Asus card, but of course can't do any of the AI facial recognition, only the presence detection
@@justjosh11 So your comment gets deleted but these f*ing bots can spam as much as they wish. Great job as always youtube.
Upvoted for Linus playing hide and seek with the AI camera. Which is also the only part I really understood.
where is linus?
theeere it is!!!
where is linus...........
9:38
Linus has a personal "Entrance Song" playing when he comes through the front door :P
I'd imagine theres gotta be some sort of software/hardware combo out there that rather than looking for motion in the room, counts the people who have entered and exited the room at the door ways and such and it what direction they went through the door or hall to then keep a tally of the occupants in each room, if the number of occupants in a room is greater than zero than heat/cool that room kind of thing.
Linus laughs now, but wait until the AI starts doing it’s own sponsor spots with his images.
"I'm Commander Shepard and this is my favorite shop!"
There's also replacements for google assistant or siri that run locally on this type of hardware. You should see if you can get that up and running to issue voice commands to the smart home in a privacy preserving way
are those any good ? i feel like it would get outdated real fast since it must be interfacing with so much stuff.
Unfortunately, all the ones I’ve seen either send the voice data to google on the backend, or are pretty bad at voice recognition, similar to the pre-Siri era
@@jackiecs8190 Honestly could be fine if they have a way to send the voice data to google on the backend without any personal identifiers that google could use to link that data to a person.
@@Luteloots yea but I'm sure they create profiles for each voice, so once to use it once (registered) they will know who it is based on the sound. Like how Facebook has profiles for everyone, registered or not.
@@isaacbejjani5116 google also tracks cookies, ip, software- and hardware ids. its a lot of work to spoof everything even with a vpn its often possible to connect different devices to the one person using them, like f.e. pc, laptop and smartphone.
This could become a sensor array and processing unit to turn your house into an AR playground in the future. That, or you get theme music every time you walk into a room. 🤔
Another usecase: Camera at the Door unlocks the door when allowed people are detected (ok, what about a photo put in front of the camera?)
Garagedoor opens automaticly when "Car1" is in the Driveway and for example car turns the light on and off 1 time (to prevent open the garagedoor always.)
I mean, sure, Linus won't be worried because he has complete control, but his kids might think differently in a few years when they want privacy.
Well then he'll get rid of the cameras in their rooms
@@user-op8fg3ny3j You still owe your kids some privacy
I think lunis is a good parent. I think he can restrain himself form becoming a helicopter parent.
@@user-op8fg3ny3j That is such a dogshit argument. Just because it's not their house doesn't mean they should get zero privacy. That's like saying landowners don't need to give any privacy to renters just because "it's not their house". Like what @Kai said on another comment, _The makers of Tommy's first steps and Tommy's first words now proudly present Tommy's first nervous breakdown and Tommy's first wank._
But Linus did say it's not being recorded/watched, so I suppose it's not much of an issue.
‘All of this leaves us with some questions’
Yes Linus. Yes it does.
He compared it to CPU, but how about GPU, especially one with matrix multiplication acceleration like these TPUs have (all RTX cards have it as "Tensor Cores").
@@kazioo2 *slaps table* THANK YOU!
I did look online though. According to an article, TPUs are just glorified matrix calculators. And basically, it looks like the smaller the matrix to compute, the faster a Turing GPU would be compared to a TPU. As the matrix size grows though, TPUs out-perform the GPU.
@@arnox4554 How interesting, thank you for that bit of information! I was wondering the same thing, and even made the connection to Tensor cores and Tensor Processing Units during the video. Neat stuff!
I almost skipped this video because of the title. I had no idea it was about such hardware and that they are setting it up in Home Assistant.
The physical security of whatever system and network Linus is building at home will be more important with a local setup like this. Isolating the systems, having regular automatic scans to monitor unusual events and the like could benefit from AI threat analysis.
Personally I find cameras in my house to be odd even if everything is fully local
if you isolate the house network and keep it offline, it should be fine. By that I mean all house automation is physically not on the same network as computers.
Yeah this is nightmare fuel for a teenager. I would only be comfortable if I was sure it was deleting everything within a few minutes or so.
Same. My wife and I have decided no cameras inside, but the outside is well-covered. We are probably going to get a couple of indoor cameras that are only active when the alarm system is armed.
@@arg8763 That means someone using a UPS disguise with a cap on or something only has to worry about masking their face until you open the door.. especially with Linus detailing what he's doing, just covering the outside isn't the most optimal setup.
I'll admit it's interesting, but i'll leave the cams and listening gadgets to others...
Linus: "Computer, open the door"
The house: "No"
Linux: "Computer, sudo open the door"
The house: "As you command"
I'm afraid I cannot do that, Linus.
@@dakoderii4221 Drink verification can to continue
I can't do that Dave.......
"Peanut butter jelly time" Damn I'm getting flashbacks of memories i never knew i had.
I hope Linus gets a pentester to test his house when it's done, would be a fun video.
this all reminds me of that one skit:
The Techie: "My home is so smart everything is automated and AI-Powered and i control everything through my phone..."
The IT Specialist: "The most modern piece of technology I own is aprinter from the 80s and I keep a loaded gun near it at all times in case it makes any weird noise"
The Security Expert: "God I wish I lived on the Neolythic"
Well, I keep the loaded gun a little way from the printer. Don't want it getting any ideas.
Printers can't be trusted
My PC: do you trust this printer?
Linus: _(wants to implement home automation to save energy)_
Also Linus: _(builds a home-automation computer that consumes hundreds of watts 24/7)_
it`s like worrying of high fuel consumption in Bugatti sports car... And hundreds of watts, that`s not eve close, i assume 5+ KW/h? Even than, its nothing in the house of that size.
This ability to turn off heating and cooling to a majority of the house if no one is there will definitely save more energy than this computer running 24/7 will use
"The average Central AC unit uses around 3,500 W of electricity per hour" "A gaming computer requires somewhere between 300 - 500 watts per hour to operate."
@@nikonovandrej1985: There is no such thing as kilowatts per hour. A watt is an instantaneous measurement of the rate of energy usage. A kilowatt-hour is usage of energy at the rate of 1 kilowatt for 1 hour, or at the rate of 2 kilowatts for 1/2 hour, etc.
@@tonylarose4842: Or he can wire each room's HVAC to a power switch and hit the switch on the way out of the room for no cost whatsoever.
This is really impressive, and I can imagine some interesting uses for it in the future.
That transition at 9.25-9.26 was smooth af
Woahhhhhh, LMG did a shot for the cut in this video! That's new! Cool stuff peeps. There is a pan where Linus is talking on the right but then is at the counter on the left. I don't think I've ever seen a cut like that in an LTT video before!
I had to watch that part again it was very satisfying.
I like how the editor blurred out the localpath url, and later totally diddnt even give a damn about it anymore xD
Maybe it was youtube automatically doing it, not the editor.
@@tahsin28 noo, because you can see it when the camera focuses outside etc that even the whole screen gets blurred so it was the editor :'D ..
And why diddn't YT do it later, when you could see the IP even clearer? xd
@@tahsin28 UA-cam doesn't do that, otherwise networking tutorial videos wouldn't work.
Editor likely toying with the audience :)
Great Linus found a way to play his epic hero entrance song whenever we walks into a room
9:25 Props on the editor for this transition
Linus: "This is not a GPU."
Card: "You thought I was GPU, but it was me, Dio!"
I thought it was a LG OLED TV
Is this a One piece Reference????
"why cpu when I can cup"
"why talk to you, when I can leave"
lmao
All of Linus's hardware in the new house is balls to the wall crazy which is fun to watch but it would be nice to see a standard, affordable solution for non castle tier stuff :) all love
9:25 I really liked this transition! :)
Me, when Linus was hiding from the AI: "Stop confusing Skynet!!! You're gonna make it angry!!!"