When I tell 'civilians' that I use Linux I usually get a blank look. After I explain a little more and tell them that the whole shebang runs on Linux: even blanker. I should imagine it is the same with "digital natives".
You're not giving nvidia enough credit for its efforts on linux. It's not that they avoided open-source to make profit, it's that they deliberately sabotaged every open standard to prevent competition.
@@ThePlacehole My apologies, i definitely should have mentioned Intel's Pat Gelsinger: "CUDA will be nothing more that a footnote in history books". Thanks Jensen for "sabotaging" the market, else we would still be stuck in the stone age.
I don't understand why people are making this a big deal. NVIDIA has been releasing Jetson edge computing platforms for the past four years. As part of my PhD research, I initially used the Jetson Nano with 2GB RAM before transitioning to the AGX Orin developer kit. The only thing changed is that it is way more powerful with higher cores and more RAM. Way more versatile and user friendly than raspberry pi.
finally a sensible comment, these people think Nvidia just makes GPU's for their video games. I have also used a ton of jetsons in my UAV projects and they are wonderful.
Well. That’s how ignorant the PC community is lol. They thought everything in the Tech world is mainly for Gaming. They always stupidly forget the industrial side of things.
While nvidia's drivers have been crap for desktop gaming usage, their hardware accelerators have always worked well for me and are very easy to install. I've used a Volta Quadro for years at work for developing GPU accelerated engineering software and we recently upgraded to an RTX 4090. Nearly the entire AI world runs on NVIDIA cards on Linux machines, mainly the A100 and H100. They work flawlessly. I guess that's the difference with whether they are supporting a niche desktop market or a trillion dollar cloud computing market.
Are you saying graphics on consumer laptops and desktops is a niche market? If that was true, they'd give up and release open source Linux drivers, because hey, who cares, it's just a little niche part of their company.
@@xpusostomos Graphics on consumer laptops and desktops /running desktop Linux/ is a niche market. Although the %ge market share of desktop Linux has been slowly going up.
To be fair I've never had too much issue with gaming on linux under Nvidia. I use the proprietary drivers, not nouveau but it supports my laptops rtx, no problem and I get the same frame rates I'd expect on windows, good experience with my old laptop using a gtx960m as well. I'm not sure if the issue with gaming on linux under Nvidia is overblown or I've just been lucky or if it goes back to Nvidia not supporting the open source Nouveau drivers..
I used one a few weeks ago, I can't deny that it's great for its purpose and that NVIDIA provides a working single board computer out of the box compared to other ARM SBC vendors. The catch is that the OS gets older over time and NVIDIA doesn't seem to care, the one I used was a Jetson Nano stuck in ubuntu 18.04 so I had to update to 20.04 breaking some packages along the way but it went smooth after 2 attempts. The biggest catch is that for every Jetson board the GPU kernel modules and NVIDIA libraries are closed source and tied to a particular patched kernel, in my case 4.9-tegra ; meaning the GPU drivers cannot be recompiled hence the kernel cannot be updated to a newer/different version while maintaining the full GPU capabilities provided by the closed source driver. Only kernel versions from 6.x provide compatibility for the Jetson Nano, but they require the kernel to use some GPU drivers called 'Open Source Drivers'. Also most of their most technical documentation is confusing or it's missing. I wouldn't call that thing a development board, it's just a single board computer with a powerful GPU.
Finally! I couldn't figure out why there was no hardware that had something to do with "AI" for the last couple of years. I search everywhere and no hardware manufacturer or seller mentions "AI".
Looking at the specs it looks like they took the "computer" out of the "AI computer". But hey it uses less power, so your new AI christmas decoration wont break the bank! ... oh wait it still does.
Just got a Belink mini PC from Amazon, 4K display, all solid state, quiet, runs cool, 6 inches across, 3 inches tall. HDMI, USB C and A. Ryzen 5 6600H, Windows 11 installed.
the speed and efficiency of thatthing is insane! the only problem is, that with 8GB you can't really use it to run fun things like the flux dev and SD 3.5 L
this will be nice for suicide drones,they can lock in with help of ai and dont need guidance after.extremly effective against electronic warfare.also missiles can use them.
@nastybadger-tn4kl anyone putting AI into small robots. It can run stuff like object recognition and tracking, and drive all sorts of motors and servos.
Funny enough this is not their first Jetson. The original jetson nano used the same SoC as the Nintendo switch and only cost $80 if you got the 4gb ram version. Now it's $250 and probably uses the same SoC as the switch 2. Will be interesting to see how it performs
Nvidia has been supporting open source driver with tegra for a very long time. It is nvidia T4L (tegra for linux) initiative that they have done since tegra 3 days. In fact just a year after than middle finger from Linus he openly praise nvidia and give his tumbs up on the effort nvidia has done with tegra linux support. I think this is also why Switch emulator able to come out just a few months of Switch release because tegra chips are very well known in linux world.
I just had this exact idea. A home machine powered by a high end GPU that is designed specifically for AI that you own. No paid platform, anytime you need AI you are talking to your own homebased LLM that you can train and modify for your needs.
Jetson's have been around a while and they make these things up to 64GB ram already, so weird they make this kit with only 8GB. Looks like they're just going for a maximum cost shaving variant to try and compete with the PI5.
Jetson nano has been on the market for a while now. If you’re developing AI video recognition I’ve heard it’s a good option. However there are now more options on the market for dedicated AI chipsets.
I'll tell you what it is. It is a great base for all local not very smart (due to memory contraints) but offline and private LLM powered voice / home assistant
Remember other company made a mini PC that you can connect oculink and USB4 port that can connect 40 gigs per second of bandwidth because you can connect video AMD or Intel GPU but if they made a mini PC that does not have any port that you cannot connect our own graphic card that will be just garbage then
nvidia definitely works great on linux. Maybe wayland has problems, but 15 years in and wayland still can't do fractional scaling correctly on AMD gear either.
Actually since Nvidia became a 2 Trillion company they are super friendly towards Linux. Because without Linux they would be a 2 billion company today.
@arenzricodexd4409 NVIDIA has been doing a lot of Linux stuff for quite some while. But the only started to engage with the wider Linux community when CUDA became a thing and pretty much nobody on Windows was interested in using it.
2:12 Linus Torvalds, the creator and current lead developer of the Linux kernel; "Nvidia has been the single worst company we've ever dealt with, so Nvidia, f*ck you!" 👍
aside from the joke that not make sense compare with mac mini, the Jetson basically a modular compute unit, similar to rPi CM (compute module) which core device that can be easily plug/unplug in factory assembly line. but back to reality, these devices (Jetson, CM, etc.) sometime are abused for its purposes, some use it as mini pc, some use it for gaming console, cluster computer (which used multicore cpu can cover it), the heck with that, this cause the demand is high while someone who create for its purpose left with nothing and price up high. these devices should be used on manufacture devices such CNC control unit, assembly robot unit, etc.
Eh, there are more manufacturers of this stuff then Raspberry and nvidia. Just well knows ones have too much fans, so everyone buys them for their project that could be done with calculator motherboard.
Ubuntu is the absolute worst Linux distro on the planet. I hate that people keep getting steered to it. Oh and nVidia works fine on non-Ubuntu distros. I have gamed on Gentoo. Hope you like building everything from sources!
Jetson, especially Orin, is a quite nice series of mini-pcs for robotics. I personally like them but their coolers are notoriously bad and it is quite a nice joke fuel
Literally watching this on Linux Mint, and dude, you screwed yourself. It's wasn't Linux, it was you. Also, Nvidia works just fine. And the drivers are kept as up to date as needed.
Nvidia likes Linux for server, just not for consumer
You forgot to add in “free” server* 😂
@@MP-vc4nu yep like ai they just nick other peoples stuff repackage it call it ai and make loads of dosh. Stealing is Not really that clever 😇
So does the whole industry, including Microsoft, Google, Amazon, AMD, Intel, .. most likely even iCloud servers are running Linux.
When I tell 'civilians' that I use Linux I usually get a blank look. After I explain a little more and tell them that the whole shebang runs on Linux: even blanker. I should imagine it is the same with "digital natives".
@@LostinSpacetime Yes, iCloud runs on Linux
Great callback to the Linux videos
Ubuntu PTSD
@@ItsAlive111 To be fair, surviving a terminal kernel panic diagnosis would give anyone Ubuntu PTSD.
It's terminal! LOL
Now, let's cook the Mini PC.
guys let him cook
Up next,
Nivida Nano Super Vision (Headset), fresh out of oven
ok i have bbq sauce it will be extra crunchy
@@MP-vc4nu Is it ok to put ketchup on that?
and add some eggs...
1:23 Those wheels costs $100 more than a Mac Mini. 💀
Not Linux… a flashback to the wall where I was a Kernel and crashed.
and Terminal!!
Ai, walls, crashing ? sounds like a Tesla
but What about Debian, or Linux MInt?
war
The AI for ants meme 😂😂😂
"what's better than open source? 3 trillion dollars!" gold 😂😂
*opposite of
You're not giving nvidia enough credit for its efforts on linux. It's not that they avoided open-source to make profit, it's that they deliberately sabotaged every open standard to prevent competition.
@@ThePlacehole My apologies, i definitely should have mentioned Intel's Pat Gelsinger: "CUDA will be nothing more that a footnote in history books". Thanks Jensen for "sabotaging" the market, else we would still be stuck in the stone age.
@@ThePlaceholegot to play hard if you want to stack racks instead of GitHub stars 😁
The Pentagon can agree with that.
lol, finally some good tech comedy, so glad I found this channel. Keep up the good work.
i get a surprising amount of technical information out of these videos, as well as a good laugh.
I don't understand why people are making this a big deal. NVIDIA has been releasing Jetson edge computing platforms for the past four years. As part of my PhD research, I initially used the Jetson Nano with 2GB RAM before transitioning to the AGX Orin developer kit. The only thing changed is that it is way more powerful with higher cores and more RAM. Way more versatile and user friendly than raspberry pi.
finally a sensible comment, these people think Nvidia just makes GPU's for their video games. I have also used a ton of jetsons in my UAV projects and they are wonderful.
It can beat macbook mini into pieces if u tune it
Well. That’s how ignorant the PC community is lol. They thought everything in the Tech world is mainly for Gaming. They always stupidly forget the industrial side of things.
It's a joke you nerd
It's a joke ya nerd
You got me at "They said it was terminal" 🤣🤣
He deserves an Oscar for that flashback
Who panics more with linux? Sam or the kernel?
Yes.
im ded " i was kernel""they said it was terminal"
Even on their niche computing platform for hobbyists, Nvidia skimps on the RAM.
I got 4x 32GB DDR4 modules from the Amazon last year and it cost me $150. HOWEVER: now I have obscene amount of RAM.
the cat is enough to deserve my like
The All New never get old ;)
Ubuntu PTSD is familiar amongst most Linux users. Ah, Ubuntu, making Linux desktop both easy and difficult at the same time.
While nvidia's drivers have been crap for desktop gaming usage, their hardware accelerators have always worked well for me and are very easy to install. I've used a Volta Quadro for years at work for developing GPU accelerated engineering software and we recently upgraded to an RTX 4090. Nearly the entire AI world runs on NVIDIA cards on Linux machines, mainly the A100 and H100. They work flawlessly. I guess that's the difference with whether they are supporting a niche desktop market or a trillion dollar cloud computing market.
Are you saying graphics on consumer laptops and desktops is a niche market? If that was true, they'd give up and release open source Linux drivers, because hey, who cares, it's just a little niche part of their company.
@@xpusostomos Graphics on consumer laptops and desktops /running desktop Linux/ is a niche market. Although the %ge market share of desktop Linux has been slowly going up.
To be fair I've never had too much issue with gaming on linux under Nvidia. I use the proprietary drivers, not nouveau but it supports my laptops rtx, no problem and I get the same frame rates I'd expect on windows, good experience with my old laptop using a gtx960m as well. I'm not sure if the issue with gaming on linux under Nvidia is overblown or I've just been lucky or if it goes back to Nvidia not supporting the open source Nouveau drivers..
I once had a Jetson board. It's a great development board... when NVIDIA doesn't unexpectedly stop supporting it.
I used one a few weeks ago, I can't deny that it's great for its purpose and that NVIDIA provides a working single board computer out of the box compared to other ARM SBC vendors. The catch is that the OS gets older over time and NVIDIA doesn't seem to care, the one I used was a Jetson Nano stuck in ubuntu 18.04 so I had to update to 20.04 breaking some packages along the way but it went smooth after 2 attempts. The biggest catch is that for every Jetson board the GPU kernel modules and NVIDIA libraries are closed source and tied to a particular patched kernel, in my case 4.9-tegra ; meaning the GPU drivers cannot be recompiled hence the kernel cannot be updated to a newer/different version while maintaining the full GPU capabilities provided by the closed source driver. Only kernel versions from 6.x provide compatibility for the Jetson Nano, but they require the kernel to use some GPU drivers called 'Open Source Drivers'.
Also most of their most technical documentation is confusing or it's missing. I wouldn't call that thing a development board, it's just a single board computer with a powerful GPU.
No matter who you spoof, I always end up laughing out loud
Finally! I couldn't figure out why there was no hardware that had something to do with "AI" for the last couple of years. I search everywhere and no hardware manufacturer or seller mentions "AI".
This guy works at almost every giant tech company!
Looking at the specs it looks like they took the "computer" out of the "AI computer".
But hey it uses less power, so your new AI christmas decoration wont break the bank! ... oh wait it still does.
8 gigs of VRAM for AI? 🤣🤣🤣
@@CMak3r enough to run small models which is what this is intended for, plus the memory is very fast.
You can run maybe some 7B models or quants of larger ones. For image generation, Stable Diffusion XL is also possible, maybe even Flux (slowly).
For robotics
My Boss asked me the other day how i keep up with the news in technology. Obviously I told him that I only use your channel for this
if you get it to run mac os it will be 16 gb
NVidia probably just heard about how people were buying their graphics cards for "mining" and the last two letters got cut off.
Can you help mw abit im trying to understand
Oh nvm you meant they wanted card for mining and instead heard mini
The clip with the actual raspberry pie is from a channel called Frontier Patriot. What are the odds that I subscribe to both of them.
My new favorite channel. Hilarious stuff, thanks Sam!
I miss here: ''and you may have heard recently''🤣🤣
I love the dogs Jenson is talking to, and the look the one dog gives us
Just got a Belink mini PC from Amazon, 4K display, all solid state, quiet, runs cool, 6 inches across, 3 inches tall.
HDMI, USB C and A. Ryzen 5 6600H, Windows 11 installed.
the speed and efficiency of thatthing is insane! the only problem is, that with 8GB you can't really use it to run fun things like the flux dev and SD 3.5 L
the linux flashbacks were gold
Most people won't get it, but to the intended audience it's as if Nvidia released the RTX5090 and it turns out to be half the price of the 4090.
this will be nice for suicide drones,they can lock in with help of ai and dont need guidance after.extremly effective against electronic warfare.also missiles can use them.
still dont know who is the user
@@nastybadger-tn4klIt’s for autonomous drones and various built-in computers.
@nastybadger-tn4kl it's for devs and homelabbers
@nastybadger-tn4kl anyone putting AI into small robots. It can run stuff like object recognition and tracking, and drive all sorts of motors and servos.
Sam I almost watch the videos just to get to your trademark "THE ALL NEW..."! However I do love the tone of the jokes! Have a great Christmas!
Funny enough this is not their first Jetson. The original jetson nano used the same SoC as the Nintendo switch and only cost $80 if you got the 4gb ram version. Now it's $250 and probably uses the same SoC as the switch 2. Will be interesting to see how it performs
lol the Bible waving at Ubuntu killed me 😂
2:06 Actually, because of the Jetson Nano, the NVIDIA drivers are now becoming open source, so they will be much easier to use on Linux in the future.
Nvidia has been supporting open source driver with tegra for a very long time. It is nvidia T4L (tegra for linux) initiative that they have done since tegra 3 days. In fact just a year after than middle finger from Linus he openly praise nvidia and give his tumbs up on the effort nvidia has done with tegra linux support. I think this is also why Switch emulator able to come out just a few months of Switch release because tegra chips are very well known in linux world.
You work for Nvidia, too? Fascinating.
He is in every company
Where i was a Kernel and I crushed XDDDDD
I just had this exact idea. A home machine powered by a high end GPU that is designed specifically for AI that you own. No paid platform, anytime you need AI you are talking to your own homebased LLM that you can train and modify for your needs.
Jetson's have been around a while and they make these things up to 64GB ram already, so weird they make this kit with only 8GB. Looks like they're just going for a maximum cost shaving variant to try and compete with the PI5.
His leather jacket actually costs a whopping $8990. Just $11 too cheap to be over $9000!
Can a LLM fit on 8GB? I can't imagine the tokens could fit on that. 🤷
Does anyone know what the song is that starts at the linux flashback?
Love your videos Sam! Have a nice day :)
Why do all these videos feel like they're 4-5min too short? The closing clip always throws me off-guard!
Jetson nano has been on the market for a while now. If you’re developing AI video recognition I’ve heard it’s a good option. However there are now more options on the market for dedicated AI chipsets.
I'll tell you what it is. It is a great base for all local not very smart (due to memory contraints) but offline and private LLM powered voice / home assistant
All in all, sam is better salesman for nvidia than their own people. I didn't even know to this day,
the Zoolander part made me laugh so hard. it's my favorite comedy movie
Someone will try to run Steam on it.
Kitt-i will have his pound of flesh
Oh the Linux flashback! You are legend, Sam!
This video is exactly 3:14 min long.
except that it's not
i cant handle this advanced shartnology
It's an embedded system. It's not going to replace your PC any time soon. It's not going to compete with Raspberry Pis either.
😂😂😂😂 best reviews ever. Nice to hear real assessment instead of the fanboy reviews, hypemen/ influencers
Remember other company made a mini PC that you can connect oculink and USB4 port that can connect 40 gigs per second of bandwidth because you can connect video AMD or Intel GPU but if they made a mini PC that does not have any port that you cannot connect our own graphic card that will be just garbage then
nvidia definitely works great on linux. Maybe wayland has problems, but 15 years in and wayland still can't do fractional scaling correctly on AMD gear either.
Actually since Nvidia became a 2 Trillion company they are super friendly towards Linux.
Because without Linux they would be a 2 billion company today.
Nvidia has been increasing their effort towards linux since 2018. And for tegra they have been doing it even longer which around 2012 or so
@arenzricodexd4409 NVIDIA has been doing a lot of Linux stuff for quite some while. But the only started to engage with the wider Linux community when CUDA became a thing and pretty much nobody on Windows was interested in using it.
PTSD from using Ubuntu is wild🤣
Are there any AI firewall software that can take advantage of the hardware?
Its mainly used for robotics industries. This isn't really a consumer thing.
2:45 Lost it on "sharted" 😆
I was going to downvote as the kitton didn't make a cameo.... then you totally redeemed yourself 😊 1 upkitto
the Linux Ubuntu puns [Chefs Kiss]
2:44
da fuck?
a dj co quote would've been great after that
well, sharding is a design pattern with horizontal partitioning of databases - or something like that ;)
@@DominikJaniec
Who comes up with the names for these tech terms?
That's almost as bad as dangle
nvidia now has very competent open-source drivers
We are regressing into the past....Sam next video please do one on the next best thing ....the Commadore. 😂
2:12 Linus Torvalds, the creator and current lead developer of the Linux kernel; "Nvidia has been the single worst company we've ever dealt with, so Nvidia, f*ck you!" 👍
That was 11 years ago
Liked, subscribed and clicked on the bell icon because you're too funny!
Loved the flashback sequence, poor Ubuntu!!
Sounds like a perfect batocera/retropie box for certainly not pirated roms.
Greetings from Reynosa, Mexico.
Those Linux puns were fantastic.
Sincerely, a NixOS user.
I'm guessing oriOn was already taken...
What cpu is it running?
aside from the joke that not make sense compare with mac mini, the Jetson basically a modular compute unit, similar to rPi CM (compute module) which core device that can be easily plug/unplug in factory assembly line. but back to reality, these devices (Jetson, CM, etc.) sometime are abused for its purposes, some use it as mini pc, some use it for gaming console, cluster computer (which used multicore cpu can cover it), the heck with that, this cause the demand is high while someone who create for its purpose left with nothing and price up high. these devices should be used on manufacture devices such CNC control unit, assembly robot unit, etc.
Eh, there are more manufacturers of this stuff then Raspberry and nvidia. Just well knows ones have too much fans, so everyone buys them for their project that could be done with calculator motherboard.
Flashbacks were amazingly funny😂.
Ubuntu is the absolute worst Linux distro on the planet. I hate that people keep getting steered to it. Oh and nVidia works fine on non-Ubuntu distros. I have gamed on Gentoo. Hope you like building everything from sources!
I use gentoo btw
Jetson, especially Orin, is a quite nice series of mini-pcs for robotics. I personally like them but their coolers are notoriously bad and it is quite a nice joke fuel
Haha terminal pun killed me!!😅
So, it runs Linucks. And there are drivers issues. But can it Run Windows 11?
What an amazing shirt, Sam.
Wonderful video. It’s always fun😂
It's still pretty cool. I got no use for it yet but, neato.
Seems like a fair price for what it does and what it is.
This is just the Switch 2's hardware isnt it? The Jetson Nano was famously the same hardware as the Switch pretty much.
If it wasn't for the 8GB I'd already ordered probably a handfull of these things...
They should make their own OS!
This was hillarious :D But I am excited to go read the specs now. I do love some raspberry pi favored gadgetry
Nice ending I thought it's for dogs😂😂
I can always count on You, to make me Laugh. Thank You Kernel Sam! 🎅🤶
Literally watching this on Linux Mint, and dude, you screwed yourself. It's wasn't Linux, it was you. Also, Nvidia works just fine. And the drivers are kept as up to date as needed.