The New Nvidia Jetson Orin Nano Is The Fastest Edge Ai NANO SBC So Far! First Look
Вставка
- Опубліковано 5 лип 2024
- In this video we take a look at the all new Nvidia Jetson Orin NANO! This Powerful AI Edge SBC Packs a 1024-Core Nvidia Ampere GPU with 32 Tensor Cores and a 6 Core Cortex A78 CPU backed by 8GB Of DDR5 Ram. We test out some ai demos 4K video Playback and we defiantly had to take look at emulation like Gamecube and Wii using the Dolphin Emulator and Even PS2 using AetherSX2!
Learn More About the Jetson Orin Nano Here: www.nvidia.com/en-us/autonomo...
Follow Me On Twitter: / theetaprime
Follow Me On Instagram: / etaprime
25% Code for software: ETA
Windows 10 Pro OEM Key($15): biitt.ly/KpEmf
Windows10 Home Key($14): biitt.ly/2tPi1
Windows 11 Pro Key($22): biitt.ly/RUZiX
Office 2019 pro key($49): biitt.ly/o0OQT
Equipment I Use:
Monitor: Pixio 277 Pro On Amazon: amzn.to/3PGUBwe
Elgato HD60 X Screen Capture Device: amzn.to/3GkP2AL
Tool Kit: amzn.to/3Wo8bpX
Camera: amzn.to/3XJfFoI
DISCLAIMER: This video and description contains affiliate links, which means that if you click on one of the product links, I’ll receive a small commission at no extra cost to you!
Under section 107 of the Copyright Act 1976, allowance is made for “fair use” for purposes such as criticism, comment, news reporting, teaching, scholarship, education, and research.
No Games Are Included Or Added
This video and Channel and Video are for viewers 14 years older and up. This video is not made for viewers under the age of 14.
00:00 Introduction
00:17 Unboxing and overview
02:55 Specs
03:41 Overall Performance
06:31 Ai Model Tests
07:19 4K UA-cam video playback
08:07 PS2 Emulationn Test
09:38 Gamecube and wii Emulation Test
10:44 First Impressions
Want to send me something?
ETAPRIME
12520 Capital Blvd Ste 401 Number 108
Wake Forest, NC 27587 US
THIS VIDEO IS FOR EDUCATIONAL PURPOSES ONLY!
#SBC #Nvidia #orin #etaprime - Ігри
Working on getting Box 86 running on this now, steam games on arm are looking pretty good.
Hello, plz test some games on Windows 11 arm😊
@@7heruvim7 with which drivers? software render is a no go for gaming
@@microlinux oh, u right🙁
@@7heruvim7 as today, the only suitable windows 11 gaming platform are snapdragons
@@microlinux understand, cool job with yours experiments
People should understand he's trying his best to make a living out of this channel so any sponsor he gets are mostly positive.
With a mil subs and 10K views within the first hour, I’m sure he’s doing fine, from monetization, alone - which is not to say he doesn’t deserve the subs/views, ‘cause his stuff has always been great and he’s _always_ genuinely excited about the toys he gets to play with. At the same time, given that number of supporters, their/our feedback needs to be taken into account, for getting future views - and the lack of sponsors has been a big part of his success... You should understand that, not to be demeaning or dismissive.
ETA Prime is pretty much the Home Shopping Network of the Tech Community so it makes since. He's pretty much one of the reasons I bought an Orange Pi 800.
I agree considering I've learned so many new devices because of him that exist.
The video release timing of his recent aokzoe pro and the company’s public fundraising coincided almost the same hour. It’s difficult to imagine that wasn’t planned and coordinated. I think he should totally make great money doing this work and hope that whenever there are company interactions or sponsorships they’re disclosed !
Viewer trust is 🔑
I searched for my main computer that he mentioned in his video's in my local marketplace and I got an insanely good deal
Your channel is amazing been hooked since I stumbled upon it looking for a ram upgrade lol 😆 great work 👏
I just want to say thanks for the recommendation on the Ryzen 5 2400G (HP mini) got it a while back that you recommended for about $150. For some casual gaming, some 3D-design and regular day-to-day tasks it’s been great. I even played some Switch games on it such as Metroid Dread and it works great.
YES! I have been hoping to see this exact video, since I first heard about this new model.
RIP for the last gen Jetson Nano, which has been abandoned by the 5.x Jetpack and it has no mainline Linux support.
I have the original jetson nano, with the pascal 128 core. What is frustrating is that the OS was never updated, so it is running Ubuntu 18.04
Another great video thanks 🎉
Switch 2 looks so promising good. Can't wait !
Hi! Have you tried running LLM models, such as Mistral or Llama, as a chatbot? Without a GPU on a 64 bit Linux laptop, Mistral is kind of OK, but not very snappy. I wonder if Nano would perform better. I can't find any videos or articles about whether it's a good solution for such a task.
Fantastic video! We can sort of at least see what the Switch 2 will be capable of (in handheld mode at least) Are you gonna make more videos? I wonder if PC games are possible....
Would be interesting if someone could try this on an Orion AGX kit too
I would love to see how fast it could run Stable Diffusion using vladmandic's "automatic", which is a fork of Automatic1111. It has a builtin benchmark on the system tab.
I wonder if your can gen Windows 11 for ARM or even Tiny 11 running on there. The only issue I can see is that Tiny 11 is not natively made for ARM devices, and W11 for ARM may not support the Nvidia drivers given these chipsets are completely custom-built for Jetpack and vice versa.
I might of missed it, but did we get any power consumption numbers here? Thanks...oh and yeah I guess it's prohibitively expensive for me actually...
So total SBC newbie question here. I understand RPis have the largest community and the most support. If you are getting a board like this or other non-RPi as an emulation station, do you need to worry about the board maker, OS, or chipmakers for getting things like updated drivers, security patches, etc?
I would love to get something like this, but worry about which brand to buy since RPis are way over retail and unable to emulate all I would like. My experiences with Windows is component makers do driver updates, device makers usually firmware, and OS security updates? So it seems like one brand of SBC over another might not matter as much as the OS installed? So Android/Linux support on the board and you are pretty solid? Thank you!
Love the videos!
Can you please make a video showing this or another sbc with the smaller open source LLMs?
whats the link to the 4k youtube video you used?
This gen of nano boards are the fastest ones available or there Will be a non nano version?
Even a 4090 and i9 13900k there's usually always 2-5 dropped frames on 4k60 playback due to the start up of the video, nothing to do with hardware, so that's totally normal
Does Nvidia Open Kernel module supports Orin SoCs?
deadly device, keep on keepin on.
Powerful SBC, powerful price too
They also have a $149 jetson nano with lower specs is that one any good for emulation??
Would there be a point to add a Coral m.2 o these for ai?
Thanks for the video. Does it have Wifi?
ETA PRIME, can this running stable diffusion? can you try it and how the performance. thank you
I had a first gen Nano that was such a pain in the ass, because the drivers are still closed source. You couldn't use the encoder if you installed something like OBS, unless you reinstalled all the CUDA stuff but you didn't have access to it unless you were set up as a developer.
Wonder if you still have this board and if is up for sale?😅
hi can you test if nvidia studio tools work on this device ?
I've noticed even on 3060ti Tatsunoko skips. Is this avoidable?
What's the performance of the Jetson orin nano in comparison to AMD' apus?
It is funny that you buy one of these and then only use it for gaming. Have you tried the reComputer J1020 from Seeed Studio? This is the Jetson Nano production module housed in a nice computer case with some additional features not found in the developer kit.
The board seems like fun for early ai devs that want to mess around with the tech. :D
At the prices they want for these things, the memory should be user-upgradable.
This
Arm platforms have never come with upgradable ram I believe, only storage if the manufacturer is feeling generous.
@@mingyi456 That is an excellent observation, and I think you may be right (or, at least, I cannot think of a single counter-example). However, that raises another question: why? I had always assumed it was because ARM platforms are usually meant to be small, power-efficient, and cheap (generally choose any two of those). Of those three, these new NVIDIA devices seem to only be one: small.
Is This is for inference only ? Or can you train models on it as well ?
for inference only
Never ever heard of Tatsunoko vs Capcom. But straight away I recognised the character of Princess from Battle of the Planets
Have you tried running yuzu on this?
Hey Prime. Have you heard anything about orange pi making handhelds?. I read a story they're prepping a 7840u handheld with 16gb ram and 512 storage for less than 500 dollars
Something similar should come in a "swtich 2". Maybe with a more powerful GPU capable of DLSS
That would be amazing, and yes I think they will use a very similar chip, possible higher clock on the Cpu and gpu
This would make an amazing UG for the Switch but I'm more inclined to think they'd use the previous gen xavier chip instead.
That's still a very good board and approx. 3 times the performance of the current Switch processor.
Haha i was thinking switch 2 while watching this
Nah, you'd be paying an arm and leg for the sequel to the Switch.
It's far cheaper and more performing to use a Zen 3 or even Zen 4 APU.
Who'd want to pay $500+ for a Nintendo Switch 2 that performs up to 1080p on handheld mode?
Remember that Nvidia can't develop a CPU if their life depends on it, they use ARM CPU to and stick a iGPU module near it and call it a day.
@@dra6o0n keep in mind that Nintendo doesn't usually require the latest and greatest and fastest hardware. And they already have a working relationship with Nvidia, so they can probably get a board similar to this one for a pretty good price. Granted, these Dev boards are usually more expensive than what you would resell for. I don't think they are going to switch to AMD or Intel, likely to stick with an arm based system if they're going to continue the mobile form factor to keep power consumption lower
Wish they would shield 2023 this. We could use a hardware refresh for Android TV. I'm still using the original 500gb HD version.
The best thing about the breakout board is, you can put it in a cluster, in anywhere between 4, 6, and even 7 module configurations.
In those cases, you would have the full Orin with 12 CPU’s, 2048 GPU’s and 32 tensors
Cheers ETA! Ive a been looking for a new brain for my Turtle and looks loke I found it.
You need to try running Gran Turismo 4 on the seattle course
God damn these things aren't cheap though. When the Jetson Nano first launched, you could get the 4GB dev kit for 99 USD. The entry level SoM for the Orin is 200 USD, and the dev kit (which includes the 8GB SoM) is 500 USD!
agree, but the sbc in first Nano was a "dumbed down" tegra, so it was probably chips that didnt pass to be used in Nintendo Switch or TV Shield. This chip is only used in this machine so far.
The Maxwell-based Jetson Nano is sticking around, which is a pain. If you're a student you can get a $100 discount, but even then $400 is a lot. But six Cortex-A78 cores and that Ampere GPU is kind of a beast. Also don't forget these are first and foremost dev kits for building robotics and AI applications. The price makes sense when you realize people are mostly buying them to make money off of what they produce, not play video games.
@@TVsBen while that is true (and is actually what I'm interested in, and why I have the old jetson and a coral dev micro) it feels massively disproportionate given the relative price of the older model it is clearly replacing. After all, these are the entry level models and would be mostly desirable for either low power or hobbyist use. It strikes me as the same type of pricing hubris that is currently biting them with their 40 series cards, but in this case there's not nearly as much out there that can compete.
@@Jaaxfo Have you seen the performance benefit of this over the original nano? It is huge (40 TOPS and 8 GB of ram vs 472 GFLOPS and 4 GB of ram), so there is no way they are going to have them similarly priced.
If you need it for floating point calculations though then it is only about 4-5 times faster than the original nano, except from in floating point double calculations where it is much faster, but the tensor cores make it much better for int 8 calculations which are used a lot for AI now because of the potential speed and because of hardware like the tensor cores.
If you can get a cheap second hand TX2 then it is about half the performance of the orin nano 8 GB again except in floating point double and it has no tensor cores.
I do wish the Orin Nano was cheaper but Nvidia know that people will buy them and they definitely arent just for hobbyist use, they have much better AI performance than even their previous top of the line boards like the Jetson Xavier AGX which only had 32 TOPS vs the Orin Nano 8 GBs 40 TOPS, the Xavier boards had more ram but less performance.
It would be good if they did larger student and maker discounts but they will sell enough of these regardless.
I also have nvidia jetson Tx2 lying around but it's larger and require an adapter to connect😪
Be wild if this was the New Nintendo switch specs since the last one used the tega apu combo👀
Perhaps you could try Ryujinx since they have specific drivers for ARM chipset.
What is that green animation often seen on Nintendo games? For a while i thought it's some kind of trick against Nintendo copyright claim.
Imagine this on the next switch pro is this a tegra xr?
I love how the compute module comes off like that. This looks like a fun pc to mess around with.
Can you run games on this?
Kinda expected a video about the new Beelink GTR7 announcement.
Could this possibly be part of the next gen Nintendo Switch? I have a feeling that Nintendo is going to stick with Nvidia technology for their next console.
They have contract that will end in the next 4 years, so the next console has to be made with Nvidia.
This is a bare minimum. Leaks are that the next-gen Nintendo unit will be ~1.5x this.
What's the green blob 10:40
this is ARM-based? can this run Android? i am interested because if this can run Stable Diffusion, i won't need a whole PC...
I was desperate to buy one when I first read about the Orin Neon. But i am sure it will have the same flaws like the Jetson Nano back then, what i did buy, and that is lack of goid drivers. At least if you want to misuse it as a every day desktop, which it should easily be capable of.
On autumn last year I did try the jetson nano with the latest Linux build from nvidia website and compared it the the first asus thinkerboard i just found when i was looking for the jetson nano. And I was shocked when I found out that UA-cam ran better with far less dropped frames on the thinkerboard than on the jetson nano which shouldn't be considered the difference in raw power of those two.
I know, none of those sbc is made with desktop use in mind. Even i have to say the Rock5b is so damn close to be usable as a simple desktop if not power issues get my in a boot loop as soon as i plug a webcam and speakers in two of the four usb ports😢.
Getting this thing to run android would be a beast
you should really revisit this board just to see what's possible with box64/86. it'd be super interesting!
Imagine this in a handheld. Maybe even a Nintendo handheld?
I have this on my desk. I am working on some custom software. The tenser cores are crazy powerful for the wattage the gpu is basically on par with a gtx 1060
so its like a Ryzen 7840U with Radeon 780m but with AI shenanigans, I wonder if this would be used on the Switch successor
@@ca9inec0mic58 It will be based on this.
@@Ghostsonplanets thats not a given, they could go with Xavier instead, also this is on Samsung 8nm which has pretty bad yields and efficiency, not suitable for a handheld that'd sell millions
@Ca9ine C0mic yes but 1/3rd the cpu power + its arm, or about the same if you limit the cpu to 10w and igpu to 20w.
So perf per watt has the Orin a bit ahead but not much for general gaming use. About 50-70% in tensorflow and most 128x128 and up ccna work. If amd dropped a professional line of the apu with a cdna core it might be on par.
I'd really like to see amd start to add some fpga like fabric to the cdna and integrated optimizer engine to the sdk so the hardware pipeline is configured to match the data structure with dma and directly tied to HBM or gddr6/7 in a gpu market well below the costs nvidia wants for top tier quadro cards.
It can basically be a gpu with much like it is now but instead of bolting on dedicated tensor cores and dedicated rt cores make a fpga that's optimized at the hardware level for doing ccna and rt work but can be configured to do slightly different types of work as needed
@@ZoeyR86 an FPGA that can do ccna and Ray tracing is something I dream about every day, Now that AMD has acquired Xilinx, I hope they could implement that in their GPU division
I wonder if they will release a new Shield TV using that base hardware
I just found out that Nintendo is utilizing a custom version of the Jetson Orin NX, and it this seems like a very promising chip
For me , it went out of the price range I expect an SBC to cost.
The main thing for every product is always price/performance ratio also know as value. If you REALLY need this, than it has certain value. How it would compare to a PC you can build for same amount of money?
SBC that cost 99USD and around that price mark have this ubiquitous proposal of being really cheap and offering something you would not be able to get with PC.
Agreed. Once you crest $200, it's back to Intel.
@@quademasters249 AMD has a 15 watt APU.
AMD's 15W Ryzen 7 7840U APU Rivals High-End Desktop CPUs on Geekbench
The tiny eight-core, 16-thread CPU is clearly punching above its weight class.
By Josh Norem April 27, 2023
At CES in January, AMD pulled the wraps off its newest Zen 4 mobile lineup, explicitly highlighting its latest offerings for thin-and-light laptops. The chip family is named the Ryzen 7040 "Phoenix" series, and though they were delayed a month, they are expected to launch any day now. This is good news for road warriors, as we now have our first benchmark for the Ryzen 7 part, and it's almost able to match high-end desktop CPUs in both single-and-multi-core scores in Geekbench. That's pretty surprising since it's a 15W CPU.
The Ryzen 7 7840U is an eight-core, 16-thread APU targeting a power envelope of 15-28W in a category AMD calls "premium ultra-thin." It will also target the handheld gaming market thanks to its Radeon 780M GPU. It's powering the new Asus ROG Ally handheld gaming device but will be rebadged to the Ryzen Z1 Extreme. According to Wccftech, the APU has 12 CUs and runs at an average of 2800MHz. A benchmark score for it has now appeared on the Geekbench charts, courtesy of a Lenovo laptop with 64GB of DDR5 memory.
ASUS ROG Ally costs around $600-700 USD.
This does offer things you cant get with a PC or with any other SBC. This was never meant as a PC replacement, it is made to be a small, relatively low power but powerful SBC, especially when you look at its AI performance. If you compare its performance against that of other common SBCs then it is a lot more powerful and its price makes a lot of sense.
Waiting for 780m emulation video,🙏🙏
How can I connect a a SIM card on it?
Damn you love that word "powerful."
I don't know much about nvidia's mini pc. Can someone help me understand the difference between the different products and how they compare to other mini pc?
its designed to be AI/ML project compared other mini pc with no dedicated GPU or low performance GPU
Damn I wish Nvidia would update the Shield pro to better specs ..it's been over 4 years+ any chance it gets updated ?
mine started crashing a lot lately
Won’t happen until after a new switch. So likely 1-2 years.
Nobody games on those things. They didn't make the money they wanted with gaming. As long as there isn't a better competitor I don't think they have any motivation to update it
@@caleb7475 I use mine daily. i'm an outlier, and we saw ouma and stadia fail, it didn't make sense as a market
Same. I've been wondering if I can use a low end PC instead. I have an old Nuc that seems powerful enough. I have 4 shields here. They're feeling pretty "Long in the tooth".
MAYBE one day, we will get a Jumper on that Board, wich when Bridged brings us straight into a sort of BIOS, where we can just preconfigure that we wanna boot from M.2 by default.
The Orin line comes with as many as 12 ARM cores and 2048 Ampere CUDA/INT cores, but thats ~$2000, then again it comes with something like 64 or 128GB of RAM(dont remember off the top of my head)
It comes with 32 iirc. Is the RAM on the chip or could more be soldered onto the board?
@@kesslerdupont6023 I dont have the Orin personally, but my Nano, TX2 and Xavier NX all have memory chips seperate from the die.
And come to think of it, i dont know of any SOCs that have their primary memory pool on the SOC, not even Apple.
Yea some SOCs have large on-die cache like IBM's Power10, but most of the memory still, lies off-die
The closest thing i can think of is Nvidia Grace and AMD Mi300 which i am pretty sure moves the memory chips onto the APU package, but still not part of the SOC die, I dont recall off the top of my head but it might be HBM2e/3 instead of LPDDR/GDDR
@@denvera1g1 Maybe someone will figure out how to put some extra memory on there via larger modules or something else like some responsive pcie memory pool like intel optane.
@@kesslerdupont6023 Optane, you said the magic word LOL, after it went on fire sale i've bought like 12 of those 960GB 905P u.2 drives
I would love to see a great Linux Arm Laptop, I really think it has the potential of getting a great market share if pushed by a company such as Amazon.
Apple and Asahi Linux if you happen to have access to an M1 Mac
Thanks for the video, I have their TX model but as the Orin now is the price of a M2 Mac Mini, and I don’t develop software, I will pass on it.
Side note If Cray ever sends you one of their computers, the 1st thing I except to see is; “Now this can emulate God of War at 1000FPS…”😂!
I have an old Jetson original X1 - half the GPU as the switch, but still better than a regular Pi and an old Core2Quad and 9800GTX from years ago.
A lot of these can be very good Simple Linux machines (basic computing, emulating games, email, browsing, and video content) but they also include software for running Cuda programs, and usually have links and manuals (programming on their GPU)
I wanted to get into CUDA a long time ago, but life kind of happened.
Nvidia or someone used to have full lectures on CUDA and mapping code/equations and other information to the GPU (I think that was around the time of Kepler) but I have to find those again.
3:08: Not to be pedantic, but slight correction. Jetson Linux or Jetpack isn't the OS, Jetson Linux is the board support package (BSP) containing drivers, the configured kernel, the hardware DTB's, etc. The OS is just normal "L4T" (Linux for Tegra) which is an Ubuntu flavor, and Jetpack is the SDKs & loader containing the BSP and all the extra GPU tools (eg. tensorrt SDK). Jetpack isn't necessary for general usage, the BSP basically is.
This nano is really cool, wish the video encoding HW was a little better, but other than that it's pretty sweet. The Jetsons have really come along way.
what about cemu and yuzu ?
These are the same SBCs used in by Kerala Motor Vehicle department to monitor traffic safety by using AI and Cameras.
What? 😲 Sheayy
How much does it cost?
I got 2 of this recently and I Can’t even flash an OS to it successfully
Waiting for those ARM/Nvidia notebooks...
seems neat. price is 500USD though before shipping. that's steep for a canadian. gonna need to watch and see where the prices go
Can you test skyline emulator on it, please?
What is the price
Imagine this being the Nintendo Switch 2 SoC?
Isn't the GPU in this Essentially a 1060?
Couldn't you just use the SD card as the boot drive, and the M.2 as mass storage?
This is going to be the core of the "Switch 2"
You did a typo at 3:04 says JESTON LINUX (JETSON). So it is like $680 Canadian.... too bad, wish they eliminate all the camera mipi and ai stuff, but gear it to gaming wonder what price and how fast.... even more ram. Let us know if you can upgrade the kernal seems special build for tegra cpu/gpu. Be nice to get Ubuntu 22.04 LTS at least and now Ubuntu 23.04 is just out. But I think with a $200bucks more you could just get a steam deck. This is more geared for robotics, computer AI vision systems...
Please get the AGX to run comparison 🎉
supposably this will be the basis for hardware on the switch 2 that is rumored to arrive at 2024 September or November. This based on the ceo's statement that in 2024-2025 switch support will be stopped. This is normally announced right before the release of a new switch.
I have an edge use case for these. The price is not so bad when you are leasing them monthly to businesses. ;)
Doing anything on the new wall mart Streaming box ?
That will perform use Nvidia with arm64 now I see
which one is more powerful? Orin Nano or Asus Z1 Extreme?
Depending on usage
But this board’s bottleneck is 8GiB ram
Is better with 16GiB or higher
Switch pro hardware?
This is most probably how powerful the new Nintendo Switch will be since the Tegra T239 inside it has a very similar GPU to this. Also the TDP matches a portable. I think the Switch will be a little more powerful due to it being closer to the metal when it comes to coding.
The T239 actually has a more powerful GPU than this. It's 1536 Cuda cores/12 SM.
@@Ghostsonplanets Even better.
There were rumours about this chip or a derivative of it being the heart of the next Nintendo Switch. Would be pretty interesting. They went very far using an ancient SoC.
This very likely the next nintendo hardware
There is a possibility that they would go with AMD. Current nintendo is known to use tech that much older for their handheld and AMD has plenty.
However, if they are going to use this SBC, they might use one with the AI disabled.
@@wahidpawana424 They wouldn't even disable the AI portion, they'd use it for the same thing that PC RTX graphics cards are using it for -- accelerated upscaling/antialiasing/cleanup.
But can it play CRISYS
Hi, just verified the shorter M.2 Key-M slot is 2230, not 2242. Just to let others know.
This might be the next Switch SoC. Or even stronger.
its $500 for the 8GB...i wonder how much bread nvidia is making with these development boards, especially with them using Samsung 8nm
What are these little dev boards actually used for? That's what I've always pondered.
my team use jetson for AI purpose installed on automotive factory doing 24/7 object detection for part defect detection without performance decrease instead of buying a PC which draws more power than this.