A New and Better AI NUC is Here
Вставка
- Опубліковано 5 лют 2025
- Now with the Intel Arrow Lake generation, the ASRock Industrial NUC BOX-255H is a massive improvement in a familiar form factor.
STH Main Site Article: www.servetheho...
Substack: axautikgroupll...
STH Top 5 Weekly Newsletter: eepurl.com/dryM09
----------------------------------------------------------------------
Become a STH YT Member and Support Us
----------------------------------------------------------------------
Join STH UA-cam membership to support the channel: / @servethehomevideo
Professional Users Substack: axautikgroupll...
----------------------------------------------------------------------
Where to Find The Unit We Purchased
Note we may earn a small commission if you use these links to purchase a product through them.
----------------------------------------------------------------------
STH Merch on Spring: the-sth-merch-...
----------------------------------------------------------------------
Where to Find STH
----------------------------------------------------------------------
STH Forums: forums.serveth...
Follow on Twitter: / servethehome
Follow on LinkedIn: / servethehome-com
Follow on Facebook: / servethehome
Follow on Instagram: / servethehome
----------------------------------------------------------------------
Other STH Content Mentioned in this Video
----------------------------------------------------------------------
ASRI NUC BOX-155H: • NEW AI Accelerated NUC...
Apple Mac Mini M4: • Only Apple could have ...
Beelink SER9: • FASTEST AMD AI Mini PC...
Beelink SER8: • The Best AMD Ryzen Min...
Ultimate 2.5GbE Switch Guide: www.servetheho...
2.5GbE Switch Mega-Round-up: • Finding the BEST Cheap...
Minisforum MS-01: • The Pinnacle of Mini P...
Intel C3758 Fanless 10GbE Server: • The EVERYTHING $300 Fa...
CWWK Fanless Desktop System: • FANLESS 7W Homelab Fan...
New 8x 2.5Gbe and 4x 2.5GbE and 2x 10GbE Firewalls: • Shocking New 10GbE and...
R86S Pro Review - • This is a SUPER Homela...
R86S Review - • This is the GoWin R86S...
iKoolCore R1 N6005 Review: • This CRAZY SMALL 2.5Gb...
Intel Core i3-N305 Fanless: • Best EVER Fanless Mini...
Intel N100 and N200 Fanless: • HUGE UPGRADE! New Fire...
Intel Alder Lake Fanless: • KING of Fanless 2.5GbE...
Example of setting up Proxmox VE with OPNsense/ pfSense: www.servetheho...
ASRock 4x4 AMD Ryzen 7 5800U: • This AMD Ryzen NUC Alt...
----------------------------------------------------------------------
Timestamps
----------------------------------------------------------------------
00:00 Introduction
02:04 External Hardware Overview
06:18 Internal Hardware Overview
10:25 The Big Change Intel Arrow Lake v. Meteor Lake
12:26 Performance
13:29 Power Consumption and Noise
17:27 Key Lessons Learned
![Lp. Сердце Вселенной #60 РОЖДЕНИЕ ЛОЛОЛОШКИ [Финал] • Майнкрафт](http://i.ytimg.com/vi/YoR0pAV9FVQ/mqdefault.jpg)
Great job working on your health! Keep it up.
Still a work in progress, but there is progress. It will be strange for people to see parts of things that we filmed in January that will go live in June and have added bits then
For those searching, pricing is about 669,99 in most countries.
I think we showed the Newegg page briefly.
In which currency? 😊
17:31 - Patrick says the price right here.
Whenever I see one of these, I think "oh nice", then we get to the price and I wince. That then reminds me why the various "direct from China" devices get so much interest. You lose a lot of support and reliability, but can actually afford to buy them. Hmm.
I've been searching but they're always out of stock, call for quote, or listings only. Cool bit if kit, just not readily available.
Nice that it’s good but the high price disqualifies it.
Same problem that msi, asus, etc all have with these
The other side is that ASRock is not a small brand by any means.
@@ServeTheHomeVideo mac mini is cheaper
@hongtanke Sure, the mac mini is cheaper (assuming you don't need modern amounts of ram and storage). But the mac mini has big issues. For example, if I bought this mini pc, I would be fairly certain linux would work just fine on it. Not even Asahi Linux has official support for thunderbolt on *M1*
excellent video and happy new years broski good to see you again
HNY to you as well!
Love your coverage of NUCs and such, and also thanks for turning me onto MikroTik hardware. Their RouterOS is killer.
Congrats on the health journey. Just curious if you've done a DEXA scan prior to starting the diet? I found it invaluable when I decided to lose weight years ago, as my first health plan didn't include enough protein and resistance training and a subseuent DEXA scan a couple of months later made that obvious since I saw what proportion of the weight lost was muscle mass. Helped to adjust and not lose too much muscle along the way.
I did not. If you go back to pre-pandemic I had been doing Crossfit daily for a decade plus when it was still a few gyms in NorCal. ~40-45 min Murph depending on the day. I need to get lighter so I can get back to those workouts.
❤ Maybe it’s an idea to mention the price at the start, this puts things in perspective when ingesting information about the product
Hard to do the value comparison with Mac when they charge +$400 for 32gb ram and +$800 for 2tb storage, anything is better value
Very true. Low-spec Mac does well, but then once you upgrade, this is much less expensive.
I think it would be preferable to just have four thunderbolt ports and let the customers and resellers do whatever they want with them via hubs. It's actually limiting to have to run the cables for the all peripherals directly to the CPU, I think the manufacturers picture all the customers sitting at a desk with everything within three feet, That's certainly not how I use these systems. And yes, I understand 'they' charge a ton for Thunderbolt, and many cpu's probably can't handle the combined throughput. But it's silly to have elegantly solved a problem years ago but not use it in 99 percent of the peripheral connections due to the greedy price they set for Thunderbolt.
I totally agree. That is like the Apple model
similarly how it was when firewire was started… make technologies expensive…
somewhat similar when DP introduced, HDMI there’s fees for using it, but still more HDMI devices compared to DP… charge more when there’s more money to make…
Great job slimming down! And yes, why can't vendors just label their ports? It seems so simple.
Thanks! Still a work in progress
Wanted to keep using the old silkscreen, presumably.
Can you benchmark this for AI use?
Congrats on the weight loss!
Thanks!
Over priced. And what's with the short m.2 slot? Both slots in a machine with this price should be 2280.
Looking sharp boss man! 💪
Thank you. Still working on it.
cant wait for the zotac minipc's on this architecture!
Looks like it would be perfect for local hosting containers on.
Why put AI in the video name and not test AI?
I want to love this, but the Ryzen AI mini PCs have LPDDR5X RAM running at 7800MHz, which is one of the most important factors in running LLM models locally. This may be useful for something like computer vision AI, or image generation, but any model that requires high bandwidth memory, this is just less useful.
Big ups on better health!
What's Asus warranty practices on this? 😅
Thanks! ASRock Industrial
None, because that's from ASRock, which has nothing to do with Asus 😅
What program is Patrick using to Stress Test/Monitor on the Big TV?
s-tui
-> Audio feedback. Truly love all your videos, Patrick! But on all of them you use this backing music that has a small beep in it, and you cannot unhear it once you notice it and it really stands out then :) In the beginning I thought my washing machine was beeping or the fridge or something else, but then realized that the music loop has it in it. :) For example, you can hear it @ 0:36 when you say "one difference" and then every 30 seconds or so...
Thanks for the feedback. I will send this to Alex.
@@ServeTheHomeVideo Thank you too, and keep it up! :)
It feels like a generic Dell pre-build would compete with this high of a price point.
Dell's Micro systems tend to cost more, and also do not have features like the dual 2.5GbE. Also, the Micro's tend to use higher TDP CPUs so you would expect ~30-50% higher power consumption. Check out our Project TinyMiniMicro series.
but does it have USB-c PD Input on the thunderbolt port? i.e. so you could run it as a single cable computer with an appropriate dock
good job on the diet patrick!
he is on a new advanced node. basically a die shrink
Thanks! Still a work-in-progress.
@@ServeTheHomeVideo Good effort so far Patrick keep up the good work. Recently achieved 3.5 stone loss here.
WTF does this have to do with AI? You never mentioned it?
So this is where intel will try to offload these chips. Might work. Insane power draw for a mini PC though. An equivalent ryzen mini PC seems like a no-brainer.
Should call out to these mini PC makers to add an external antenna jack that extends from internal wireless card. Almost all have very poor wifi/bluetooth reception
I had to return them due to poor wifi and bluetooth
You know they use m.2 cards that have standard antenna "pins"? You unpin the included wires and get something else - I bet you could find external antenna socket with those.
Does anyone have any good suggestions for UK based vendors who will stock this?
0:51 Wow that typo in the 255H datasheet - World record 16 socket NUC! How do they do it?! lol
Crazy, that is lscpu output
I don't quit understand the point of this over an MS-01 with a 12900H unless you specifically want a bit of desktop tops.
Ya...even the MS-A1 with am5 cpu that it can contain lol wonder how maxed a1 would fair against this. Think asrock could lower costs by making more under consumer label maybe like minisforum
You are right. This is a much newer CPU and it is from a much larger vendor.
tbh, the big selling point of the MS01 is its 10gbe ports. Also the 12900H and 13900H overheat quite a lot and need severe power limiting, and their cooler isn't discreet. they don't really compare all that well to the Asrock
Change NPU -> 10G ports and I want it.
Hi Patrick, what is this power monitor utility you are using?
s-tui
Too expensive. For mini PC I'm ready to spend $350 top.
Given the 1K tray price for the 255H that is not going to get you this class of system.
Ahh, the USB Standart always a nightmare.
USB is not a realy standart, it is Quizshow for everyone, every day.
I call it a nightmare
Ahh the spelling. Not really standard. Not even close.
@ Sorry but im not a Nativ Englisch speaker or writer
Hi Patrick,
does this support in-band ECC?
what software was that on the big screen?
Ubuntu?
@ServeTheHomeVideo i mean the actual program showing cpu usage etc
@@TheZieloo s-tui
Regarding buying a mini pc right now, Intel ones are compatible with pretty much all hardware and software i/o standards, but I can't trust Intel to not try to pass me a defective cpu. And AMD-based computers aren't compatible with absolutely everything, so I have to do my homework. I remember in the 2010's finding out VMWare wouldn't run on AMD, that one hurt.
For VMware these days, I actually like AMD since you have homogeneous cores
@@ServeTheHomeVideo You still can run ESXi 8 with both P and E cores enabled - two flags to be enabled and off you go. Not officially supported, but who in their right minds would be purchasing Broadcom support today anyway?
@@ServeTheHomeVideo Fair enough! I still have that 8-core Ryzen-1 system, though I upgraded it to a 5800X for Windows 11. I stopped following VMWare after it was acquired, just too much trouble to play with nowadays, there are better and cheaper toys.
14:08 The core forecast is in -- looks like it's going to be a scorcher. 😅
I thought the same. Funny enough, we left this for 24 hours came back and it was still going strong.
Congrats on the weight loss, but please be careful, at 1:53 you've lost part of your hand!
Did anyone else notice that the lscpu screenshot showed 16 sockets and 1 core per socket? Is that indicative of anything other than a simple bug?
Yeah, that doesn't seem right.
I have a previous model (NUC-1360P) and I couldn't be happier. I am just not happier since the core count of the new 155H and 255H is lower than the 1360P was, and I need cores more than I need speed.
That is very fair. You even lose threads with this over the previous generation.
Yeah, but mac mini has a gpu that doesn't suck, and since it's sharing memory with CPU you can load some huge AI models and have them fly.
Somewhat. If you have a base Mac Mini you are stuck with small models in 16GB. With these, you can add 96GB and actually run much larger models.
@@ServeTheHomeVideo From my experience: not really. On mac gpu can use WHOLE system RAM, on PC iGPU is limited how much it can access due to design of operating system - hence if you load stuff from LLMstudio part of your model will be processed by CPU, not the GPU, and makes it really really slow. Do a simple test - load a model that takes like 48GB on the mini pc you suggested, and then load same model on mac mini. Let us know the difference. At this moment I'm using M4 max with 128gb ram to run models larger than 70GB - only reliable and fast way that I've found so far that doesn't require machine in excess of 50k$.
There is more of a change between 155 and 255 than i expected, also didnt expect the iGPU to outperform the 8700G.
When AMD announced they'd have a 256 bus APU with 16 cores and 40 CUs i was ecstatic, with DDR5 that would mean up to 1TB of RAM per node (assuming 2 dimms per channel and using the larger capacity, higher speed, lower latency desktop udimms even more if it supported ECC/RDIMM), this could allow running large models locally on a single machine instead of chaining 4 or more nodes together like many have been doing with Macs
Now many people are telling me Strix Halo only supports LPDDR and was never designed with DDR in mind, sort of like a console like the SteamDeck or a graphics card unlike their other APUS which include both. If this is true AMD has shot themselves in the foot by having the same capabilities as Nvidia and Apple. AMD could have eaten their lunch offering 1TB of RAM in the same space as the Nvidia Digits with only 128GB of RAM where many models will require 4-8 digits to run the full model, not because the GPU isnt powerful enough, but because there isnt enough RAM
Heck right now you can get more RAM on the 8700G or 14900K than you can with Nvidia DIGITS
They look interesting and I like the efficiency, but as long as they don't have the power suppy integrated, I don't plan to buy another one. I also won't buy another PC with Intel CPU.
If this only had 2*TB so e could use fast TB Networking in a cluster...
Good point
Nyuk, nyuk NUC.
bro you need to turn off overscan on that big tv of yours
What is crazy is that this was something that Ubuntu on this system with the LG OLED did.
@@ServeTheHomeVideo 😧
2:18 If one uses fractional units with decimals (!), why not convert completely to the real thing: the decimalic system called metric 😂
Run the engine of your own demise
i am sure most pp would want all cores running at 4ghz i want full power. not a cripple.
Vs base mac mini
Do you like unifi products?
We use some.
Too expensive for HDMI 2.1 TMDS
Ubuntu is the worst thing that happened to the FOSS community.
Why would you even mention this piece of c...p?
They've chosen their community, Oracle, Google, Amazon, MS, etc.
Someone did a llm video on the previous gen with 96gb. ua-cam.com/video/xyKEQjUzfAk/v-deo.htmlsi=hqOLqElk3-Hpnjal
Getting 96GB of CSODIMMs right now is not easy
@ServeTheHomeVideo well, soon.
ugh, 2.5GbE
Mac mini can get 10ge why don’t we get mini pc with 10gb Ethernet
@@PCGUYSMiamiyou have m.2. Same as mac mini. Just put it in
Well, dual 2.5GbE. These days you can plug both into an unmanaged switch (no need for link aggregation) and get ~5Gbps of performance using SMB3 Multichannel without having to do anything on the networking side. I agree 10GbE is better, but adding a TB to 10G adapter is easy.
Waiting for intel 5gbe
@@ServeTheHomeVideo True, but TB to 10G adapters are all still really expensive, maddeningly so. I could get IOData's M.2 adapter, but then I lose an SSD slot.
Most of the time it's cheaper to get an ADT PCIe expansion board and a cheap X520 or X540 card. That's still gonna be $200.
And then, I have to have a separate power supply for the card, a cable coming out of the *front* of the NUC, and it all stops making sense. I get a miniPC because I want a small, neat package that is a competent performer. Once I add in a bunch of cables and external adapters and nonsense, I might as well just build a tower or a rack mount system, all because of the network speed.
I'm happy to pay an extra $1-200 for built-in 10G, its just so disappointing that it seems like Apple are the only ones thoughtful enough (or greedy enough, LOL) to offer that option. It seems like a lot of times these miniPCs bend over backwards to allocate IO for dual HDMI out and dual DP out, which ok, fair enough, a lot of people do use these as desktop PCs and all the power to them. It's just that those decisions always tend to compromise the headless/home server/HTPC use case where these miniPCs shine so brightly. If this had 10GbE I'd go pick up three of them, stuff each with 2x2TB NVMe, maybe a larger SATA SSD, and cluster em together, no ECC be damned.
Just so frustrating so many miniPC manufacturers miss this mark.This is still a nice little box, all things considered. I also wish Intel would let us use unbuffered ECC on their consumer platforms.
Every time I see two ethernet ports on one of these I just want to scream. I will never buy anything that has two ethernet ports.
Why? You can just hook them to an unmanaged switch and using SMB3 Multichannel it automatically will use both for transfers to and from a NAS as an example.
@@ServeTheHomeVideoI didn’t understand that either. You can also build a kick ass router/firewall/mail server.
Basically not available to buy retail. What a tease 🫠