When I saw this thumbnail I literally went to "The Collab nobody knew they needed" only to find it was the first line of the description. Great minds and all that... Good stuff y'all!
Thanks for that-this video will end up being a bit of a swan song for 2022, sadly... I have to get surgery, and though overall I'm feeling a bit better than summer, I've had complications enough that I have to get a pretty major surgery in a week that'll knock me out until next year :( But hopefully after I recover, I'll be a lot better off! Maybe I'll be able to feel 100% again, it's been a while since I was feeling my best.
@@JeffGeerling Really hope you feel better soon and that the surgery helps. You have done amazing work, and we all appreciate what you do. In fact, you inspired me to setup a Raspberry Pi Compute Module 4 and I/O Board with native-boot NVMe, which is what I am writing this message to you on right now. :) Thank you for all that you do Jeff, you have made the world a better place and are an inspiration to all!
@@JeffGeerling 🤞🏻that the surgery goes well, hopefully even better than expected 🤞🏻Wishing you can feel 100% again (it's been over 30 years since I had a day without pain so I don't really remember how 100% feels)
@3V0 person here, who types words that people read when in front of their face. I'm an atheism denier. I don't believe that people don't believe in skyman. You can't prove you exist, so I win. Wish maker-of-video man all the good things and speedy recovery. I like how you speak words out loud and I hear them. Subscribed.
I seriously love ARM so much, so this got me really excited!! Great video :D I've waited years and years for someone to fully push out ARM to the mainstream desktop for "regular" consumer usage, and while the Pi's + others are capable, nothing was ever the same as your usual x86-64 for typical tasks / light gaming. Well, when Apple announced their M series of chips, I got excited and purchased one right away after reviews! Been happily using my M1 Max as a daily driver, all because I love ARM and really want to support it as much as I can, even if it's coming from Apple, who doesn't truly *need* the money but ended up making a product that I had been looking for for quite some time. I'm just happy that a major company took the plunge, and I'm happily following suit. Maybe someday we'll all be on ARM!
not for much longer. the way arm is going it is killing itself by spitting in its customers face by forcing major companies to use its gpu along with its cpu. after this many companies are looking at risc v. hopefully, risc v takes off as it is open source
For what it's worth, afaik, the big selling point of ARM cpu designs was in power savings not so much raw performance. -- Even if a particular design/SoC performed at a mere fraction(say 50%) of an Intel x86/x86-64 system the former would kill in terms of power savings. // Things have improved a lot and now that even Intel chips are SoC-like...
@@jnharton Performance as well. At the socket level Ampere M128-30 matches or exceeds top bin Epyc Milan for Data Centre workloads whilst burning less energy. Anandtech and STH have published stats.
@@vikingforties I was really talking about the broader history and not so much the current state of affairs. Also, given that x86 development was, for a long time, presumably based on single core, single thread performance and ARM is a relatively new architecture...
Intro: I love that Pi cluster box (sees price tag) Sees Galaxy Quest: Classy throw back my friend Blue Shirt Jeff whose a spinoff of "Tim the Toolman: PC Edition" when? :Edit: Sees server "Drools" I have no idea what I'd use this for but I want it.
That's what GFLOPs/W and MIPS/W benchmarks represent on a standard scale that should convert to other loads, provided everyone uses the same benchmarks without cheating. Of cause, additional numbers are needed for idle and near idle power consumption.
@@ServeTheHomeVideo Hope he appears secretly at your channel and still return it in one piece... and hope red shirt jeff does not use his favorite grinders and whatnots
Have been a fan of STH for almost 10 years now... Has always been a great website, and the forum is great as well. The hardware sale section is an amazing place to find deals on server grade hardware that is coming out of production if your looking to setup a good home server cluster.
in case you think of using one of them for virtualization it would be nice to have the performance per core. that is because next year there will be a shift in licencing from cpu to core (read VMware here).
@Greyson thanks for the comment, yes but, if you own a million dollar company you want to stay on the safe side and then you buy support from the vendor (read RedHat or Suse). if you get a problem installing a SW (SAP, Dynamics, VDI) and you have problems to whom are you asking, do you have enough people in IT to go through the opensource code and find a solution.... Being technology enthusiastic, having an home lab is completely different in managing company/corporate infrastructure, you want reliability and support. if you look around many applications are born as opensource but there is always a "pro" version, for the support.
@@g.s.3389 Just to be picky, you miss stated your example. RedHat and Suse are opensource. Opensource and free are not the same. I get what you mean though. I have 2 sides in my DC. The internal side runs on things like docker, haproxy, a lot of Ubuntu for simplicity. The client side runs on kubernetes (openshift), F5, and RedHat for added support. I have no issues supporting either, but when you are dealing with things in the enterprise, they want to have a company support to be able to contact for some types of things.
@skechergn It depends on the pricing. If the core pricing ends up equaling what the CPU pricing would be at a certain point, it is just targeting the new processor setups. There is a large difference in the amount of vms you can run on 24 cores/512GB ram and 140 cores/2TB ram. Especially when you start looking at containers on VMs on a hypervisor. Containerization is really hammering VM virtualization. I have a pair of IBM power servers (for redundancy) running Openshift. It's running the same workload that use to sit on a 12 system ESXi cluster because of the number of different VMs it needed and the number of servers to make it n+1 for the hardware. Those 2 power servers still have plenty of resources to add a ton of additional containers to it before it would even comes close to high utilization on one node in a failed scenario. I can see why VMware would need to go to the core level overall to not only make more money on the higher end server chips but also allow them to be price competitive on smaller core numbers. If the price per CPU is based around say what will now cost for 40 or 64 more cores, then if you come in needing 24 or 36 cores, then it would be cheaper then the old CPU cost.
@skechergn Your still assuming it will be a higher (then inflation) cost with the new licensing. We can't say it will or won't until we see it put in place across the board. It could be a way to enable charging more across the board and it wouldn't surprise me. But it could also be a way to make the costs more cost effective also. If it becomes cheaper on the lower end and more expensive on the higher end, then they are really just trying to be cost effective against competition. Again, I am not saying it will work out that way, I am just saying we are assuming that it will raise prices (beyond inflation) for customers without any evidence yet.
Love Love LOVE my MicroCenter in St Louis Park. Excellent sponsorship! Beats the fiasco of Kamikoto knives and Scottish Titles (what a scam those were).
here's the cost of 6 Pi's... with 6 2TB nvme sticks, and it's more expensive than a single high-end AMD CPU.... Wow. truly an amazing comparison. Love the humor.
18:09 You should try out Armbian. Their support of older arm boards is phenomenal. My tiny cluster of 4 Orange Pi pc's form ~2015 is still running perfectly with kernel 5.15 thanks to Armbian.
This seems like a kinda cheeky way of telling commercial/industrial customers "sooo how about not buying up all the Raspberry Pis, you can do better per watt and per dollar with larger scale solutions!" hope the Pis can come back in stock soon
Most of the industrial/commercial usage is just using a single Pis though, where the performance isn't always as critical. But there are use cases where people still use Pis where they'd probably be better served with something else (especially with above-MSRP pricing).
I love the collab with STH! Keep up the great content! I have been running my own "server" (TS3) since the early 2010's. Never realized that was homelab-ish territory. Now I run a bunch of servers off of RasPi's, Local PC's, and a NAS. Totally Cosplaying as a SysAdmin. Want to do more in the future and you are helping me do that!
Remember the Ampere has 128 PCI lanes. That is capable of dedicating a compute core per lane - quite a barnburner. So you are comparing a state of the art Enterprise datacenter processor to a high end consumer microcontroller with embellishments to appear equivalent.
@@JeffGeerling - For embedded development that is more than adequate. The PI really is intended for embedded controls with IOT function enhancements and it does it exceptionally well for a game changing price. There really are multiple classes of computing ranging from Super down to bit twiddler. Each class has a finite set of requirements and as such specific circuitry. Any System On A Chip design (Arduino/Pi/Beagle/etc) has a target price/performance and feature set derived from intended market expectation. License free Linux as an embedded foundation really moved things forward dramatically. What you see with the Shields and Hats expansion is horizontal market requirements being met until the market is big enough to justify a custom SOC budget. What is fascinating is how advanced desktop processors have become with no real benefit to the consumer. Yes Photoshop/video editors and gamers will squeeze every bit they can out of the latest IO/Memory and number of cores but for 86% of the market there is very little benefit. In fact many games are single core - so these large multicores sit idle whale the main core is overclocked as best as possible. So its an interesting moment in time in that regard.
I was just playing with VirtualBox, Docker et al - really these uber core processors with massive PCI lanes and deep memory (cache and onboard) systems are "purpose built" for datacenter virtualization and GPU/AI farms. I had to load specific programs to exploit the multiprocessor array. What is quite interesting is how quickly even a lowly six or eight core can be data starved. You must use a RAID array it seems to "feed the beast". Not surprising but interesting to watch the perf meters cope with Page Faults etc. I'm guessing the proves the old adage "Clocks are better than Cores" for most home/game users since more cores means slower clocks due to power and really most software is single threaded. As such I would home the Cortex folks stay focused on maximum speed (with power levels ) and low temps since cooling a PI is a bit limited due to its size and IOT use cases.
RE: first bit about 24 RPi cores vs 24 x86_64 cores. A, say, 1GHz ARM and 1GHz x86 are VERY different. ARM will always win on the power consumption front, but even if using a reduced instruction set(IIRC) the x86 will walk all over an ARM twice before it even realizes what happened, and a few more times before it hits the ground. Yes, application matters. Programming matters. Auxiliary processing load matters. But straight clock for clock ARM and x86 are not comparable, its x86 on top all day long. You cannot replace a x86 desktop with an ARM and expect the same performance. But that was never what they were supposed to do, its not their design case. Remember, the right tool for the right application ;)
I was in the market for an ARM VPS but couldn't find any good ones. Honestly I am so ready for ARM to just take over the server space more and more - its super efficient, less cluttered than x86 and has some great nicities. Unfortunately, software support is still a little hit or miss - especially when talking about Phones and Tablets where SystemReady isn't implemented properly - be it on purpose or not. Honestly I'd love to play around with one of those! These ARM servers are awesome as heck! ^_^
I'm using Graviton, as Arm 64 makes sense to match my M1 Max laptop. However, AMD Milan is way more efficient than any Arm server chip up to this point, you don't get much in terms of efficiency if you are on AMD, right now.
@IngwiePhoenix Did you not pay attention? Literally said in the video 16:28 that ARM isn't inherently more efficient than x86. In fact, the lack of libraries and application support can make it LESS efficient. What apple did with the M1 came down to building an ARM chip made specifically for OS X, down to the point where it theoretically should be good for gaming, but isn't since apple doesn't put as much thought or support behind it. Also, apple decided efficiency at all costs, to the point where the damn thing throttles on certain tasks to keep the battery life well and the cpu cool.
What an awesome vid guys! Not only did i learn new stuff, I couldn't be but happy to see you both school us on a badass project. One of the best vids I watched coming from your end. Thank you both!
What. CM4 modules cost now 165$. This is insane. Great video Jeff. Also, I am bit on the edge about getting DeskPi Super6C. It only has 2x1Gbit uplinks, and even utilising two of them is tricky due to the type of switch chip used. If it would had 10Gbps, or maybe even 2.5Gbps, it would be an interesting option. Also lack of some BMC to access serial console and power state of CMs is not great. They could have added a small stm32 micro with a 100Mbps ethernet to just do some telnet to interact with few things on board and serial ports, and maybe small http server to view some minimal metrics, it would be useful. And where is RTC battery. I can live without it probably for cluster setup where I would be using NTP, but come on.
I think the Turing Pi 2 is probably the more flexible option, and hopefully their production run will get underway soon (they just said they're tooling the line for a first 1,000 unit run).
What really concerns me, the realization that red shirt Jeff is not confined to the Geerling basement. We don't need that harbinger of chaos roaming free to spread this madness!
Don't forget that I/O bandwidth is next to nothing on the PI and the real server probably has excessive lanes. Don't feel bad though, even desktops have crippled I/O compared to what they should have.
Those linpack benchmark results were super interesting, didn't know m1 max chip was that far ahead. I wonder how long will it take for competitors building arm64 processors to catch up
Comparing different things here. An M1 client CPU to CPUs designed to operate in a DC (e.g. Ampere Altra & Graviton). Data Centre and cloud workloads tend to force the economics for your compute & I/O efficiency per rack of servers and storage. M1 still needs a focus on per core performance because there's way more single threaded stuff that it has to deal with.
That's some pretty crazy stuff! I have a couple Raspberry Pi 3s running Stretch. They weren't cutting it for me so I just decided to drop $$$ for an Apple M1 Mac Mini with the 16GB of RAM and base everything else. External SSD is a lot cheaper although slower. The plan is to run it headless with a direct 1GB/s Ether connect to my router which goes to my cable modem. The router gives my house WiFi. It's kinda old, but I'm not sure what to update it with yet. That's my lazy solution to a local server. It's double plus cool to see that there are still hobbyists out there building custom computers. It's like the 1970s with 2020s tech. Good stuff.
Atlas might not be the best blas library. There are others which may give significantly better performance, including openblas and the libraries bundled with official arm development compiler suite. You can also usually win a bit more performance by experimenting with the relevant compiler flags.
If the point is /benchmarking/, then you use the same program on the different hardware configurations because you want a comparative sense for which is better. Otherwise you use whatever can perform /best/ on the hardware you have, as you are suggesting.
@@jnharton The linpack test does use the same source code on each system. Blas is a standard library, so does the same thing on every system. Clearly, you need to compile and link the code in the way that gives the best performance for the target hardware.
I love seeing favorite UA-camrs collaborating together on a video! Now I want to see Linus & Jeff together in a collaboration. Another good one was Linus and Destin from SmarterEveryDay doing a collaboration on the computer from the Saturn V Rocket.
Besides of being an incredible interesting subject, i love how you pulled a page out of the influencers that contaminate UA-cam and the media with Nvidia GPUs visible just because (LTT, TechSpot and others) with your strategic placement of AMD CPUs. Here is a like going your way!
So I really enjoy the large box labeled "Only Fans" 🤣. Also it's pretty surprising your efficiency went up when overclocking, apparently the opposite usually happens on desktop pc's. Wonder if that means there's more headroom in the silicon?
Weirded me out seeing you mention the St. Louis Microcenter... Until last year I lived directly behind the building (Well, and the ravine behind it). I know that is an ad spot... but I miss that place so much.
I think in Patrick's studio, there are at least 2,000-3,000 CPU cores between all the Intel, AMD, Ampere, and other exotic CPUs laying around (you don't even see most of them behind the set!). That doesn't include the many thousands of GPU cores (CUDA et all) on GPUs on the set!
Our first MicroSoft compatible PC back in early 80s cost more then $3200. It had a whole 10MB Hard Drive that weighted more than most Desktops do today. Black/Orange tinted 2 color cathode 10 inch monitor and of course your 5 1/4" soft floppy drive and later we got the 3 1/2" hard floppy drive as well. We were COOL! Well my Brother in Law had the 8-inch floppy drive as he worked for JPL at the time and wanted to take work home. My other Brother in Law went the Apple route and later MAC and had LASER disc player, where the laser disks which came in a cool cover for movies and disks were double sided 12". Fun to think back to those days, everything was new, few standards and future looked limitless.
One area where the Pi board wins is because you essentially have 6 discrete systems linked together you essentially have built in failure redundancy. So instead of dedicating all 6 to active server functions you could have monitoring set up so if there is a crash or some other failure one of the nodes that is held back is switched over to with the config of the node that failed. Or instead of them being clustered at all just run as a bunch of individual server each handling their own tasks. In an educational example each person learning would have their own dedicated 4 core machine attached to the network to learn with rather it be compiling and testing code or whatever else. No monkeying around with load balancing, VM license costs/issues, everybody gets their own dedicated box with only their account. Very much an example of giving a student enough rope to hang themselves with.
What a super-fun collaboration exploring Arm server options! Thank you for stopping by Jeff!
It was so fun to do this video... maybe we can figure out another fun project for next year?
Hope you got back the Server he stole lol at the end we all saw you Jeff. lool 🤣🤣🤣
We need more of those!
Keep doing more, that was fun
@@JeffGeerling You could set up a mastodon instance on a pi cluster. See how it holds up:)
2021 Linus flexes doing videos on million dollar home, 2022 Jeff flexes showing off he ownes multiple Rasberry Pi units.
i make my pies in owen too lol
@@lordjaashin stupid auto correct
he has the last batch of RPIs while they were still made.
But the PI entered the halls of history, it was good while it lasted.
@@monad_tcp I think he is the reason for the shortage. He just uses them once and throws them away after each video lol
They that rare? I traded someone a pin zero w for like a pair of wire strippers and a 32v 20a power supply
Patrick and Jeff. In one video. Talking ARM servers and RPIs. Awesome
Truly excellent crossover episode!
Amazing that he was able to find 6 compute modules let alone regular Raspberry Pis
The secret is to order them in late 2020 😭
It just the RaspberryPi trend since the beginning. I remember the months I needed to get my hands on the first one...
Call this Pi server "unobtainium"
I can still get them rather easily, but at 3-4 times the price. It's insane.
@@JeffGeerling Now you tell us.
When I saw this thumbnail I literally went to "The Collab nobody knew they needed" only to find it was the first line of the description. Great minds and all that...
Good stuff y'all!
Haha you know it!
It seriously makes my day when you're feeling good enough to make a video and post it. Glad to see you upload again Jeff.
Thanks for that-this video will end up being a bit of a swan song for 2022, sadly... I have to get surgery, and though overall I'm feeling a bit better than summer, I've had complications enough that I have to get a pretty major surgery in a week that'll knock me out until next year :(
But hopefully after I recover, I'll be a lot better off! Maybe I'll be able to feel 100% again, it's been a while since I was feeling my best.
@@JeffGeerling Really hope you feel better soon and that the surgery helps.
You have done amazing work, and we all appreciate what you do.
In fact, you inspired me to setup a Raspberry Pi Compute Module 4 and I/O Board with native-boot NVMe, which is what I am writing this message to you on right now. :)
Thank you for all that you do Jeff, you have made the world a better place and are an inspiration to all!
@@JeffGeerling 🤞🏻that the surgery goes well, hopefully even better than expected 🤞🏻Wishing you can feel 100% again (it's been over 30 years since I had a day without pain so I don't really remember how 100% feels)
@enrique amaya coming from an atheist, not only does he live you, he loves everyone.
@3V0 person here, who types words that people read when in front of their face. I'm an atheism denier. I don't believe that people don't believe in skyman. You can't prove you exist, so I win. Wish maker-of-video man all the good things and speedy recovery. I like how you speak words out loud and I hear them. Subscribed.
That was a great collab. The scripting was fantastic and you guys interacted seamlessly.
Jeff nicking the server at the end is the cherry on the top. Great video guys, I enjoy both of your channels :)
good to see a colab with you and Patrik :D
I love both channels, looking forward to more colabs!
Two of my favorite UA-camrs! I'm glad to see what Patrick's studio looks like!
x86 servers also have a mechanism for attesting the boot process that simply doesn't work right now with an arm server.
You mean the lockdown to Microsoft signed boot images?
Great collaboration from 2 of my favorite tech channels.
Owesome ! Thanks to both.
Hope your getting beter Jef ,
Serve the "large scale, high performance data center" home. Great collab guys.
13:40 Love to see JEFF hosting in STH's new studio.....🤩🥰😍😘🥳
I seriously love ARM so much, so this got me really excited!! Great video :D I've waited years and years for someone to fully push out ARM to the mainstream desktop for "regular" consumer usage, and while the Pi's + others are capable, nothing was ever the same as your usual x86-64 for typical tasks / light gaming. Well, when Apple announced their M series of chips, I got excited and purchased one right away after reviews! Been happily using my M1 Max as a daily driver, all because I love ARM and really want to support it as much as I can, even if it's coming from Apple, who doesn't truly *need* the money but ended up making a product that I had been looking for for quite some time.
I'm just happy that a major company took the plunge, and I'm happily following suit. Maybe someday we'll all be on ARM!
not for much longer. the way arm is going it is killing itself by spitting in its customers face by forcing major companies to use its gpu along with its cpu. after this many companies are looking at risc v. hopefully, risc v takes off as it is open source
For what it's worth, afaik, the big selling point of ARM cpu designs was in power savings not so much raw performance. -- Even if a particular design/SoC performed at a mere fraction(say 50%) of an Intel x86/x86-64 system the former would kill in terms of power savings. // Things have improved a lot and now that even Intel chips are SoC-like...
@@jnharton Performance as well. At the socket level Ampere M128-30 matches or exceeds top bin Epyc Milan for Data Centre workloads whilst burning less energy. Anandtech and STH have published stats.
@@vikingforties I was really talking about the broader history and not so much the current state of affairs. Also, given that x86 development was, for a long time, presumably based on single core, single thread performance and ARM is a relatively new architecture...
@@jnharton Ahh. got you. I take your point.
Intro: I love that Pi cluster box (sees price tag)
Sees Galaxy Quest: Classy throw back my friend
Blue Shirt Jeff whose a spinoff of "Tim the Toolman: PC Edition" when?
:Edit: Sees server "Drools" I have no idea what I'd use this for but I want it.
We should compare Wh for fixed unit of work. E.g. the same compilation/render and just look at the power consumed to do the work.
That's what GFLOPs/W and MIPS/W benchmarks represent on a standard scale that should convert to other loads, provided everyone uses the same benchmarks without cheating. Of cause, additional numbers are needed for idle and near idle power consumption.
Hey, this is great! Y'all make great crossovers.
yes, the collab we never knew we needed. good thing red shirt jeff must be busy somewhere else.
Just don't watch to the end 🫣
@@JeffGeerling i commented before finishing the whole thing... oh no....
@@n0madfernan257 We are still trying to find the Ampere server
@@ServeTheHomeVideo Hope he appears secretly at your channel and still return it in one piece... and hope red shirt jeff does not use his favorite grinders and whatnots
Have been a fan of STH for almost 10 years now... Has always been a great website, and the forum is great as well. The hardware sale section is an amazing place to find deals on server grade hardware that is coming out of production if your looking to setup a good home server cluster.
This is an amazing with Patrick. Thank you both
Loving the content, good Sir. Definitely the best collab of '22!
Wow, I cannot believe how compact the STH studio is, it really stood out when both were in there
in case you think of using one of them for virtualization it would be nice to have the performance per core. that is because next year there will be a shift in licencing from cpu to core (read VMware here).
@Greyson Sounds like a reason to use qemu.
@Greyson thanks for the comment, yes but, if you own a million dollar company you want to stay on the safe side and then you buy support from the vendor (read RedHat or Suse). if you get a problem installing a SW (SAP, Dynamics, VDI) and you have problems to whom are you asking, do you have enough people in IT to go through the opensource code and find a solution....
Being technology enthusiastic, having an home lab is completely different in managing company/corporate infrastructure, you want reliability and support. if you look around many applications are born as opensource but there is always a "pro" version, for the support.
@@g.s.3389 Just to be picky, you miss stated your example. RedHat and Suse are opensource. Opensource and free are not the same. I get what you mean though. I have 2 sides in my DC. The internal side runs on things like docker, haproxy, a lot of Ubuntu for simplicity. The client side runs on kubernetes (openshift), F5, and RedHat for added support. I have no issues supporting either, but when you are dealing with things in the enterprise, they want to have a company support to be able to contact for some types of things.
@skechergn It depends on the pricing. If the core pricing ends up equaling what the CPU pricing would be at a certain point, it is just targeting the new processor setups. There is a large difference in the amount of vms you can run on 24 cores/512GB ram and 140 cores/2TB ram.
Especially when you start looking at containers on VMs on a hypervisor. Containerization is really hammering VM virtualization. I have a pair of IBM power servers (for redundancy) running Openshift. It's running the same workload that use to sit on a 12 system ESXi cluster because of the number of different VMs it needed and the number of servers to make it n+1 for the hardware. Those 2 power servers still have plenty of resources to add a ton of additional containers to it before it would even comes close to high utilization on one node in a failed scenario.
I can see why VMware would need to go to the core level overall to not only make more money on the higher end server chips but also allow them to be price competitive on smaller core numbers. If the price per CPU is based around say what will now cost for 40 or 64 more cores, then if you come in needing 24 or 36 cores, then it would be cheaper then the old CPU cost.
@skechergn Your still assuming it will be a higher (then inflation) cost with the new licensing. We can't say it will or won't until we see it put in place across the board. It could be a way to enable charging more across the board and it wouldn't surprise me. But it could also be a way to make the costs more cost effective also. If it becomes cheaper on the lower end and more expensive on the higher end, then they are really just trying to be cost effective against competition.
Again, I am not saying it will work out that way, I am just saying we are assuming that it will raise prices (beyond inflation) for customers without any evidence yet.
Hey it's Patrick STH! He always has the coolest and latest "toys" to play with. Nice comparison guys!
Love Love LOVE my MicroCenter in St Louis Park. Excellent sponsorship! Beats the fiasco of Kamikoto knives and Scottish Titles (what a scam those were).
This collab is great! Love it!
here's the cost of 6 Pi's... with 6 2TB nvme sticks, and it's more expensive than a single high-end AMD CPU.... Wow. truly an amazing comparison. Love the humor.
I wish Patrick greeted Jeffrey in third person "This is Patrick"
I just made the connexion between you and the fantastic ansible roles everyone use.. THANKS A LOT FOR THAT !
Loved this video. Will love a follow up on the LTT screw driver even more!
10:39 I spy an absolutely BEAUTIFUL Noctua cooler :):):)
18:09 You should try out Armbian. Their support of older arm boards is phenomenal. My tiny cluster of 4 Orange Pi pc's form ~2015 is still running perfectly with kernel 5.15 thanks to Armbian.
seconded, armbian is pretty great
This seems like a kinda cheeky way of telling commercial/industrial customers "sooo how about not buying up all the Raspberry Pis, you can do better per watt and per dollar with larger scale solutions!" hope the Pis can come back in stock soon
Most of the industrial/commercial usage is just using a single Pis though, where the performance isn't always as critical. But there are use cases where people still use Pis where they'd probably be better served with something else (especially with above-MSRP pricing).
I love the collab with STH! Keep up the great content! I have been running my own "server" (TS3) since the early 2010's. Never realized that was homelab-ish territory. Now I run a bunch of servers off of RasPi's, Local PC's, and a NAS. Totally Cosplaying as a SysAdmin. Want to do more in the future and you are helping me do that!
can you imagine a raspberry pi with that monster 128 core arm processor in it?🤣
Remember the Ampere has 128 PCI lanes. That is capable of dedicating a compute core per lane - quite a barnburner. So you are comparing a state of the art Enterprise datacenter processor to a high end consumer microcontroller with embellishments to appear equivalent.
Not only that, each of those 128 PCIe lanes is Gen 4, whereas the single little lane on the Pi CM4 is Gen 2
@@JeffGeerling - For embedded development that is more than adequate. The PI really is intended for embedded controls with IOT function enhancements and it does it exceptionally well for a game changing price. There really are multiple classes of computing ranging from Super down to bit twiddler. Each class has a finite set of requirements and as such specific circuitry. Any System On A Chip design (Arduino/Pi/Beagle/etc) has a target price/performance and feature set derived from intended market expectation. License free Linux as an embedded foundation really moved things forward dramatically. What you see with the Shields and Hats expansion is horizontal market requirements being met until the market is big enough to justify a custom SOC budget. What is fascinating is how advanced desktop processors have become with no real benefit to the consumer. Yes Photoshop/video editors and gamers will squeeze every bit they can out of the latest IO/Memory and number of cores but for 86% of the market there is very little benefit. In fact many games are single core - so these large multicores sit idle whale the main core is overclocked as best as possible. So its an interesting moment in time in that regard.
I was just playing with VirtualBox, Docker et al - really these uber core processors with massive PCI lanes and deep memory (cache and onboard) systems are "purpose built" for datacenter virtualization and GPU/AI farms. I had to load specific programs to exploit the multiprocessor array. What is quite interesting is how quickly even a lowly six or eight core can be data starved. You must use a RAID array it seems to "feed the beast". Not surprising but interesting to watch the perf meters cope with Page Faults etc. I'm guessing the proves the old adage "Clocks are better than Cores" for most home/game users since more cores means slower clocks due to power and really most software is single threaded. As such I would home the Cortex folks stay focused on maximum speed (with power levels ) and low temps since cooling a PI is a bit limited due to its size and IOT use cases.
RE: first bit about 24 RPi cores vs 24 x86_64 cores. A, say, 1GHz ARM and 1GHz x86 are VERY different. ARM will always win on the power consumption front, but even if using a reduced instruction set(IIRC) the x86 will walk all over an ARM twice before it even realizes what happened, and a few more times before it hits the ground. Yes, application matters. Programming matters. Auxiliary processing load matters. But straight clock for clock ARM and x86 are not comparable, its x86 on top all day long. You cannot replace a x86 desktop with an ARM and expect the same performance. But that was never what they were supposed to do, its not their design case. Remember, the right tool for the right application ;)
Woah, I'm so interested to see the results!
Nobody plans raspberry pi projects anymore
I love the labels on your fan drawers.
Great job with this video.
A lot of information packed in here to work with.
I was in the market for an ARM VPS but couldn't find any good ones. Honestly I am so ready for ARM to just take over the server space more and more - its super efficient, less cluttered than x86 and has some great nicities. Unfortunately, software support is still a little hit or miss - especially when talking about Phones and Tablets where SystemReady isn't implemented properly - be it on purpose or not. Honestly I'd love to play around with one of those! These ARM servers are awesome as heck! ^_^
Try Oracle. They give 4 core ARM Amperes for free.
AWS EC2 m6g, uses AWS graviton.
I'm using Graviton, as Arm 64 makes sense to match my M1 Max laptop. However, AMD Milan is way more efficient than any Arm server chip up to this point, you don't get much in terms of efficiency if you are on AMD, right now.
@@GustavoNoronha Epyc is crazy, it's amazing how they just leapfrogged everyone else.
@IngwiePhoenix Did you not pay attention? Literally said in the video 16:28 that ARM isn't inherently more efficient than x86. In fact, the lack of libraries and application support can make it LESS efficient. What apple did with the M1 came down to building an ARM chip made specifically for OS X, down to the point where it theoretically should be good for gaming, but isn't since apple doesn't put as much thought or support behind it. Also, apple decided efficiency at all costs, to the point where the damn thing throttles on certain tasks to keep the battery life well and the cpu cool.
What an awesome vid guys! Not only did i learn new stuff, I couldn't be but happy to see you both school us on a badass project. One of the best vids I watched coming from your end. Thank you both!
Two of my favorite channels in one video. This awesome!!
I've been trying to get a review sample of a ARM based server for a while and it's great to see this one here!
Oracle Cloud has some really generous "always free" quotas for VMs on their Ampere machines.
Search for "OCI Ampere A1". 4 vCPUs, 24GB RAM, multiple distros, adequate storage and lots of regions. What's not to like?
In other news. A Chevy Bolt, gets left in the dust by a Tesla Roadster. ;)
Two guys that I don't watch at 2X speed. Great pairing, great content!!
Fantastic video Jeff, hope to see you guys collab again!
By Grabthar's Hammer...Cool Content!
I like those collaborations, it gives more insights and different views on the topics we love.
Have you been served?...in the home?
I'm glad Microcenter isn't near me. I couldn't afford that.
What. CM4 modules cost now 165$. This is insane.
Great video Jeff.
Also, I am bit on the edge about getting DeskPi Super6C. It only has 2x1Gbit uplinks, and even utilising two of them is tricky due to the type of switch chip used. If it would had 10Gbps, or maybe even 2.5Gbps, it would be an interesting option. Also lack of some BMC to access serial console and power state of CMs is not great. They could have added a small stm32 micro with a 100Mbps ethernet to just do some telnet to interact with few things on board and serial ports, and maybe small http server to view some minimal metrics, it would be useful. And where is RTC battery. I can live without it probably for cluster setup where I would be using NTP, but come on.
I think the Turing Pi 2 is probably the more flexible option, and hopefully their production run will get underway soon (they just said they're tooling the line for a first 1,000 unit run).
Maker center does that bring me back reminds me of my youth going to radio shack to pick up components to put a well anything together.
What really concerns me, the realization that red shirt Jeff is not confined to the Geerling basement. We don't need that harbinger of chaos roaming free to spread this madness!
You guys are both great! Fun to see you together.
I loved the transition you made to the STH clip :D
Microcenter is legit. I stopped in for the first time in ages this summer. Not only did they HAVE the 8gb Pi4, it was on sale for $60.
rpi available and on sale, wow
Thank you for the manual captions and timestamps.
Let us hope Red Shirt Jeff does not use an angle grinder for that end clip....
Another great video Jeff!
I was already impressed by your 6-pack Pi. Time for a new T-shirt, "My other computer is a 128 core Ampere"? :)
Brothers in ARM's
One of the best collab intros i have watched so far... :)
What a savings.... LOL love it! Just bought the motherboard and trying to get the CPUs
I've had an order in with DigiKey for a month or so... hopefully they come through!
Loved this reference
superb info and production value. thank you!
Don't forget that I/O bandwidth is next to nothing on the PI and the real server probably has excessive lanes. Don't feel bad though, even desktops have crippled I/O compared to what they should have.
Yeah, like my desktop Ryzen CPU gets crippled by x1 and x4 PCIe 3.0 slots even though the CPU has plentiful PCIe 4.0 available :(
Those linpack benchmark results were super interesting, didn't know m1 max chip was that far ahead. I wonder how long will it take for competitors building arm64 processors to catch up
Comparing different things here. An M1 client CPU to CPUs designed to operate in a DC (e.g. Ampere Altra & Graviton). Data Centre and cloud workloads tend to force the economics for your compute & I/O efficiency per rack of servers and storage. M1 still needs a focus on per core performance because there's way more single threaded stuff that it has to deal with.
An other indicator how much 'node size' matters. A they mentioned in the video: the M1 uses a newer TSMC process.
That's some pretty crazy stuff! I have a couple Raspberry Pi 3s running Stretch. They weren't cutting it for me so I just decided to drop $$$ for an Apple M1 Mac Mini with the 16GB of RAM and base everything else. External SSD is a lot cheaper although slower. The plan is to run it headless with a direct 1GB/s Ether connect to my router which goes to my cable modem. The router gives my house WiFi. It's kinda old, but I'm not sure what to update it with yet.
That's my lazy solution to a local server. It's double plus cool to see that there are still hobbyists out there building custom computers. It's like the 1970s with 2020s tech. Good stuff.
Might be useful if raspberry pis were actually obtainable one of these years
11:30 the only name possible for a box of fans
Atlas might not be the best blas library. There are others which may give significantly better performance, including openblas and the libraries bundled with official arm development compiler suite. You can also usually win a bit more performance by experimenting with the relevant compiler flags.
If the point is /benchmarking/, then you use the same program on the different hardware configurations because you want a comparative sense for which is better. Otherwise you use whatever can perform /best/ on the hardware you have, as you are suggesting.
@@jnharton The linpack test does use the same source code on each system. Blas is a standard library, so does the same thing on every system. Clearly, you need to compile and link the code in the way that gives the best performance for the target hardware.
Great video Jeff 👍👍
I might pick few tips to build my first PI cluster.
I love seeing favorite UA-camrs collaborating together on a video! Now I want to see Linus & Jeff together in a collaboration. Another good one was Linus and Destin from SmarterEveryDay doing a collaboration on the computer from the Saturn V Rocket.
The subtitles are the best. "red shirt jeff acts suspicious" hahah love it!
Besides of being an incredible interesting subject, i love how you pulled a page out of the influencers that contaminate UA-cam and the media with Nvidia GPUs visible just because (LTT, TechSpot and others) with your strategic placement of AMD CPUs.
Here is a like going your way!
I had Ubuntu server 20.04 corrupt itself too. After that, I won't be going back to Ubuntu anytime soon.
This is the collab I never knew I needed, having a more 'dulled' ServeTheHome really hit the mark for me - his normal style burns me out quickly
Yeah, STH normally talks about stuff that has no actual application to "the home' whatsoever, unless your home is a corner of a data center.
This is monstrous. Thank you for the learning, Jeff and Patrick, too! Cheers!
At 0:30 , 3960x 24-core is old technology.
A modern 16-core Ryzen 7950x offers greater performance, for just $550 USD.
Oh so that's what the new STH set looks like! Going to have to see what Red Shirt Jeff can get up to
So I really enjoy the large box labeled "Only Fans" 🤣. Also it's pretty surprising your efficiency went up when overclocking, apparently the opposite usually happens on desktop pc's. Wonder if that means there's more headroom in the silicon?
Naked processor of the day, for only $20/month.😂😂
why doesn't patrick have more questions about how you got into his recording studio?
/s
Jeff is always welcome.
Weirded me out seeing you mention the St. Louis Microcenter... Until last year I lived directly behind the building (Well, and the ravine behind it). I know that is an ad spot... but I miss that place so much.
It's a great computer store, even better than CompUSA which was my previous favorite until they folded!
the coolest thing about this vid is .......how you guys just keep pulling out multi core cpus 😎
I think in Patrick's studio, there are at least 2,000-3,000 CPU cores between all the Intel, AMD, Ampere, and other exotic CPUs laying around (you don't even see most of them behind the set!). That doesn't include the many thousands of GPU cores (CUDA et all) on GPUs on the set!
both of these guys are in their element. I can see their enthusiasm and excitement
Does the Super6c require all 6 compute modules to be installed, or can you have some unpopulated without damaging anything?
I have 5 pi in mine... Works fine. I can't wait to find one more to fill it up. Note that only the first one has extra ports...
^ This
Love the crossover with STH!
Waiting for Patrick to post a bounty for the capture of red shirt Jeff and the return of his server.
Thank you for the great video, Jeff! I would like to inquire, if there are any current alternatives to RPi that are capable of running Xen?
Getting a bit lusty for that Ampere system 😍
i think this is more like comparing apples to a apple tree
You just barge into his studio when he's recording?
This is the way.
Our first MicroSoft compatible PC back in early 80s cost more then $3200. It had a whole 10MB Hard Drive that weighted more than most Desktops do today. Black/Orange tinted 2 color cathode 10 inch monitor and of course your 5 1/4" soft floppy drive and later we got the 3 1/2" hard floppy drive as well. We were COOL! Well my Brother in Law had the 8-inch floppy drive as he worked for JPL at the time and wanted to take work home. My other Brother in Law went the Apple route and later MAC and had LASER disc player, where the laser disks which came in a cool cover for movies and disks were double sided 12". Fun to think back to those days, everything was new, few standards and future looked limitless.
Jeffy G?
Apparently I'm Jeffy G and Jeff from Craft Computing is Crafty Jeff XD
That means you’re ….not crafty. 😗
One area where the Pi board wins is because you essentially have 6 discrete systems linked together you essentially have built in failure redundancy. So instead of dedicating all 6 to active server functions you could have monitoring set up so if there is a crash or some other failure one of the nodes that is held back is switched over to with the config of the node that failed. Or instead of them being clustered at all just run as a bunch of individual server each handling their own tasks.
In an educational example each person learning would have their own dedicated 4 core machine attached to the network to learn with rather it be compiling and testing code or whatever else. No monkeying around with load balancing, VM license costs/issues, everybody gets their own dedicated box with only their account. Very much an example of giving a student enough rope to hang themselves with.
you could also get dual xeon for 50$ and have 20 core beating those shitty rpi
Nice benchmark comp Jeff! Rasp Pi's have become like gold now - amazing. That ARM system is a beast. He who dies with the most teraflops, wins!😂😂
11:30 - seems jeff is into only fans :D
🤣 ikr