Thanks for that-this video will end up being a bit of a swan song for 2022, sadly... I have to get surgery, and though overall I'm feeling a bit better than summer, I've had complications enough that I have to get a pretty major surgery in a week that'll knock me out until next year :( But hopefully after I recover, I'll be a lot better off! Maybe I'll be able to feel 100% again, it's been a while since I was feeling my best.
@@JeffGeerling Really hope you feel better soon and that the surgery helps. You have done amazing work, and we all appreciate what you do. In fact, you inspired me to setup a Raspberry Pi Compute Module 4 and I/O Board with native-boot NVMe, which is what I am writing this message to you on right now. :) Thank you for all that you do Jeff, you have made the world a better place and are an inspiration to all!
@@JeffGeerling 🤞🏻that the surgery goes well, hopefully even better than expected 🤞🏻Wishing you can feel 100% again (it's been over 30 years since I had a day without pain so I don't really remember how 100% feels)
@3V0 person here, who types words that people read when in front of their face. I'm an atheism denier. I don't believe that people don't believe in skyman. You can't prove you exist, so I win. Wish maker-of-video man all the good things and speedy recovery. I like how you speak words out loud and I hear them. Subscribed.
When I saw this thumbnail I literally went to "The Collab nobody knew they needed" only to find it was the first line of the description. Great minds and all that... Good stuff y'all!
Love Love LOVE my MicroCenter in St Louis Park. Excellent sponsorship! Beats the fiasco of Kamikoto knives and Scottish Titles (what a scam those were).
I seriously love ARM so much, so this got me really excited!! Great video :D I've waited years and years for someone to fully push out ARM to the mainstream desktop for "regular" consumer usage, and while the Pi's + others are capable, nothing was ever the same as your usual x86-64 for typical tasks / light gaming. Well, when Apple announced their M series of chips, I got excited and purchased one right away after reviews! Been happily using my M1 Max as a daily driver, all because I love ARM and really want to support it as much as I can, even if it's coming from Apple, who doesn't truly *need* the money but ended up making a product that I had been looking for for quite some time. I'm just happy that a major company took the plunge, and I'm happily following suit. Maybe someday we'll all be on ARM!
not for much longer. the way arm is going it is killing itself by spitting in its customers face by forcing major companies to use its gpu along with its cpu. after this many companies are looking at risc v. hopefully, risc v takes off as it is open source
For what it's worth, afaik, the big selling point of ARM cpu designs was in power savings not so much raw performance. -- Even if a particular design/SoC performed at a mere fraction(say 50%) of an Intel x86/x86-64 system the former would kill in terms of power savings. // Things have improved a lot and now that even Intel chips are SoC-like...
@@jnharton Performance as well. At the socket level Ampere M128-30 matches or exceeds top bin Epyc Milan for Data Centre workloads whilst burning less energy. Anandtech and STH have published stats.
@@vikingforties I was really talking about the broader history and not so much the current state of affairs. Also, given that x86 development was, for a long time, presumably based on single core, single thread performance and ARM is a relatively new architecture...
@@ServeTheHomeVideo Hope he appears secretly at your channel and still return it in one piece... and hope red shirt jeff does not use his favorite grinders and whatnots
Intro: I love that Pi cluster box (sees price tag) Sees Galaxy Quest: Classy throw back my friend Blue Shirt Jeff whose a spinoff of "Tim the Toolman: PC Edition" when? :Edit: Sees server "Drools" I have no idea what I'd use this for but I want it.
Have been a fan of STH for almost 10 years now... Has always been a great website, and the forum is great as well. The hardware sale section is an amazing place to find deals on server grade hardware that is coming out of production if your looking to setup a good home server cluster.
here's the cost of 6 Pi's... with 6 2TB nvme sticks, and it's more expensive than a single high-end AMD CPU.... Wow. truly an amazing comparison. Love the humor.
What really concerns me, the realization that red shirt Jeff is not confined to the Geerling basement. We don't need that harbinger of chaos roaming free to spread this madness!
What an awesome vid guys! Not only did i learn new stuff, I couldn't be but happy to see you both school us on a badass project. One of the best vids I watched coming from your end. Thank you both!
That's what GFLOPs/W and MIPS/W benchmarks represent on a standard scale that should convert to other loads, provided everyone uses the same benchmarks without cheating. Of cause, additional numbers are needed for idle and near idle power consumption.
This seems like a kinda cheeky way of telling commercial/industrial customers "sooo how about not buying up all the Raspberry Pis, you can do better per watt and per dollar with larger scale solutions!" hope the Pis can come back in stock soon
Most of the industrial/commercial usage is just using a single Pis though, where the performance isn't always as critical. But there are use cases where people still use Pis where they'd probably be better served with something else (especially with above-MSRP pricing).
I love the collab with STH! Keep up the great content! I have been running my own "server" (TS3) since the early 2010's. Never realized that was homelab-ish territory. Now I run a bunch of servers off of RasPi's, Local PC's, and a NAS. Totally Cosplaying as a SysAdmin. Want to do more in the future and you are helping me do that!
What. CM4 modules cost now 165$. This is insane. Great video Jeff. Also, I am bit on the edge about getting DeskPi Super6C. It only has 2x1Gbit uplinks, and even utilising two of them is tricky due to the type of switch chip used. If it would had 10Gbps, or maybe even 2.5Gbps, it would be an interesting option. Also lack of some BMC to access serial console and power state of CMs is not great. They could have added a small stm32 micro with a 100Mbps ethernet to just do some telnet to interact with few things on board and serial ports, and maybe small http server to view some minimal metrics, it would be useful. And where is RTC battery. I can live without it probably for cluster setup where I would be using NTP, but come on.
I think the Turing Pi 2 is probably the more flexible option, and hopefully their production run will get underway soon (they just said they're tooling the line for a first 1,000 unit run).
I was in the market for an ARM VPS but couldn't find any good ones. Honestly I am so ready for ARM to just take over the server space more and more - its super efficient, less cluttered than x86 and has some great nicities. Unfortunately, software support is still a little hit or miss - especially when talking about Phones and Tablets where SystemReady isn't implemented properly - be it on purpose or not. Honestly I'd love to play around with one of those! These ARM servers are awesome as heck! ^_^
I'm using Graviton, as Arm 64 makes sense to match my M1 Max laptop. However, AMD Milan is way more efficient than any Arm server chip up to this point, you don't get much in terms of efficiency if you are on AMD, right now.
@IngwiePhoenix Did you not pay attention? Literally said in the video 16:28 that ARM isn't inherently more efficient than x86. In fact, the lack of libraries and application support can make it LESS efficient. What apple did with the M1 came down to building an ARM chip made specifically for OS X, down to the point where it theoretically should be good for gaming, but isn't since apple doesn't put as much thought or support behind it. Also, apple decided efficiency at all costs, to the point where the damn thing throttles on certain tasks to keep the battery life well and the cpu cool.
Remember the Ampere has 128 PCI lanes. That is capable of dedicating a compute core per lane - quite a barnburner. So you are comparing a state of the art Enterprise datacenter processor to a high end consumer microcontroller with embellishments to appear equivalent.
@@JeffGeerling - For embedded development that is more than adequate. The PI really is intended for embedded controls with IOT function enhancements and it does it exceptionally well for a game changing price. There really are multiple classes of computing ranging from Super down to bit twiddler. Each class has a finite set of requirements and as such specific circuitry. Any System On A Chip design (Arduino/Pi/Beagle/etc) has a target price/performance and feature set derived from intended market expectation. License free Linux as an embedded foundation really moved things forward dramatically. What you see with the Shields and Hats expansion is horizontal market requirements being met until the market is big enough to justify a custom SOC budget. What is fascinating is how advanced desktop processors have become with no real benefit to the consumer. Yes Photoshop/video editors and gamers will squeeze every bit they can out of the latest IO/Memory and number of cores but for 86% of the market there is very little benefit. In fact many games are single core - so these large multicores sit idle whale the main core is overclocked as best as possible. So its an interesting moment in time in that regard.
I was just playing with VirtualBox, Docker et al - really these uber core processors with massive PCI lanes and deep memory (cache and onboard) systems are "purpose built" for datacenter virtualization and GPU/AI farms. I had to load specific programs to exploit the multiprocessor array. What is quite interesting is how quickly even a lowly six or eight core can be data starved. You must use a RAID array it seems to "feed the beast". Not surprising but interesting to watch the perf meters cope with Page Faults etc. I'm guessing the proves the old adage "Clocks are better than Cores" for most home/game users since more cores means slower clocks due to power and really most software is single threaded. As such I would home the Cortex folks stay focused on maximum speed (with power levels ) and low temps since cooling a PI is a bit limited due to its size and IOT use cases.
in case you think of using one of them for virtualization it would be nice to have the performance per core. that is because next year there will be a shift in licencing from cpu to core (read VMware here).
@Greyson thanks for the comment, yes but, if you own a million dollar company you want to stay on the safe side and then you buy support from the vendor (read RedHat or Suse). if you get a problem installing a SW (SAP, Dynamics, VDI) and you have problems to whom are you asking, do you have enough people in IT to go through the opensource code and find a solution.... Being technology enthusiastic, having an home lab is completely different in managing company/corporate infrastructure, you want reliability and support. if you look around many applications are born as opensource but there is always a "pro" version, for the support.
@@g.s.3389 Just to be picky, you miss stated your example. RedHat and Suse are opensource. Opensource and free are not the same. I get what you mean though. I have 2 sides in my DC. The internal side runs on things like docker, haproxy, a lot of Ubuntu for simplicity. The client side runs on kubernetes (openshift), F5, and RedHat for added support. I have no issues supporting either, but when you are dealing with things in the enterprise, they want to have a company support to be able to contact for some types of things.
@skechergn It depends on the pricing. If the core pricing ends up equaling what the CPU pricing would be at a certain point, it is just targeting the new processor setups. There is a large difference in the amount of vms you can run on 24 cores/512GB ram and 140 cores/2TB ram. Especially when you start looking at containers on VMs on a hypervisor. Containerization is really hammering VM virtualization. I have a pair of IBM power servers (for redundancy) running Openshift. It's running the same workload that use to sit on a 12 system ESXi cluster because of the number of different VMs it needed and the number of servers to make it n+1 for the hardware. Those 2 power servers still have plenty of resources to add a ton of additional containers to it before it would even comes close to high utilization on one node in a failed scenario. I can see why VMware would need to go to the core level overall to not only make more money on the higher end server chips but also allow them to be price competitive on smaller core numbers. If the price per CPU is based around say what will now cost for 40 or 64 more cores, then if you come in needing 24 or 36 cores, then it would be cheaper then the old CPU cost.
@skechergn Your still assuming it will be a higher (then inflation) cost with the new licensing. We can't say it will or won't until we see it put in place across the board. It could be a way to enable charging more across the board and it wouldn't surprise me. But it could also be a way to make the costs more cost effective also. If it becomes cheaper on the lower end and more expensive on the higher end, then they are really just trying to be cost effective against competition. Again, I am not saying it will work out that way, I am just saying we are assuming that it will raise prices (beyond inflation) for customers without any evidence yet.
18:09 You should try out Armbian. Their support of older arm boards is phenomenal. My tiny cluster of 4 Orange Pi pc's form ~2015 is still running perfectly with kernel 5.15 thanks to Armbian.
Whenever I recommend your videos to my friends and IT Systems classmates (often) I'll be sure to introduce you as "Jeffy G" Great video, love it my two favorite tech channels collab 👌
RE: first bit about 24 RPi cores vs 24 x86_64 cores. A, say, 1GHz ARM and 1GHz x86 are VERY different. ARM will always win on the power consumption front, but even if using a reduced instruction set(IIRC) the x86 will walk all over an ARM twice before it even realizes what happened, and a few more times before it hits the ground. Yes, application matters. Programming matters. Auxiliary processing load matters. But straight clock for clock ARM and x86 are not comparable, its x86 on top all day long. You cannot replace a x86 desktop with an ARM and expect the same performance. But that was never what they were supposed to do, its not their design case. Remember, the right tool for the right application ;)
Those linpack benchmark results were super interesting, didn't know m1 max chip was that far ahead. I wonder how long will it take for competitors building arm64 processors to catch up
Comparing different things here. An M1 client CPU to CPUs designed to operate in a DC (e.g. Ampere Altra & Graviton). Data Centre and cloud workloads tend to force the economics for your compute & I/O efficiency per rack of servers and storage. M1 still needs a focus on per core performance because there's way more single threaded stuff that it has to deal with.
So I really enjoy the large box labeled "Only Fans" 🤣. Also it's pretty surprising your efficiency went up when overclocking, apparently the opposite usually happens on desktop pc's. Wonder if that means there's more headroom in the silicon?
There is just something about these videos I can't say how fun they are to watch and easy to listen to in the background! (Its really the small things about these videos....A.K.A Red shirt Jeff additions that don't need to be there but really leave you laughing all the way to the end :) KEEP IT GOING @Jeff Geerling
Don't forget that I/O bandwidth is next to nothing on the PI and the real server probably has excessive lanes. Don't feel bad though, even desktops have crippled I/O compared to what they should have.
I think in Patrick's studio, there are at least 2,000-3,000 CPU cores between all the Intel, AMD, Ampere, and other exotic CPUs laying around (you don't even see most of them behind the set!). That doesn't include the many thousands of GPU cores (CUDA et all) on GPUs on the set!
I love seeing favorite UA-camrs collaborating together on a video! Now I want to see Linus & Jeff together in a collaboration. Another good one was Linus and Destin from SmarterEveryDay doing a collaboration on the computer from the Saturn V Rocket.
Besides of being an incredible interesting subject, i love how you pulled a page out of the influencers that contaminate UA-cam and the media with Nvidia GPUs visible just because (LTT, TechSpot and others) with your strategic placement of AMD CPUs. Here is a like going your way!
Atlas might not be the best blas library. There are others which may give significantly better performance, including openblas and the libraries bundled with official arm development compiler suite. You can also usually win a bit more performance by experimenting with the relevant compiler flags.
If the point is /benchmarking/, then you use the same program on the different hardware configurations because you want a comparative sense for which is better. Otherwise you use whatever can perform /best/ on the hardware you have, as you are suggesting.
@@jnharton The linpack test does use the same source code on each system. Blas is a standard library, so does the same thing on every system. Clearly, you need to compile and link the code in the way that gives the best performance for the target hardware.
What a super-fun collaboration exploring Arm server options! Thank you for stopping by Jeff!
It was so fun to do this video... maybe we can figure out another fun project for next year?
Hope you got back the Server he stole lol at the end we all saw you Jeff. lool 🤣🤣🤣
We need more of those!
Keep doing more, that was fun
@@JeffGeerling You could set up a mastodon instance on a pi cluster. See how it holds up:)
2021 Linus flexes doing videos on million dollar home, 2022 Jeff flexes showing off he ownes multiple Rasberry Pi units.
i make my pies in owen too lol
@@lordjaashin stupid auto correct
he has the last batch of RPIs while they were still made.
But the PI entered the halls of history, it was good while it lasted.
@@monad_tcp I think he is the reason for the shortage. He just uses them once and throws them away after each video lol
They that rare? I traded someone a pin zero w for like a pair of wire strippers and a 32v 20a power supply
Patrick and Jeff. In one video. Talking ARM servers and RPIs. Awesome
Truly excellent crossover episode!
Amazing that he was able to find 6 compute modules let alone regular Raspberry Pis
The secret is to order them in late 2020 😭
It just the RaspberryPi trend since the beginning. I remember the months I needed to get my hands on the first one...
Call this Pi server "unobtainium"
I can still get them rather easily, but at 3-4 times the price. It's insane.
@@JeffGeerling Now you tell us.
It seriously makes my day when you're feeling good enough to make a video and post it. Glad to see you upload again Jeff.
Thanks for that-this video will end up being a bit of a swan song for 2022, sadly... I have to get surgery, and though overall I'm feeling a bit better than summer, I've had complications enough that I have to get a pretty major surgery in a week that'll knock me out until next year :(
But hopefully after I recover, I'll be a lot better off! Maybe I'll be able to feel 100% again, it's been a while since I was feeling my best.
@@JeffGeerling Really hope you feel better soon and that the surgery helps.
You have done amazing work, and we all appreciate what you do.
In fact, you inspired me to setup a Raspberry Pi Compute Module 4 and I/O Board with native-boot NVMe, which is what I am writing this message to you on right now. :)
Thank you for all that you do Jeff, you have made the world a better place and are an inspiration to all!
@@JeffGeerling 🤞🏻that the surgery goes well, hopefully even better than expected 🤞🏻Wishing you can feel 100% again (it's been over 30 years since I had a day without pain so I don't really remember how 100% feels)
@enrique amaya coming from an atheist, not only does he live you, he loves everyone.
@3V0 person here, who types words that people read when in front of their face. I'm an atheism denier. I don't believe that people don't believe in skyman. You can't prove you exist, so I win. Wish maker-of-video man all the good things and speedy recovery. I like how you speak words out loud and I hear them. Subscribed.
When I saw this thumbnail I literally went to "The Collab nobody knew they needed" only to find it was the first line of the description. Great minds and all that...
Good stuff y'all!
Haha you know it!
That was a great collab. The scripting was fantastic and you guys interacted seamlessly.
Jeff nicking the server at the end is the cherry on the top. Great video guys, I enjoy both of your channels :)
Serve the "large scale, high performance data center" home. Great collab guys.
good to see a colab with you and Patrik :D
Two of my favorite UA-camrs! I'm glad to see what Patrick's studio looks like!
13:40 Love to see JEFF hosting in STH's new studio.....🤩🥰😍😘🥳
I love both channels, looking forward to more colabs!
Wow, I cannot believe how compact the STH studio is, it really stood out when both were in there
Great collaboration from 2 of my favorite tech channels.
Owesome ! Thanks to both.
Hope your getting beter Jef ,
Hey it's Patrick STH! He always has the coolest and latest "toys" to play with. Nice comparison guys!
Love Love LOVE my MicroCenter in St Louis Park. Excellent sponsorship! Beats the fiasco of Kamikoto knives and Scottish Titles (what a scam those were).
I seriously love ARM so much, so this got me really excited!! Great video :D I've waited years and years for someone to fully push out ARM to the mainstream desktop for "regular" consumer usage, and while the Pi's + others are capable, nothing was ever the same as your usual x86-64 for typical tasks / light gaming. Well, when Apple announced their M series of chips, I got excited and purchased one right away after reviews! Been happily using my M1 Max as a daily driver, all because I love ARM and really want to support it as much as I can, even if it's coming from Apple, who doesn't truly *need* the money but ended up making a product that I had been looking for for quite some time.
I'm just happy that a major company took the plunge, and I'm happily following suit. Maybe someday we'll all be on ARM!
not for much longer. the way arm is going it is killing itself by spitting in its customers face by forcing major companies to use its gpu along with its cpu. after this many companies are looking at risc v. hopefully, risc v takes off as it is open source
For what it's worth, afaik, the big selling point of ARM cpu designs was in power savings not so much raw performance. -- Even if a particular design/SoC performed at a mere fraction(say 50%) of an Intel x86/x86-64 system the former would kill in terms of power savings. // Things have improved a lot and now that even Intel chips are SoC-like...
@@jnharton Performance as well. At the socket level Ampere M128-30 matches or exceeds top bin Epyc Milan for Data Centre workloads whilst burning less energy. Anandtech and STH have published stats.
@@vikingforties I was really talking about the broader history and not so much the current state of affairs. Also, given that x86 development was, for a long time, presumably based on single core, single thread performance and ARM is a relatively new architecture...
@@jnharton Ahh. got you. I take your point.
Hey, this is great! Y'all make great crossovers.
This is an amazing with Patrick. Thank you both
I just made the connexion between you and the fantastic ansible roles everyone use.. THANKS A LOT FOR THAT !
This collab is great! Love it!
Loving the content, good Sir. Definitely the best collab of '22!
yes, the collab we never knew we needed. good thing red shirt jeff must be busy somewhere else.
Just don't watch to the end 🫣
@@JeffGeerling i commented before finishing the whole thing... oh no....
@@n0madfernan257 We are still trying to find the Ampere server
@@ServeTheHomeVideo Hope he appears secretly at your channel and still return it in one piece... and hope red shirt jeff does not use his favorite grinders and whatnots
In other news. A Chevy Bolt, gets left in the dust by a Tesla Roadster. ;)
Intro: I love that Pi cluster box (sees price tag)
Sees Galaxy Quest: Classy throw back my friend
Blue Shirt Jeff whose a spinoff of "Tim the Toolman: PC Edition" when?
:Edit: Sees server "Drools" I have no idea what I'd use this for but I want it.
I've been trying to get a review sample of a ARM based server for a while and it's great to see this one here!
One of the best collab intros i have watched so far... :)
I love the labels on your fan drawers.
Have been a fan of STH for almost 10 years now... Has always been a great website, and the forum is great as well. The hardware sale section is an amazing place to find deals on server grade hardware that is coming out of production if your looking to setup a good home server cluster.
Loved this video. Will love a follow up on the LTT screw driver even more!
here's the cost of 6 Pi's... with 6 2TB nvme sticks, and it's more expensive than a single high-end AMD CPU.... Wow. truly an amazing comparison. Love the humor.
Two of my favorite channels in one video. This awesome!!
What really concerns me, the realization that red shirt Jeff is not confined to the Geerling basement. We don't need that harbinger of chaos roaming free to spread this madness!
x86 servers also have a mechanism for attesting the boot process that simply doesn't work right now with an arm server.
You mean the lockdown to Microsoft signed boot images?
The subtitles are the best. "red shirt jeff acts suspicious" hahah love it!
Woah, I'm so interested to see the results!
What an awesome vid guys! Not only did i learn new stuff, I couldn't be but happy to see you both school us on a badass project. One of the best vids I watched coming from your end. Thank you both!
To help with airfare.
I am now free to move about the cabin! Thanks :)
superb info and production value. thank you!
We should compare Wh for fixed unit of work. E.g. the same compilation/render and just look at the power consumed to do the work.
That's what GFLOPs/W and MIPS/W benchmarks represent on a standard scale that should convert to other loads, provided everyone uses the same benchmarks without cheating. Of cause, additional numbers are needed for idle and near idle power consumption.
This seems like a kinda cheeky way of telling commercial/industrial customers "sooo how about not buying up all the Raspberry Pis, you can do better per watt and per dollar with larger scale solutions!" hope the Pis can come back in stock soon
Most of the industrial/commercial usage is just using a single Pis though, where the performance isn't always as critical. But there are use cases where people still use Pis where they'd probably be better served with something else (especially with above-MSRP pricing).
I love the collab with STH! Keep up the great content! I have been running my own "server" (TS3) since the early 2010's. Never realized that was homelab-ish territory. Now I run a bunch of servers off of RasPi's, Local PC's, and a NAS. Totally Cosplaying as a SysAdmin. Want to do more in the future and you are helping me do that!
can you imagine a raspberry pi with that monster 128 core arm processor in it?🤣
10:39 I spy an absolutely BEAUTIFUL Noctua cooler :):):)
Two guys that I don't watch at 2X speed. Great pairing, great content!!
I loved the transition you made to the STH clip :D
I wish Patrick greeted Jeffrey in third person "This is Patrick"
Fantastic video Jeff, hope to see you guys collab again!
Microcenter is legit. I stopped in for the first time in ages this summer. Not only did they HAVE the 8gb Pi4, it was on sale for $60.
rpi available and on sale, wow
You guys are both great! Fun to see you together.
By Grabthar's Hammer...Cool Content!
This is monstrous. Thank you for the learning, Jeff and Patrick, too! Cheers!
Have you been served?...in the home?
Another great video Jeff!
I was already impressed by your 6-pack Pi. Time for a new T-shirt, "My other computer is a 128 core Ampere"? :)
What. CM4 modules cost now 165$. This is insane.
Great video Jeff.
Also, I am bit on the edge about getting DeskPi Super6C. It only has 2x1Gbit uplinks, and even utilising two of them is tricky due to the type of switch chip used. If it would had 10Gbps, or maybe even 2.5Gbps, it would be an interesting option. Also lack of some BMC to access serial console and power state of CMs is not great. They could have added a small stm32 micro with a 100Mbps ethernet to just do some telnet to interact with few things on board and serial ports, and maybe small http server to view some minimal metrics, it would be useful. And where is RTC battery. I can live without it probably for cluster setup where I would be using NTP, but come on.
I think the Turing Pi 2 is probably the more flexible option, and hopefully their production run will get underway soon (they just said they're tooling the line for a first 1,000 unit run).
Great job with this video.
A lot of information packed in here to work with.
I was in the market for an ARM VPS but couldn't find any good ones. Honestly I am so ready for ARM to just take over the server space more and more - its super efficient, less cluttered than x86 and has some great nicities. Unfortunately, software support is still a little hit or miss - especially when talking about Phones and Tablets where SystemReady isn't implemented properly - be it on purpose or not. Honestly I'd love to play around with one of those! These ARM servers are awesome as heck! ^_^
Try Oracle. They give 4 core ARM Amperes for free.
AWS EC2 m6g, uses AWS graviton.
I'm using Graviton, as Arm 64 makes sense to match my M1 Max laptop. However, AMD Milan is way more efficient than any Arm server chip up to this point, you don't get much in terms of efficiency if you are on AMD, right now.
@@GustavoNoronha Epyc is crazy, it's amazing how they just leapfrogged everyone else.
@IngwiePhoenix Did you not pay attention? Literally said in the video 16:28 that ARM isn't inherently more efficient than x86. In fact, the lack of libraries and application support can make it LESS efficient. What apple did with the M1 came down to building an ARM chip made specifically for OS X, down to the point where it theoretically should be good for gaming, but isn't since apple doesn't put as much thought or support behind it. Also, apple decided efficiency at all costs, to the point where the damn thing throttles on certain tasks to keep the battery life well and the cpu cool.
Remember the Ampere has 128 PCI lanes. That is capable of dedicating a compute core per lane - quite a barnburner. So you are comparing a state of the art Enterprise datacenter processor to a high end consumer microcontroller with embellishments to appear equivalent.
Not only that, each of those 128 PCIe lanes is Gen 4, whereas the single little lane on the Pi CM4 is Gen 2
@@JeffGeerling - For embedded development that is more than adequate. The PI really is intended for embedded controls with IOT function enhancements and it does it exceptionally well for a game changing price. There really are multiple classes of computing ranging from Super down to bit twiddler. Each class has a finite set of requirements and as such specific circuitry. Any System On A Chip design (Arduino/Pi/Beagle/etc) has a target price/performance and feature set derived from intended market expectation. License free Linux as an embedded foundation really moved things forward dramatically. What you see with the Shields and Hats expansion is horizontal market requirements being met until the market is big enough to justify a custom SOC budget. What is fascinating is how advanced desktop processors have become with no real benefit to the consumer. Yes Photoshop/video editors and gamers will squeeze every bit they can out of the latest IO/Memory and number of cores but for 86% of the market there is very little benefit. In fact many games are single core - so these large multicores sit idle whale the main core is overclocked as best as possible. So its an interesting moment in time in that regard.
I was just playing with VirtualBox, Docker et al - really these uber core processors with massive PCI lanes and deep memory (cache and onboard) systems are "purpose built" for datacenter virtualization and GPU/AI farms. I had to load specific programs to exploit the multiprocessor array. What is quite interesting is how quickly even a lowly six or eight core can be data starved. You must use a RAID array it seems to "feed the beast". Not surprising but interesting to watch the perf meters cope with Page Faults etc. I'm guessing the proves the old adage "Clocks are better than Cores" for most home/game users since more cores means slower clocks due to power and really most software is single threaded. As such I would home the Cortex folks stay focused on maximum speed (with power levels ) and low temps since cooling a PI is a bit limited due to its size and IOT use cases.
in case you think of using one of them for virtualization it would be nice to have the performance per core. that is because next year there will be a shift in licencing from cpu to core (read VMware here).
@Greyson Sounds like a reason to use qemu.
@Greyson thanks for the comment, yes but, if you own a million dollar company you want to stay on the safe side and then you buy support from the vendor (read RedHat or Suse). if you get a problem installing a SW (SAP, Dynamics, VDI) and you have problems to whom are you asking, do you have enough people in IT to go through the opensource code and find a solution....
Being technology enthusiastic, having an home lab is completely different in managing company/corporate infrastructure, you want reliability and support. if you look around many applications are born as opensource but there is always a "pro" version, for the support.
@@g.s.3389 Just to be picky, you miss stated your example. RedHat and Suse are opensource. Opensource and free are not the same. I get what you mean though. I have 2 sides in my DC. The internal side runs on things like docker, haproxy, a lot of Ubuntu for simplicity. The client side runs on kubernetes (openshift), F5, and RedHat for added support. I have no issues supporting either, but when you are dealing with things in the enterprise, they want to have a company support to be able to contact for some types of things.
@skechergn It depends on the pricing. If the core pricing ends up equaling what the CPU pricing would be at a certain point, it is just targeting the new processor setups. There is a large difference in the amount of vms you can run on 24 cores/512GB ram and 140 cores/2TB ram.
Especially when you start looking at containers on VMs on a hypervisor. Containerization is really hammering VM virtualization. I have a pair of IBM power servers (for redundancy) running Openshift. It's running the same workload that use to sit on a 12 system ESXi cluster because of the number of different VMs it needed and the number of servers to make it n+1 for the hardware. Those 2 power servers still have plenty of resources to add a ton of additional containers to it before it would even comes close to high utilization on one node in a failed scenario.
I can see why VMware would need to go to the core level overall to not only make more money on the higher end server chips but also allow them to be price competitive on smaller core numbers. If the price per CPU is based around say what will now cost for 40 or 64 more cores, then if you come in needing 24 or 36 cores, then it would be cheaper then the old CPU cost.
@skechergn Your still assuming it will be a higher (then inflation) cost with the new licensing. We can't say it will or won't until we see it put in place across the board. It could be a way to enable charging more across the board and it wouldn't surprise me. But it could also be a way to make the costs more cost effective also. If it becomes cheaper on the lower end and more expensive on the higher end, then they are really just trying to be cost effective against competition.
Again, I am not saying it will work out that way, I am just saying we are assuming that it will raise prices (beyond inflation) for customers without any evidence yet.
Great video Jeff 👍👍
I might pick few tips to build my first PI cluster.
18:09 You should try out Armbian. Their support of older arm boards is phenomenal. My tiny cluster of 4 Orange Pi pc's form ~2015 is still running perfectly with kernel 5.15 thanks to Armbian.
seconded, armbian is pretty great
I like those collaborations, it gives more insights and different views on the topics we love.
Whenever I recommend your videos to my friends and IT Systems classmates (often) I'll be sure to introduce you as "Jeffy G"
Great video, love it my two favorite tech channels collab 👌
Ha! I have nicknames for folks, JeffyG, Crafty Jeff, and so forth.
@@ServeTheHomeVideo Crafty Jeff must be Red Shirt Jeff's nickname... always scheming and plotting...
Lol
@@the-perfidious "Crafty Jeff" is Jeff from Craft Computing. I informed Crafty Jeff of his nickname at lunch this summer when I was in Oregon.
@@ServeTheHomeVideo Decided to check Crafty Jeff out, was definitely the correct decision! My IT-tuber subscription list grows ever larger...
RE: first bit about 24 RPi cores vs 24 x86_64 cores. A, say, 1GHz ARM and 1GHz x86 are VERY different. ARM will always win on the power consumption front, but even if using a reduced instruction set(IIRC) the x86 will walk all over an ARM twice before it even realizes what happened, and a few more times before it hits the ground. Yes, application matters. Programming matters. Auxiliary processing load matters. But straight clock for clock ARM and x86 are not comparable, its x86 on top all day long. You cannot replace a x86 desktop with an ARM and expect the same performance. But that was never what they were supposed to do, its not their design case. Remember, the right tool for the right application ;)
Oracle Cloud has some really generous "always free" quotas for VMs on their Ampere machines.
Search for "OCI Ampere A1". 4 vCPUs, 24GB RAM, multiple distros, adequate storage and lots of regions. What's not to like?
That was a great collab!
Brothers in ARM's
Awesome! Thanks man!
Those linpack benchmark results were super interesting, didn't know m1 max chip was that far ahead. I wonder how long will it take for competitors building arm64 processors to catch up
Comparing different things here. An M1 client CPU to CPUs designed to operate in a DC (e.g. Ampere Altra & Graviton). Data Centre and cloud workloads tend to force the economics for your compute & I/O efficiency per rack of servers and storage. M1 still needs a focus on per core performance because there's way more single threaded stuff that it has to deal with.
An other indicator how much 'node size' matters. A they mentioned in the video: the M1 uses a newer TSMC process.
Nobody plans raspberry pi projects anymore
So I really enjoy the large box labeled "Only Fans" 🤣. Also it's pretty surprising your efficiency went up when overclocking, apparently the opposite usually happens on desktop pc's. Wonder if that means there's more headroom in the silicon?
Naked processor of the day, for only $20/month.😂😂
There is just something about these videos I can't say how fun they are to watch and easy to listen to in the background! (Its really the small things about these videos....A.K.A Red shirt Jeff additions that don't need to be there but really leave you laughing all the way to the end :) KEEP IT GOING @Jeff Geerling
Thank you for the manual captions and timestamps.
Don't forget that I/O bandwidth is next to nothing on the PI and the real server probably has excessive lanes. Don't feel bad though, even desktops have crippled I/O compared to what they should have.
Yeah, like my desktop Ryzen CPU gets crippled by x1 and x4 PCIe 3.0 slots even though the CPU has plentiful PCIe 4.0 available :(
Yay! Both of my favorite channels!
why doesn't patrick have more questions about how you got into his recording studio?
/s
Jeff is always welcome.
I'm glad Microcenter isn't near me. I couldn't afford that.
At 0:30 , 3960x 24-core is old technology.
A modern 16-core Ryzen 7950x offers greater performance, for just $550 USD.
Maker center does that bring me back reminds me of my youth going to radio shack to pick up components to put a well anything together.
Might be useful if raspberry pis were actually obtainable one of these years
Love the lead in to microcenter - lol!
the coolest thing about this vid is .......how you guys just keep pulling out multi core cpus 😎
I think in Patrick's studio, there are at least 2,000-3,000 CPU cores between all the Intel, AMD, Ampere, and other exotic CPUs laying around (you don't even see most of them behind the set!). That doesn't include the many thousands of GPU cores (CUDA et all) on GPUs on the set!
At the end of the segment, you got to watch out for that red shirt Jeff... 🤣 Great video! Stay safe out there!
I love seeing favorite UA-camrs collaborating together on a video! Now I want to see Linus & Jeff together in a collaboration. Another good one was Linus and Destin from SmarterEveryDay doing a collaboration on the computer from the Saturn V Rocket.
both of these guys are in their element. I can see their enthusiasm and excitement
This is the collab I never knew I needed, having a more 'dulled' ServeTheHome really hit the mark for me - his normal style burns me out quickly
Yeah, STH normally talks about stuff that has no actual application to "the home' whatsoever, unless your home is a corner of a data center.
That's really cool ! bro, have a nice day!
Besides of being an incredible interesting subject, i love how you pulled a page out of the influencers that contaminate UA-cam and the media with Nvidia GPUs visible just because (LTT, TechSpot and others) with your strategic placement of AMD CPUs.
Here is a like going your way!
In other news, a pinto was demolished by a monster truck....
Great video and I love the direction that ARM is going!!
Does the Super6c require all 6 compute modules to be installed, or can you have some unpopulated without damaging anything?
I have 5 pi in mine... Works fine. I can't wait to find one more to fill it up. Note that only the first one has extra ports...
^ This
YEAHHHH!!! THIS IS AWESOME !!!!
Let us hope Red Shirt Jeff does not use an angle grinder for that end clip....
Nice benchmark comp Jeff! Rasp Pi's have become like gold now - amazing. That ARM system is a beast. He who dies with the most teraflops, wins!😂😂
What a savings.... LOL love it! Just bought the motherboard and trying to get the CPUs
I've had an order in with DigiKey for a month or so... hopefully they come through!
Loved this reference
Oh so that's what the new STH set looks like! Going to have to see what Red Shirt Jeff can get up to
Getting a bit lusty for that Ampere system 😍
I miss Micro Center :( such a awesome place! Great Video :)
Atlas might not be the best blas library. There are others which may give significantly better performance, including openblas and the libraries bundled with official arm development compiler suite. You can also usually win a bit more performance by experimenting with the relevant compiler flags.
If the point is /benchmarking/, then you use the same program on the different hardware configurations because you want a comparative sense for which is better. Otherwise you use whatever can perform /best/ on the hardware you have, as you are suggesting.
@@jnharton The linpack test does use the same source code on each system. Blas is a standard library, so does the same thing on every system. Clearly, you need to compile and link the code in the way that gives the best performance for the target hardware.