The $1,000,000 Unboxing - Petabyte of Flash Part 1
Вставка
- Опубліковано 30 тра 2024
- Thanks to Kioxia for sponsoring this video! Check out the CD6 NVME SSD at lmg.gg/rkDFz
$1,000,000 is how much this entire system costs, not including a YEAR of work hours from different companies to make this happen! Kioxia, AMD, NVIDIA, Supermicro, and WEKA combined their efforts, and they have blown our minds.
Discuss on the forum: linustechtips.com/topic/14211...
Check out the Kioxia CD6 Drives: lmg.gg/rkDFz
Check out AMD Epyc 32 Core Processors: lmg.gg/5vQAv
Check out AMD Epyc 64 Processors: lmg.gg/pN6lh
Check out the Supermicro Storage 1124US-TNRP: lmg.gg/6Qqcu
Check out the Supermicro GPU 4124GO-NART: lmg.gg/bgJiM
Check out Samsung DDR4 ECC Memory: lmg.gg/GAN0z
Check out the NVIDIA MSN3700-VS2F Switch: lmg.gg/0SKZE
Check out the NVIDIA ConnectX-6 200GbE Cards: lmg.gg/rfSEo
Buy some Infinite Cables Fibre Cables: lmg.gg/HGrgD
Buy some Infinite Cables Custom Cables: lmg.gg/K4JK8
Buy some FS.com 100GbE Transceivers: bit.ly/3IX9qpr
Purchases made through some store links may provide some compensation to Linus Media Group.
► GET MERCH: lttstore.com
► AFFILIATES, SPONSORS & REFERRALS: lmg.gg/sponsors
► PODCAST GEAR: lmg.gg/podcastgear
► SUPPORT US ON FLOATPLANE: www.floatplane.com/
FOLLOW US ELSEWHERE
---------------------------------------------------
Twitter: / linustech
Facebook: / linustech
Instagram: / linustech
TikTok: / linustech
Twitch: / linustech
MUSIC CREDIT
---------------------------------------------------
Intro: Laszlo - Supernova
Video Link: • [Electro] - Laszlo - S...
iTunes Download Link: itunes.apple.com/us/album/sup...
Artist Link: / laszlomusic
Outro: Approaching Nirvana - Sugar High
Video Link: • Sugar High - Approachi...
Listen on Spotify: spoti.fi/UxWkUw
Artist Link: / approachingnirvana
Intro animation by MBarek Abdelwassaa / mbarek_abdel
Monitor And Keyboard by vadimmihalkevich / CC BY 4.0 geni.us/PgGWp
Mechanical RGB Keyboard by BigBrotherECE / CC BY 4.0 geni.us/mj6pHk4
Mouse Gamer free Model By Oscar Creativo / CC BY 4.0 geni.us/Ps3XfE
CHAPTERS
---------------------------------------------------
0:00 - It's all true
1:12 - The most expensive unboxing stars!
1:42 - NVIDIA's special surprise
3:10 - Chunktastic unboxing
3:30 - Background information
4:25 - Exploring the head unit
6:40 - Processor and memory surprise
8:00 - Airflow overview
8:33 - Now that's a fan!
9:04 - It's heavy!
9:40 - Yep, that's DENSE!
10:07 - Why there are so many storage racks
10:35 - Storage rack unit overview
12:59 - More boxes
13:30 - Thanks Micron
13:53 - Yep, 200 Gb/s cables
14:15 - Now that's a SWITCH!
15:00 - Kioxia's CD6 drive information
17:01 - How do we power this?
18:00 - Linus is very excited
19:09 - Outro - Наука та технологія
![[柴犬ASMR]曼玉Manyu&小白Bai 毛发护理Spa asmr](http://i.ytimg.com/vi/0TsXQ7z2Dh4/mqdefault.jpg)
I love that kioxia said challenge accepted. They weren't " that's not we were thinking" or "here's a script for this." But that's an interesting engineering project.
I can imagine Kioxia enjoying blowing LTT minds with what is normal to themselves.
Why is human technology so depressing? Especially Gpus producing heat like an air fryer.
The thing is... everyone who heard about this was just like "sure, this seems like fun!" and partnered with the project. thats so cool!
Kioxia had a a mishap a month or two ago and lost 600,000 exabytes of flash. I guess they are pretty good at catching up. So they lost 600 million times more than what is used here..... they are supplying the planet of flash.
The engineers were like:
"*He wants to do WHAT?!*"
"Not saying we can, but assuming we COULD what would it take? You know for -science- LTT"
Kioxia was like 'That sounds like fun, let's make this happen!'
For reference, each of those CD6 drive costs $3100.
How many were there? (sorry I don't remember them saying it in the video)
I think they had 12 per server and said they gonna have 6 servers so a total of 72… so… 220000$ of drives
He discussed on WAN show that all this hardware is a loan, not a gift. After the project is done they have to give it all back.
@@danieljensen2626 why would they start talking about setting it up to their systems? Can you send a link of the ep of the wan show where they talk about it?
@@Jack-rq7ll because to test a machine like this you have to hook it up to a network to even test the speed/reliability of the unit
The excitement is infectious! The fact that they just unboxed this at a pokey part of their warehouse giggling like kids on Christmas morning was really fun to watch. This is going to be a great series!
It is funny how Linus didn't know what part was the server.
Linus 2022 "we may never see performance like this again in our lifetime"
Linus 2040 "Today we are reviewing the Samsung Universe XXII with 50 petabytes of quantum memory onboard"
ikr. It's like they haven't learned at all how fast this shit improves.
2040 continued... Why not, everyone needs a starter system...
"Building a data center is the most expensive part about building a data center"
- LS 2022
Never in my life have my ears been blessed with such wisdom.
been looking for a invisible character, would you be willing to give me yours?
edit: actually visiting your page i can see it, im looking for one thats invisible when viewing the channel and have tried dozens of invisible characters but none have worked so far.
we'll just use the welder and the mill plugs for this, we got it with extension cables. sounds about right.
What did he mean with that?
@@william41017 Linus meant that the cost of the servers in a DC is less of a factor than the cost of the actual building and infrastructure.
@@jkmicha thanks
Every time Linus moves a part I sweat bullets lol
We were nervous too
@@LinusTechTips i guess so I'm nervous and Frikin Excited
Bread
@@LinusTechTips You should have been
Same here. I want to add that college did not equip me to understand much, if any, of what is being said. But I like the excitement.
9:48 "Building a data center, is the most expensive thing about building a data center"
This is so fucking cool. You have to realise it's only because Linus and co have been so diligent about building their legitimacy, brand, reputation, and connections for YEARS that we got to this point. It's only because the industry trusts him so much that we got to see such amazing tech like this.
Also that he did some pretty poorly done reviews of enterprise
cards a few months back and nvidia didn't like the bad press and wanted to see him do it right.
I'm so excited for the part where he has his editors use it and respond with "yeah its ok"
Taryn, paging Taryn!
"Is this supposed to be better?" 🤣
Lol
"I'm getting some stuttering on video editing"
Linus panics.
Especially Hoffman.
“It’s still laggy and shitty”
Honestly the best part of this is Kioxia playing ball. "Yeah, that would be an interesting engineering challenge." This is the kind of stuff you like to see.
Kioxia really said fuck around and find out
this is the attitude that keeps tech improving further and further… you love to see it
I love when people are genuinely excited about their passion like this, its amazing.
i feel they were not professional and were horsing around throughout the whole video.
@@anthonyhernandez157 who cares lmao
I can already tell that this is going to be my favorite series on this channel.
I can just imagine the folks and nvidia and kioxia covering their faces in fear as linus handles their $1,000,000 worth of hardware in such a care free way lmao.
@DJ idk how strong?
Let's be honest. If they were that worried, they wouldn't have sent it.
Nah they probably wipe their ass with that amount of money lol.
Dont worry , they dont care about them. They would not even feel the loss of one. I acctually used to support a competior version of this. This ladies and gents is called "High availablity cloud". I've actually seen a dataceter made out of those and yes they cost arm and leg (just to look at them).
@@psedog idk man, Linus is known for dropping things. Unless they had a backup plan like Linus pays compensation for dropping I'm guessing.
I love that linus has a “pull out animation” for the screwdriver, every time he takes it out he flips it
And surprisingly he doesn't drop it either
@@zachylimaki2167 Maybe that's the only skill he has. otherwise it's Linux DropTips
Marketing and Practice
When you spend a few million on a screwdriver you damn well cherish it and this just shows in how he prefers to use it himself.
Like the "pull out" animation I had with your mom
As a Datacenter Technician I find it very cute how you are excited so much about such small things :D
18:04 is Linus in a candy store where he was told he could get whatever he wanted.
At LTT we usually see consumer PCs that most enthusiasts can only dream of. This is enterprise level hardware that's so cutting edge and over the top that people who spec servers in data centers dream of this.
As a Systems Admin, I approve..
@@wongperson4909 just wish we could see more supercomputers
I'd love to see Wendell or Patrick make a showing in this series.
@@morosis82 I actually expect one of them, if not both, might appear cause I bet Wendell is as excited as Linus and Jake if not both of them together bout this much power... Just my thoughts
People who spec servers in datacenters stopped caring long ago.
I love how LMG linked everything they used in the description like the viewers would just snag some of it for themselves.
I'm sure some will. And I'm pretty sure taking a 1% cut on even one single 100K item is better than 1% cut on 1000 pcs of 50$ each.
I've no clue how much they get from their affiliate links, plus the links are also just a good way, for people interested, to check out the further specs on items shown.
Corporate IT folks watch LTT too. What Linus showed today could likely replace our entire Itanium data center.
@@BobSentell I had a feeling. Just thought it'd be a chuckle anyways.
I mean some crazy son of a gun may use an epyc processor in a gaming rig, I don't doubt it's possible, even practical.
@@BobSentell as a datacenter tech, I can only say they've hit the nail on the head for things that cannot be discussed.
The modularity of that hardware is wonderful and I hope we get some of that sort of thing in lower-end/DIY servers in the future.
Thank you Kioxia for doing this, I can’t wait for the rest of the series’s, super cool
When Linus and Jake can't actually believe what it is they're looking at, even though they already know what's coming, you know it's going to be something special.
wow fr?
@@inflammatorycommentswithno2407 fr
very easy to recreate at home, affordable as well 👍
yes :/
Yes you could buy this and totally dont break the bank
Rofl
I've been looking for this tutorial for so long, and finally found a simple, well explained one.
He only runs his own servers because he can farm content and he gets the hardware for free.
i love the fact the intro has never changed, always updated but never a complete rework. classic man i love this channel so much & have been following for around 7yrs now. so proud of Linus & all the hardworking folks at LTT making all this possible. shoot past the stars ❤️
"Warranty void if removed" Jake and Linus: Who?
The amount of times Jake hands Linus a piece of hardware then says “don’t drop this” is priceless.
And then Jake proceeds to keep 1 hand on it. 🤣
Wher'd Linus find "Giggles the Clown" at?? I recommend 40cc of Euthasol .......STAT!! {0.o}
😆😂🤣
And then Jake dropped on purpose one PSU.
wysi
and usually that piece is worth more than your hole life
8:33 the "flappers" are to prevent backflow if that unit goes bad and the rotors go to 0 rpm. The internal pressure is so high from the other fans that the air would go the wrong way without those.
Ohhh that makes sense! Thank you :v
When a case has so much air pressure inside, you have to start adding airlocks...
Nice
Ooh it’s like a bomb lol
@@PureRushXevus "gas escape valve went out on my case, gotta stick it in the freezer now"
"Hey guys, this is Austin."
10:01 That's the first thing I think when I watch an LTT video. Clearly.
Alternate title: Two idiots stack heavy things as high as they possibly can on top of unstable boxes for no good reason.
Alex walking into frame:
"Nothing new here, we do this everyday"
I like that short "camouflage appearance" in the middle of the video. :-D
@@michael7738 Wait, Alex appear on the video?!
@@Braiam A wild Alex appeared for a second.
I saw him or his shirt slip around a box before. He had just reached "fuck it". I gotta be over there so I'm gonna be in shot. They can always re-shoot it.
Gotta hand it to Kioxia, they really have some pull in the industry, and they went in this full send.
They did literally invent Flash Memory. XD
@@goodiesohhi oh forreally?
@@goodiesohhi oh didnt know that
They heard Linus's challenge and were like "Alright, bet"
@@hxd9321 kioxia (formerly known as Toshiba Semiconductor) is one of the first company to made and commercialize flash memory.
man i LOVE server / enterprise content. This is next level
this is the coolest thing I've seen, cant wait to see it all together!
"Everyone you can possibly name in the server space" - RIP Intel.
):
doesn't already matter :D everyone has new cool "home stuff" :D
marketing is business ...
I really want to see this running a Minecraft server.
@@IM2awsme lol 1 petabyte minecraft world
@@IM2awsme finally a server that can run modded minecraft worlds that don't crash when more than 2 people are exploring lmao
Linus: "we may never see this again in our lifetime."
Technology: "come see this cell phone in 20 years"
He's underestimating Moore's law xD
@@spicybaguette7706 unless process node density slows down as gate features approach fundamental atomic limits.
@@flinx Dennard scaling seems to have hit a wall, just wait until you see the TDP of next generation server CPUs.
Future: “remember cellphones”
Future: This old IBM PC AT went on evolve into mind blowingly powerful technology. Sadly this little IBM is all that remains and we no longer have the technology to make one even this simple.
8:11 Lol Jake, the Heat Sinks 😄. You guys are Awesome in this one, Love the Energy & Tempo!
Love this so much, this is my third time watching. Can't wait for the rest of the videos; this is going to be fun.
I work at a datacenter, so I'm fairly used to high performance enterprise hardware, but I've never got to work with something this powerful. I'm very excited to see what's next with this project.
This is already outdated if only you could see it
Yeah I get what you are saying, those numbers are a definitely high for a medium enterprise but for larger customers, $1M IT orders are no big deal. I have clients whose cloud monthly bill are close to that number.
BUT I have to say, this is still next level performance that I am certain is an overkill for all but a very specific use cases where u need that kind of fast storage. I honestly can't think what you could possible need that kind of storage for, because basically anything that needs that fast, you load it (& run it in memory - which is still much faster than any NVME), Anything lower and u cache into NVME and then tier the storage like any other sane person based on usage.
@@AmrXcellent Basically Powering the Starships next.
@@AmrXcellent Agree - this is a "because we can and got it for free" project for what they are going to use it for (presumably video editing?)- in the real world of real budgets you would certainly tier it and size the fastest tier to your normal working dataset. I've been an Enterprise IT consultant in storage and backup for 15 years, now also part of the high performance computing team at my employer and I get to play with this stuff every week. Good times! I will say that some of our HPC clients do have this sort of storage in performance and amount for HPC work. Just absolutely enormous datasets, so the time to even load the dataset into RAM becomes a real issue, and many multiple datasets flying in and out of the GPUs for processing. I have to admit, I'm the hardware dude - I don't have that much of a clue about how any of the software they run on these things actually works.
@@kevinrhodes335 They're not keeping it, they have to send it back when they're done. Genuinely the amount of power draw this thing is pulling would probably make it too expensive for them in and of itself lmao.
enterprise storage gear is bonkers, I've deployed some multi-million dollar solutions, but I don't think I've ever had my hands on anything with that much potential performance.
you have, probably took 8x the space of this however
@@justbob333 or more in some cases, but some of the newest stuff I deployed fit into a rack or two, especially the flash solutions
I’ve worked with some 11+ figure projects that would blow your mind, the density is impressive but the speeds are last gen. Can’t wait to see what his power delivery solution will be.
Totally geeking out! Can not wait to see all of this content.
8:34 "They've got flappers!"
Those louvers are there to close of the air path if the fans dies. When the air pressure get higher on the back the louvers will close so air cant leak back to the front through the fans. Pretty slick and low tech which makes them very reliable.
300 watt* fans, 0 watt protections.
*or wattever ;)
The amount of computing power available today is absolutely insane. I work in a big data company and one of our hadoop clusters has 104TB of RAM and over 13000 CPU cores. When I first started working there about 3 years ago, I would sometimes navigate to the resourcemanager just to take another look to make sure my eyes weren't betraying me. I must admit that I have never seen 1PB of flash storage though so this will be a freaking crazy project and I can't wait to see what the result benchmarks are.
How many racks was that, too? Probably not just the half-rack they had there!
@@kaukospots I have no clue as I don't work in the infrastructure side but we have multiple data centers so probably lots of racks!
can you imagine what google or amazon has?!?!!?
@@skmetal7 Google, Amazon, and Microsoft probably have more than we would even think on a high estimate in their cloud datacenters for sure.
What it's for exactly?
another kick ass video about the bleeding edge of server tech. i love it!
18:00 It's a whole lotta fun to see these guys be this excited over such exceptional hardware.
A few moments though where I couldn't not be aware of just how much Linus was breathing directly onto $100,000 of ultra-high-end electronics 7:17 🙊 10:38 😅
I work in the Enterprise space, and I deal with Datacenters with massive SAN's, compute racks, etc....we have 4 DC's ourselves, let alone the 3rd Party DC's we colocate racks into. But the pure insanity of this sort of power, and the configuration with the NVMe-oF to a central GPU accelerated central compute, absolutely blows my mind...and the absolute density of this setup to fit in what...about 10U of space, so a 16RU rack holding everything....insane.
Can we get the Yottabyte Project next?
The engineers who worked on this must either HATE them and their lives right now or squealed like children when they were handed this project. Possibly both. This couldn't have been easy. Probably required some innovation and development to make work.
@@avroarchitect1793 I kinda doubt it. Looks more like they get to test the next gen product lines. None of this looks custom, and it seems to be a future standard configuration.
I still work in DCs. The density nowadays is so insane. 4kva racks are standard, customer trying to push like 6-8 kva per rack at just a colo facility the cooling is having a rough time. this kind of hardware is just so badass and fun.
And at science databases there could be racks after racks full of servers like this one column after column side by side.
Favorite thing about LTT was when we'd get to see some absolutely bonkers over-the-top hardware. Glad that is back.
I’ve been watching since Whole room watercooling.
@@wesrihn I came for the tips, but Whole Room Water Cooling is why I stayed.
It was either that or one of the Compensator builds.
This is the most excited I've ever seen these guys. I was excited by proxy.
I love how giddy they both are the whole time!
God, I barely know any of what you're talking about when it comes to this avenue of techy talk, but it's so satisfying to hear excited people talk about what they love
same
Basically, a small company got hold of the kind of hardware that you would find in a google data center
@@20blog28 did they buy this? Was it offered in exchange for a shouting? Sounds insane but you never know. Is this really a million dollars?
Also do we know what it's for? They have a specific need or is it just because why not? Do they keep it or have to send it back?
Thanks.
@@Andrei5656 Given the specs of what they've shown - Yes - This is easily a million dollars worth of hardware.
@@Andrei5656 They do have to give it back, yeah.
5:30 it's incredible that Linus can flip a screwdriver so nonchalantly, while also being known for dropping thousands worth of equipment
Cause it's his own, when it comes to anything not owned it's a drop
One does not get good at flipping and catching random assorted shit by being careful and not dropping things, they get good by dropping things trying to flip them. He's just an expert at dropping things such that he has gotten to the point that he just drops them intentionally with style back into his own hands. You're merely witnessing a REFINEMENT of pure dropping technique.
Part of his attention is focused on the teleprompter, while handling pieces of hardware, presenting it to the right angle for the camera, making sure A roll and B roll shot are made. In the contrary, flipping his screwdriver is something that requires less attention and something he's used to handle
I swear to god I've never been so nervous watching an LTT video.. you guys are killing me! Setting that thing on two edges of an open cardboard box.. I was actually clenched the whole time.
Great video. I respect the companies involved in this
So... will you start installing petabytes of flash storage in collabs with other UA-camrs now? A friend would like to know.
Try doing it with a raspberry pi ;)
@@erdragh Imagine having all of these servers and equipment and then routing all of that traffic through a Pi.
@@profblack And still, having all running through a Pi and then check the capacity of that array/pool with 1PiB would be crazy impressive for that small board.
As long as that friend isn't one of those people who immediately turn around and go back to an off-the-shelf product because either A. it works very so slightly better with their mac because macs, or B. it looks more aesthetically pleasing on a desktop. ( valid yet vapid reasons )
It would be interesting to know if it would beat HashiCorp's Nomad 2 Million Container Challenge but this time around running Kubernetes. Linus and Jeff please make it happen 🙏
I work in manufacturing and assembly for these machines and watching these two casually take components out and handle them with such "care" is the reason I have work nightmares
Lol
this video must have given you nightmares D:
I am sure they can get a replacement part!
I don't work in manufacturing or assembly for these machines and I was still sweating
14:50 here you go
I'm super curious about what you've got planned for all that GPU compute!
I'm so jealous of someone getting to use this kind of stuff. Where I work we have tons of very expensive servers and network devices, but I don't really get to mess around with it too much. I just fiddle with my server at home on a dell workstation.
As a enterprise IT guy, the MSRP for that server with the A100s is roughly 150-200k USD. I've looked into it before for some projects that we did.
Edit, my vendor tells me each 12TB ssd from Kioxia is about 5k. That's another 360k on top of the servers.
So here in Australia that would easily be AUD$1,000,000 allowing for exchange rate, GST and 'the Australia Tax' which is a random markup put on because of 'distance etc.'.
@@ozgruntsyd4281 'random markup for distance ' yeah it's called shipping costs. If you look at shipping lanes they basically make a path East to West meaning that Europe and North and South America are all along a roughly straight line so it's efficient and cheaper to ship whereas Australia they have to head south from China just for Australia and New Zealand which is a lot less efficient so the shipping costs are higher.
@@pepperroni6252 We usually get charged a higher base price and shipping on top of that. As for inconvenient shipping the ship can be back at Singapore Japan Taiwan or China before it could have made it to the USA or Europe and no pirates to dodge.
@@johnmccallum9106 the base cost is usually to do with manufacturing costs, Europe Asia and America all have their cheap labour countries. There's many more people in Europe, and the American continents than South Asia and Oceania so it's still more economical for them to ship to those places, also ships will return with products from those countries whereas there'll be less to bring back from South Asia and Oceania so another loss. It's all about minimising loss and increasing efficiency.
What would you say in your estimation the engineering cost of the whole thing would have been? Let's say, another million across all partners?
2:17
can’t wait for people to comment 25 years later and say “we have 1tb vram nowdays”
yes
It's 2047 and 1TB of memory is less than my breakfast subscription.
Niktek boi
They did 640gb vram in the video
25yrs later and we no longer have pc's at home. Just VR interfaces and everything is owned by someone else.
Thank you for the tech tip, Linus. I can't wait to install this in my home.
I have never seen them so giddy. They are like kids on Christmas unpacking best-freakin-gift-eeveeeeeeer
The amount of high pitched laughs just shows how excited these gamer bois are about the new servers! Gaming days at work just got alot more real lol
How else is make going to maintain his minecraft server. Clearly this is what hes been working on since he dropped work on the server last year. Coincidence I think not lol. 1mil mc server hahaha
Except for they don't get to keep
Not for gaming....
@@joshse8709 almost as if you didn't read sarcasm. Nobody would use this for gaming it's over kill and stupid.
@@shanebluebutterfly no shit Sherlock when did you become a detective
I remember those days... Retired from IT Infrastructure now. I was the SAN guy at the office and the day the two+ million dollars of equipment and a couple of petabytes of storage (SAN storage racks, controllers, Brocade switches and boxes of fibre to connect it all) came in, well... I remember that feeling. Christmas does come early some times.
He Mark, I just left them a similar message. I was a network admin back in the 90's and early 2000's and was just like they are today. I miss getting switches, routers, storage, wiring, tape backups, learning to work with fiber, even making hundreds of patch cables back when I first started.
I cant even expect this kinda dope video anywhere else other than at LTT
What a gaming sensation I could have with that system. Game On!!
This is exactly why I love seeing enterprise stuff on the channel, and especially the more exotic stuff, cuz you get to see things like this power supply 5:05 and this weirdo connector for all that massive data 5:39 and the insane amounts of RAM with all the drives. I love it and I seriously can't wait for the next video to come out about this, which doesn't happen often for me lol
Yep. That's stuff i can't get my hands on, and i work in a data center...
Imagine a day like 30 years later where this is the equivalent to a portable ssd at that time...
One day in 30 years: _Remember when that phone you're holding took up a full 16U rack & needed more power than a house?_
I mean, probably. 40 years ago the Cray Y-MP was as powerful as it got.
It barely meets the requirements for Vista.
@@SaddisticSpeller And right now, that phone is far more powerful than the Apollo guidance computer. And probably has more sensitive accelerometers.
@@NemoConsequentae Well the guidance computer was built with reliability in mind, taking a phone through the van allen belt would instantly corrupt the contents of it's RAM, whereas the guidance computer went to the moon and back going through the van allen belt twice without crashing
@@talibong9518 the amount of gold insulating it is not comparable.
LTT has finally reached the WTF I don't even know phase... awesome content and a wicked shoutout to your sponsor/partners! This is going to be a blast series of videos to watch!
I have no idea what you are talking about, but i am so damn excited to watch this!
There's enterprise level hardware, and then there's data center level hardware.
There's data center level hardware, then there's your mom's beside drawer level hardware.
@@FlyboyHelosim your mom out there blowing circuit breakers using over 12 kW.
This is like... HPC level hardware. No enterprise or datacenter is running this level of hardware for normal compute... If you're running this in production you've got a seriously niche need.
@@VexingRaven yup. I mean Linus talks about density, but there has to be a limit. It's hard to believe this is worth the money just for the density.
And then there are research clusters/HPC
As a former amazon data center employee I’m super super super excited to see the benchmarks done with this unit. I’ve always only just fixed these types of servers. Replaced those dac cables seen upwards of 400 gbps dac’s and 15.6 terra-byte drives I believe but never ever once got to benchmark or see just how amazing they are.
I am extremely excited for the entire series
i once had a job to set up a server for a highschool, the cable management was a huge pain, so good luck with that
This is the amazing content i support you for.
I sometimes forget how insane some of this stuff is because I deal with it every day. It's always fun to see someone not from the enterprise space see these things and be reminded how cool they are
Yeah it loses a lot of it's appeal when that insane hardware is powering slow as shit VDI workstations.
@@boltinabottle6307 why are they slow?
@@boltinabottle6307 ahhhh a man of culture I see. Best part is when you have to manage those POS VDI's....
@@Abbrahan can confirm; I work for a financial firms enterprise data center, and our virtual workstations are allocated 8 threads of a Xeon Gold 6xxx (I forgot the exact chip), 16gb of memory and around 512gb of storage and even then they are atrociously slow.. when I WFH, I try my best to just remote into my office pc 99% of the time lol
@@RamyWarda A big part of it is network congestion too. I work in NYC and the upper floors of my building with fewer employees do just fine. The 2nd and 3rd floors (which are much larger, with many more users) are slow as hell. Doesn't matter which pool we put them in. Perhaps the 2960x switches are the bottleneck.
(edit: 2960, not 2690)
Mad props to Kioxia... this is by far the coolest tech video I've watched in a long time
I love when Linus is excited because he starts creating new words to describe things
The pure joy on their faces when they opened that box....
They're laughing out of excitement like Sponge Bob and Patrick and honestly, I'm laughing along. These crazy projects and the adventure sense they always have about them are one of the top reasons I love LTT so much.
I need one of these so i can install my whole steam library finally
Damn this is a huge project i can't believe the team pulled this off as a sponsor
I've never been so excited to see someone unbox something before. This is going to be an Epyc series! Thanks Xioxia, Nvidia, and SuperMicro for making this happen!
Kioxia
@@SphinxKingStone must’ve auto corrected or I’m just an idiot, either scenario is likely.
The amount of giggling in this video tells me everything I need to know about just how insane this all is.
Well if an average gaming computer has or had 1 GBit at max speed, which barely ever gets fully utilized, then his server rack had a capacity of 12 800 GBit networking.
- That means it could handle almost 13 thousand gaming computers at once, all at max speed which they ever can utilize.
If you drop this value down to lets say FullHD (1080p) content streaming which is something like 3MBit per computer / client. That'll make it capable of serving approximately 4 MILLION 267 THOUSAND customers at once! (Tho can the rest of that server handle that many clients?)
Almost 4,3 Million computers running FullHD video at once? Is this crazy enough? Just one server can serve almost every citizen in my country at the same time, streaming some 1080p content.
I wanna see you guys have a server room set and keep the enterprise equipment coming
You know what is the hardest. Imagining linus without beard right now.
10:03 this made me laugh harder than it should’ve 😂
that shit got me so hard i swear, tbh i thought about it and when he said it, i just fkin died
The fact that it came outta nowhere really caught me off guard
@@pyromaniacpenguin I also thought about it at the same time he said it haha that was amazing
Same here bro I almost literally rolled on the floor
The little editing subtitles are absolutely hysterical and I appreciate every single one.
Loving all the internal labeling from the manufacturers, part of the reason cheap stuff can suck more is lack of labeling.
I would love a full info guide on how this all works I'm so interested!
I’ve been so excited for this! After hearing about it from the WANShow! This kind of content is always super entertaining, and the dynamic of these two is so fun!
free stuff its always good
you need a life, man..
Oh yeah. This is the kind of content I can get behind.
Also, it's brilliant to have Linus next to all those boxes and crates in the intro. It really makes them look super large.
I handle mostly cloud servers these days but watching this video, made me miss the ol' data centres I use to visit for work.
Daaaammmmmm -!!!! I love when companies accept challenges and complete them-! Now m super pumped for the benchmarks-- --!!!!!!
At this part I'm halfway convinced sponsors provide Linus with hardware, let's say, 50% for the advertisement and 50% because some engineers somewhere are wondering "What's gonna happen if we hook up a week of merchandise together?"
Engineers:
"There is a point where we needed to stop and we have clearly passed it but let's keep going and see what happens"
I hold my breath every time Linus is holding things.
And I love how Jake gets to tell his boss "Don't do that!"
Seriously… watching this hardware being handled this way makes me cringe. Casual box dropping, tossing and torquing chassis, forcing mechanicals, no regard for static. I’d fire Linus if he worked for me
@@nicholasmitchell8184 dam linus sweating bruh u rlly got him
It's actually one of the reasons why I don't watch his videos much anymore. He always handles very expensive hardware extremely carelessly for no reason whatsoever. He clearly isn't even doing it for views or anything, he just does it instinctively. He may take a multi-thousand-dollar heavy piece of hardware and flail it around with one hand like it were a coctail shaker (heck, even cocktail shakers are handled more carefully because they are usually shaken with both hands, not just one). This video is no exception (eg. he does that at 8:55).
And, of course, every time he unboxes some really expensive server hardware, instead of doing it safely on a table in a clean environment, he insists in doing it in some dirty storeroom, on the floor, placing it precariously on some cardboard box. I'm surprised he doesn't do the unboxings on a piece of plywood propped up onto some rickety garden chairs... on the roof during a windstorm.
The Austin joke got me. This tech is beastly!
the storage can accommodate any machine learning data set
looking foward to see how the A100 crunching machine learning
Hearing about how this unboxing came about on WAN Show had me even more excited for this video. Glad to see it finally come to fruition, & I guess you’re really going full tilt with this LMG server overhaul (albeit not with this gear specifically since they’re returning it later).
If you followed on WAN Show you also remember they said they have to return most of it sadly
It's not an overhaul lol theyre not keeping
G u haven't even watched the video, it was released 9 mins ago 😂
I believe they are returning all of it and they are definitely returning most of it
@@poletooke4691 True, but the other server stuff that they’re getting is an overhaul.
I work at a data center for a cloud provider and we've been deploying rows and rows of this hardware. It's been pretty fun to deploy and play with the hardware. You will definitely need to rethink your power and cooling solutions to support this stuff.
When I see stuff like this, I have to wonder about the absolutely insane amount of bandwidth that AWS or Google has in total. It has to be at least exabits per second. I don't even know what's past exa but that might be a reality in terms of flops (maybe?)
@@blackbriarmead1966
Giga Byte
Tera Byte
Peta Byte
Exa Byte
Zetta Byte
Yotta Byte
Yeah, they're pulling power from wherever they can but there was no mention of cooling at all. They better have something special lined up.
i'm woking in a data center as well, i would love to see something see to install something like that for a customer in my queue... until now only had smaller netapp shelf or hp vault setups... just like linus, i giggle to myself when see such rediculus brilliant setups!
@@Pussalia Yeah, I hope LTT revamps their server room infrastructure specifically to support this hardware. I don't think they've thought that far ahead yet haha. It'll be fun to watch them figure this out.
Please next part!! Can't wait pleeeeease!!
Looks like an interesting project !
I'm super jacked for this series! Can't wait to see it going all together and up and running!! Freaking awesome!!
hihi
I have a SuperMicro 200TB storage with some processing servers in a 10Gbps switch at work, and it is sweet. This monster that they are mounting is just mind boggling. I am very pumped to watch this series unfold.
Beautiful, something really awesome about the raw magnitude of this build. A note on the power, hopefully these two power connections are in sync, or being run through a central UPS/building or otherwise to clean it up, but running extra long cable to sensitive equipment of differing lengths can cause a dirty power input, not something to problematic but not ideal and in brown out scenarios can cause a fault down one side of the rack, not sure on the tolerances on the kit. On oneside it should be bullet proof as it's DC equipment, on the the side it's DC equipment and may expect incoming facilities to be within DC tolerance. Can't wait for the follow up videos
With what they are plugging in i would have thought they would get it a direct line of power
@@kirkanos3968 Seriously, they repeated how long this project has been in the works. Was Brian the Electrician not available to extend the service? Oof!
I hope this comment gets some attention, they aren't really going to know how serious that could be so hopefully there can be some input from the few who might be able to answer this.
Agree - those extensions need to be the same length.
Agree, with a million dollars of high end equipment why wouldnt you run dedicated power from a panel to it? No extension cables.