This is an SSD?! - PureStorage FlashBlade Tour
Вставка
- Опубліковано 9 лип 2024
- Thanks to Pure Storage for sponsoring this video! You can learn more about FlashBlade//S at purefla.sh/3u1ySFF and follow Pure Storage on LinkedIn at purefla.sh/3xMZlIk
SSDs are fast, but in the datacenter, fast is never fast enough. So why did Pure Storage switch to slower QLC flash, and how is it FASTER than TLC?
Discuss on the forum: linustechtips.com/topic/14460...
► GET MERCH: lttstore.com
► SUPPORT US ON FLOATPLANE: www.floatplane.com/
► AFFILIATES, SPONSORS & REFERRALS: lmg.gg/sponsors
► PODCAST GEAR: lmg.gg/podcastgear
FOLLOW US
---------------------------------------------------
Twitter: / linustech
Facebook: / linustech
Instagram: / linustech
TikTok: / linustech
Twitch: / linustech
MUSIC CREDIT
---------------------------------------------------
Intro: Laszlo - Supernova
Video Link: • [Electro] - Laszlo - S...
iTunes Download Link: itunes.apple.com/us/album/sup...
Artist Link: / laszlomusic
Outro: Approaching Nirvana - Sugar High
Video Link: • Sugar High - Approachi...
Listen on Spotify: spoti.fi/UxWkUw
Artist Link: / approachingnirvana
Intro animation by MBarek Abdelwassaa / mbarek_abdel
Monitor And Keyboard by vadimmihalkevich / CC BY 4.0 geni.us/PgGWp
Mechanical RGB Keyboard by BigBrotherECE / CC BY 4.0 geni.us/mj6pHk4
Mouse Gamer free Model By Oscar Creativo / CC BY 4.0 geni.us/Ps3XfE
CHAPTERS
---------------------------------------------------
0:00 - Intro
0:50 - This is an SSD?!
1:59 - How do SSDs work?
2:59 - The Method to Pure Storage’s Madness
6:17 - The FlashBlade//S
8:12 - Touring the Datacenter
11:44 - Who could need this much storage!?
13:15 - An NVIDIA DGX A100 in action
14:08 - What happens after the SSD array is retired?
15:10 - The “File System” and what happens when you yank one out
17:45 - Who is Pure Storage?
18:32 - Conclusion - Наука та технологія
It must be a huge relief for the companies to have Anthony and not Linus in their extremely valuable place, he didn't drop a single thing...
😂
i expect Anthony's jaw dropped when he saw this technology ...
may have been a condition of the video lol
Maybe thats why he is there, they were like big nope on linus yall.
I work for a reseller of Pure storage products, and when building our lab kit, we've had several "Linus moments" over the years.
Whilst whatever was "Linused" obviously can't be given to a customer, they tend to run for many years after the incident in lab equipment (or until we send it back to Pure) .
It is really well built kit.
Love that Anthony is out in the wild doing reports like this. Just awesome!
No one else would understand this.
A wild Anthony appears
8:16 Yes, now we know those racks are rated for a magnitude 9.1 on the Anthony hairflow meter.
I was worried his hair would be caught in a server fan. Dang that is some danger in the field.
Reports like this... can you spell "a d v e r t i s e m e n t"?
Disclaimer - I work for Pure, but this is one of the coolest videos I've seen in a long time. I remember the days we had to spend the first half of any presentation explaining what Flash technology was, and why is was better than spinning disks - lower power, higher performance and density, more reliable, and with dedupe/compression and predicted wide scale adoption - price competitive with magnetic media. How times have changed - Flash benefits are well known now, and price per TB cheaper than spinning disks. Pure DFMs are not only higher performing than SSDs, they are way more reliable and last a lot longer. Well done Anthony - great job.
Your tech is madness - fantasy level stuff. Enjoyed the hell out of this video.
price per TB cheaper then spinning rust? Well i dont know in what universe you live, but consumer grade spinning rust is still cheaper then any reliable SSD....
@@kanarie93 I think you're missing the point. The cost to have the redundancy and usuable space as spinning rust vs this type of solution is higher. Because of their compression+dedupe your sizing is different. This isn't for a homelab/consumer use, this is comparing datacenter tech to datacenter tech
@thebindir Correct. In consumer and enthusiast and even some workstation worlds, spinning rust drives per TB, even with decent redundancy, will almost always end up cheaper than equivalent systems utilizing flash. But in datacenter and enterprise scales like that, it flips around easily depending on what methods you're using for redundancy and recovery from failures. Add onto that secondary things like cost and software used, and yea...as shown in the vid, it goes to show why it flips. Eventually this kind of thing will probably leech into consumer space once we start touching the dozens to hundreds of TB 5 to 15 years from now.
As a Pure Storage field engineer, I am glad to see this video getting some attention
Same. I run quite a few Pure arrays and they are impressive.
Does Pure run their own engineers, or do they contract out?
I work with HPE right now, Pure looks more fun lol
@@dallascarney2986bro Hewlett is a mess rn hahahah
Dude, I assembled these machines on the factory line back in 2019. They have some really interesting perspectives on using SSD storage in tandem with FPGA's
Why not spin up some custom silicon? FPGAs are still quite slow, expensive and power hungry.
@@graealex yea i wonder why during a chip shortage they havent put out their own custom silicon yet........
@@graealex It's so they can remotely send updates to the FPGA's to better optimize the storage algorithms, and as they expand their supported services. It doesn't act as a file storage system. It's more like they install services on the FPGA per use case, like if you want to run an SQL database, or cloud storage, or whatever, they write onto the FPGA specific for your service needs. This is why they've been able to support all their old hardware from many generations ago and get similar performance metrics of the new hardware today.
@@AniClips699 FPGAs require a lot more die area, and if it is unknown to you, the shortage mainly affects old processes, and as such chip designs that rely on those.
@@TickyTack23 That's a reasonable explanation. Still, compared to ASIC, FPGAs are very slow.
Edit: a reasonable but wrong explanation as it seems.
LTT: We can use a Threadripper as a GPU
Pure Storage: We can use a Xeon CPU as a DRAM server cache
Image how quieter the server room would be with ARM or RISC-V chips
also using QLC SSD arrays for a GPU data crunching cache, technically VRAM right?
@@gabrielfair724 server rooms doesnt need to be quiet
@@user-tn6tb2qh8d like your mama, but here we are
@@user-tn6tb2qh8d can confirm working in a datacenter working on a long maintainance task ANC headphones are pretty much a requirement to hear yourself think
Anthony has really gotten comfortable in front of a camera. This is the best, most natural performance I've seen him deliver. And the tech is bonkers in this one!
Well done all around.
Just record the audio outside the server room next time :-D
The infamous Anthony turns famous. 👍👍🙂😁
I feel like the more nerdy/technical something is, the better Anthony preforms. Partly because he can truly understand what he's talking about, but also partly because this shit is just purely fascinating to him similar to us, dude truly gets immersed in the tech rather than worrying about his presentation. The less explaining he needs to do, the choppier it tended to sound to me. He is definitely getting better in general though, I love his videos.
Anthony is by far my favorite, the best part is he actually enjoys all this really technical stuff. The kind of guy that walks into a server room and looks around like a kid in a candy store, on top of that his brain is huge and he actually understands the stuff he's explaining.
That's me measuring my switching node at 5:50! I designed the FIOM on FlashBlade//S. So proud to see its name in lights 🤩Huge thanks to Anthony and LTT for stopping by!
I remember when Anthony first started appearing as a cohost in videos, and everyone overwhelmingly wanted more Anthony.
Here we are years later and Anthony hosts some of the coolest videos. Excellent video hosting and writing, Anthony!
🤮
@@detective_mitch_conner It's ok to like things and appreciate people, Bort. Perhaps one day you'll become an adult and realise this.
@@johnnypopstar 🤮
@@detective_mitch_conner 🤮
@@TheEatcrap 🤮
Been using PureStorage since 2016. Fantastic system, amazing team and hardware that just won't quit. Upgraded storage controllers twice in that time with absolutely no downtime for a critical healthcare environment. So worth the money. Especially compared to my experiences with HP Lefthand and 3par.
We've got an old 3par and Dell Compellent we are looking to replace. I forwarded this to the lan team since they said they were not aware of this company. We'll see.
@@kierasher1 we just performed a migration from 3 par to pure and it was the best decision that we have made so far. Condensed 3 racks to just a few U’s and the performance boost has been amazing. Just wanted to share.
I have to admit (coming from someone who worked for their competition at one point) I'm impressed with what Pure has done to stay competitive in the datacenter storage space.
I worked for Pure Storage for 3 years, and still know a bunch of the staff. It's an absolutely WONDERFUL product.
Fledgling technician here, how do you get into working for a company like Pure? I've been fascinated by server and enterprise grade tech for so long, but it seems like an industry where you have to have 7+ years of experience with the stuff to get a job in the first place.
@@syntaxvrc I was in their support department, so the requirements weren't as intense, but it was still challenging to get hired on. It helped that I had friends who worked there and could give me a good recommendation.
@@syntaxvrc best advice find something your passionate about and become an expert. Specifically for pure learn Linux and networking. Learning the standards and how/why things work goes a long ways. Understanding the actual standard that powers smb or NFS or S3 or networking those will take you a long way in a tech career.
@@syntaxvrc I started as an intern at Pure, so I had a kinda unconventional way of getting there. That being said - there's a lot of different things going on at Pure, from our actual server hardware, to our cloud services at Pure1 Manage, to our data analytics and AI research for predicting array load, to plugins for things like vSphere, Microsoft apps, and other storage solutions for Kubernetes and Docker like Portworx. All of them have different skill-sets and provide good ways to get "in" to the storage space, and you can soak up a bunch from the surroundings from there asking about all the different stuff.
I've enjoyed almost every day working at Pure so if you see any openings, I'd highly recommend you apply and give it a try ;)
I purchased from Pure for a data center when they were young. Absolutely amazing product and recommend it to friends still doing the purchasing and needing amazing storage solutions.
Its so strange how YT has never shown me a video newer than a few hours old until this week. I keep getting suggested videos with minutes shown rather than hours.
Wtf same!! 😳 so strange
same here
Same!!!! I got recommended a video uploaded 5 seconds ago
Same
Google controlling you and shifting your interests and attention to where they want😑
Going with Pure Storage was my best decision in the datacenter I’ve ever made. Absolutely amazing tech.
FlashBlade S customer here and we are super happy with the performance. We basically replaced two full rack SANs with two 5U Pure arrays. Crazy.
This might be one of my favorite LTT videos. The technology is incredibly novel and Anthony is the perfect host to give such a clear explanation of how it works(the editing went a long way for that too!) And something about him just standing in front of a loud server rack screaming about specs was just perfect. It felt like I was there.
The server scream was definitely a great sell. I'd have liked to have seen (heard) more of an audio edit to nuke the high frequencies because anthony has a deep enough voice that getting rid of the shrill entirely wouldn't have affected his voice.
Watching Antony's magnificent hair blow in the breeze of a server rack's worth of fans is peak content. Totally the nerdy equivalent of those breeze on the beach slow mo Scenes.
Nick Cage -esque
I was looking for this comment haha
Those fans are so loud the editing team had to stifle or use Noise Reduction on the audio, holy shite!🤣
He's *_majestic_*
@@DiamondTear waiting to see the meme created
I love seeing Anthony's hair blown in the wind of the server exhaust. Combined with the sounds picked up by his mic, it really gives you a sense of what it's like to stand in there with Anthony.
I couldn't watch, I thought for sure a fan was gonna suck his hair in at any minute
I'm the Storage guy for the 3rd largest credit union in the US. We have several Pure Storage units now.
In their standard FlashArray (The SLC driven "X" series and the QLC driven "C" series) they also install "NVRAM" cache for the entire array. And are "BlockStorage" meaning you can create and present LUNS that can be booted from even. (And we have several servers that "Boot from SAN" from our Flash Arrays.)
The FlashBlade you are displaying are "Object Storage". NFS or File type objects.
We've ditched an EMC VMAX 250F and it's suuuper high maintenance support contract with a X70R3 that handles all the high IO load at a much lower cost. *AND* we get free upgrades every 3 years to the controllers and enclosures. The VMAX was a full rack with dual 3 phase 30 amp feeds. The replacement is a 3U system with two standard C19 connectors.
*C13 connections ;) No need for C19 with an X70. Also, take a look at how NVRAM is redone on //XL.
We got one of these a few months ago. Like Anthony said we never heard of them. The performance is outstanding.
We had a disk queue graphic set up that we thought had stopped working it appeared to have just flatlined... Turns out at 500% zoom it was working, just the queue was so crazy small you couldn't tell by the graphic 😂
Pure storage has horrifically uninformed sales teams. I heard things like 'IOPS dont matter' and 'Our compression is 3 to 1 or better, so its competitive with this other unit that has more storage, even though you encrypt your vms.' The product was fine, the sales 4 years ago was dumpster.
@dj Kplus They don't bother to have the conversation because 500k/1 million IOPS is a fucking walk in the park for these things and real conversations about planning for IOPS happen when are talking about accommodating double digit millions of IOPS. The conversations strictly revovled about beating HPE/Dell EMC numbers to keep the bean counters happy in terms of bids...
We ran FlashArrays that provided tier 1 file access plus some of our arrays backed MS SQL servers with 1TB of RAM, 64 CPU's and about 50TB of databases....... most of the time the arrays were sleeping.... or idle. We just needed the bonkers low latency because lawyers get impatient when clicking through documents and they don't appear fucking instantly.
@@lharris428 Kind of put them in a crunch when they were bidding for us, because (this was a hair over 5 years ago now that I look at it, lockdowns been rough) we were knocking in the 6.5 million IOPS range on AFAs with around 300tb of storage. They wanted a signed sales contract before going further with technical performance aspects, and had all sorts of strange terms at the time that meant we'd be locked into a solution that they couldn't SHOW us was competitive or guarantee a performance level for. I still have the bid in our archive, they legit were trying to sell us 100tb of actual capacity, even after 3 attempts to explain we're using full encryption. At the time they were pushing their still relatively new platform, with their own underlying model, which was hugely unproven. It left a bad taste in Sr IT management at the time and we're nearing upgrade time again. We're looking at 2pb (our current solution grew hugely) replicated across 3 sites and Pure isnt being invited to bid by the exec teams after the very real cost of allowing them to waste a bid last time. I've used pure since then in my side consulting gig and it's good, but they still sell on their deduplication and the sales team completely ignores you when you say 'Deduplication doesn't work in our environment because we are fully encrypted at rest and in transit.'
Does it basically work like Ceph, but with each chip being its own OSD?
@@BadHaddy If you haven't yet, take a look at Weka, faster than anything Pure has and a an architecture that is designed to leverage cheap public cloud storage as a seamless capacity tier.
If your workload requires massively parallel file systems, Weka might be the way to go. They aren't as mature as Pure is as a company, but if your needs gut within their sweet spots, you won't find anything faster and more scalable at a better price point.
I just ran a client through a bake off replacing 10PB of previous gen Isilon with modern Isilon/PowerScale, Pure Flashblade, NetApp and Weka, and while NetApp ended up being the most efficient in total raw capacity required on-prem, Weka mopped the floor with all of them performance wise and overall scalability, it wasn't even close.
We got two of these at my org. They are INSANE. We run our daily backups onto them. Some of the coolest hardware I've every worked on.
I believe you must have the previous gen ones ;) These new ones just came out recently.
@@rotohcf1400 Yes. But their software and hardware suite is cool to work with. A bit proprietary, but it's allowed to be when it's so freaking good.
Why do you run your backups to all flash storage? That seems like a very expensive use case.
@@shawnrhode let's imagine you actually have to restore 500TB worth of data. How long would it take? And how much do days of downtime cost while you're doing that.
@@shawnrhode depends on your downtime risk appetite etc
Seeing that pure angel of a man get to geek out the way he did in this video makes my heart happy. He's truly a treasure and the best thing about LTT.
Let's just take a moment to appreciate that they managed to get remarkably usable audio while basically standing in a hurricane.
Also, Anthony on location! Whoop!
Anthony is perfectly imperfect and I think thats why everyone loves him. The guy just loves what he does, you can see the joy and passion in his voice. This is what companies should look for in a spokesperson. You can tell hes excited, he loves this, he loves his job, he is just happy to be talking about technology. This man is going to move up and hes going places, just you wait.
@Susanna If you don't start addressing your own lack of propriety and respect when speaking to others about something serious, the only place you're going is into the downvote rabbit hole.
Hint on why I said this:
I worry for anyone that needs to address health as well, but I would also find a proper time and place to bring it up, IF there is one... Otherwise, it comes off as blatant judgement, and sanctimonious spite.
What you stated, *could* easily have been a more private, and helpful, sentiment if made to him in a DM or his socials, IF you actually cared...
Not aired out to the public, where it seems to be not much more than a play at seeking upvotes, or a confirmation of your own perception of someone else...
Be respectful, at least. If you are concerned, think ahead enough to at least approach things the right way. Blurting it here, does nothing but open the remarks to trolling, and it kinda comes off as just a flippant and arrogant judgement. Sorry...just being honest.
Besides, if you had been around long enough...you'd see he's clearly doing that, in his own life. You'd be proud, not prodding...
Adrian: or you could just say "wow what a horrible comment by a horrible person"
@@BenjaminArntzen Oh sure, but flip that coin and ask...
If the person is even being semi-honest or has a sentiment based in concern, and perhaps couldn't think of a better way to voice it...should their concerns be pushed away or diminished completely?
I'm simply giving this person the benefit of the doubt...
May not always pay off, but sometimes, people surprise each other, in positive ways.
🤷♂
@Susanna I would advise you to speak to literally anyone worth their salt in the psychiatry field about your views on shaming people to promote a healthy change in them. You’ll be booed out of the door in an instant. Maybe they’ll even laugh at you. Y’know, mock and shame you on your deep misunderstanding of the subject in the hopes that you’ll attempt to educate yourself even one iota on the issues you discuss before airing your nonsensical views again.
@Susanna To start off on an agreement: obesity is a moral failing, provided a person has to ability to prevent it, to be sure. And most of us obese people absolutely have the ability to fix ourselves, so there's no doubt that most of us have failed morally in that regard. My self included, unfortunately. With that said, shame is a tool that can be used and has a place. But like any tool, it can be misused.
People respond to shame differently from each other, from past versions of themselves, and in different contexts . If a fat person is about to jump off a bridge, that is a terrible time to shame them. If a fat person is working out in the gym, that is a terrible time to shame them. Without knowing a person, you're not positioned well to use shame effectively. This isn't to say that you're aim is wrong. It's to say that you can strive for a better application of your method, and that shaming random people who don't know you will not bring about the results you desire reliably.
As things stand, you're giving everybody a push. Some people you're pushing along the path to a better life. But you're pushing other people closer to the edge. Don't push indiscriminately. Learn when you should push people along the path and when you should pull them back from the edge. There is no one solution to the problem. It's the judicious use of the right tools at that right time that will bring you the outcome you want.
All of that is, of course, just my experience and perspective. I wish you all the best in your endeavors so long as they are at least aimed toward the good.
Pure is the best product I’ve ever bought as a Sys Admin. I looked at nearly every one of their serious competitors when I was making my purchase, and nobody even came close to this kind of speed. Most were even more expensive, while being slower and harder to upgrade.
our renderfarm was projected to save 35% on power and get a 4x speed boost - turns out we got a 19x speed boost and 39% power savings AND we keep adding server nodes with ZERO SLOW DOWN. Their products are dummy fast and super easy to manage
NetApp AFF would like to have a talk with you about that statement.
@@nuzzlefutz NetApp can’t beat Pure’s dedup ratio’s. I’ve seen allot of vendors in my career, and Pure is the only one that stands out in both tech and support!
@@nuzzlefutz Don't get me Wrong. NetApp is a good solution in regards to beeing a jack of all trades. But it's not even a competition to Purestorage in regards to performance. I know both and have multiple customers which have one or the other. Purestorage just destroys NetApp in performance and simplicity in Setup.
Edit: Typos, im tired. :D
@@InIMoeK Advertised or actual dedupe - They also originally stole their dedupe algorithm from EMC.
I love these sort of videos as it allows me to see what is going on within the professional IT world and data centres which we would not normally see even when we are in IT ourselves.
Always happy to see Anthony being this excited. I was so enlightened when Anthony was being excited in the server rooms. Damn LTT keep up the content ! Expectations are definitely higher after this one
We would get 1PB of SSD easily on the consumer platform too... If manufacturers decided to make bigger SSDs than just 2.5" ones. As is shown with the ExaDrive DC100, 100TB 3.5" SSD, but that's not for the regular folks...
But what consumer would want, need, or even consider paying for 1PB of SSD space? Doesn't make sense to change the form factor when its been an industry standard for several decades now.
@@Sizukun1 I mean, with the right volume of manufacturing, and the lower prices that come with that, I'd be willing to pay up to $1-2k to never need to worry about storage again.
I never once thought I'd fill 5TB, but here I am.
@@K-Anator 100% this. If I could have a setup that was reliable and never be used up by me I'd buy it. It's insane that 8TB ssd right now can be $1k+.
@@Sizukun1 i dunno, they could definitely make ssd's the size of hdd's and i'd buy them just the same
@@K-Anator 1PB of storage. We might be able to install the next Call of Duty
The technology to store and transmit bits is really starting to evolve. Kioxia recently developed an SSD with a 25Gb Ethernet port, no CPU or memory required, the EM6.
It has a CPU AND memory on board, in its internal controller, like almost all SSDs. They just added a network layer to their controller they use for it.
With the technology to transmit bits evolving, you'd think fast home internet would be easily available everywhere!
@@ajhauter5049 It could be, but getting ISPs to actually spend the money to utilize new technology in the US will never happen without government intervention. The same thing had to happen with electricity in rural areas across the country. Utilities having monopolies in many areas really screws over the average person
@@jondubois5347 That is unfortunately the case. I live in rural Missouri, and internet connections that pass 10mbps do not exist in the area.
@@jondubois5347 Same thing here in Germany ^^
I love how happy this makes him in this video. The passion and energy he has in this video is my favorite.
That was fantastic, I'm amazed by what Pure Storage is doing maintaining the balance of cost with the low grade flash while pushing it to absurd limits with a bit of hardware and a lot of software. That's super creative and it really feels like they're making the best of older tech. Thanks for checking that out and host it Anthony!
Thanks for shelling out more Anthony videos. He truly is a gem.
not to be a meat rider, but has he lost weight?
@@holocomputers6120 looks like that right?
I prefer linus it's his channel after all. I miss the pc builds and testing games. No idea what this video was about..
@@Ladioz if you work in IT these are pretty regular topics, nothing crazy, cool tho. However this was some giant AD, there are other companies doing things like that, and all those features aren't exclusive to them.
@@Ladioz We got a glimpse of what is to come into your PC probably in 20 years, I liked it.
Linus won't always be there, even if everyone enjoy a good Linus video, I do appreciate Anthony a lot too. All of Linus staff are truly exceptional really.
Anthony killing it like he always does. Probably my favorite member of the LTT team :) Good job!!!!
Definitely my favorite 🙌
This was one of the most interesting videos that I've seen from your channel (like the Intel one) and Anthony did an amazing job as host. Thank you all for producing this kind of content
Bravo! That was maybe the most informative and easy to understand explanation of a hard to get topic under obviously difficult conditions. Again "Bravo"
Pure is pretty great, I've installed many of these arrays in my day. Sadly I'm not doing that anymore, but it's a super exciting company and one of the only companies that took on the big guys like EMC/Dell, HP, IBM in the storage arena and actually won.
So awesome to see Pure on here. Now maybe you can get them to loan you an array to test out and mess around with 😄
They probably haven't as it will get used for Jake's data recovery and won't see the light of day for another 6 months 🤣
This honestly is the coolest thing I've heard of or learned about, thanks for the lesson.
Have seen a few of these at work! Nice to see some of it on this channel, and more data center stuff in general.
Been using Pure for years now. Love them for our analytics platform storage. Their snapshotting and deduplication is awesome.
Gotta love that this one was Anthony over Linus.
I enjoy Linus when it's regarding large infrastructure and business operations types of videos; because you know he knows what it's like to develop his business over the years. So it's palpable to feel his awe, when he is going through something like the Intel Fabs.
But it's nice to see Anthony for a change; especially digging into some of the deeper levels of technical topics: mostly because of his enthusiasm for this kind of thing.
Nice work Anthony! Always enjoy watching your videos!
You are such an asset to this channel. I have been in IT for 22 years and you definitely get it.
Maybe the proudest moment of my life besides my kid being born. I have worked at pure for years and LOVE to see the crossover with my favorite tech channel
That's awesome. I'm sure lots of people at Intel felt the same way.
We’ve had one of these at work for a few years now. Wicked fast!!
What a great video. I really love Anthony as a presenter, the man knows his stuff and his enthusiasm is contagious.
I bought a shirt from Good Mythical Morning, it took 3 weeks to arrive, the customer service never responded to my email, when it arrived it had loose threads everywhere and was essentially a basic gildan shirt for $30. I've spent a lot of money on LTT store and I gotta say, I appreciate you guys so much, you seriously go above and beyond to put out seriously good, quality and fashionable merch. LTT rocks to much, thank you for caring about your fans.
This is exactly the type of technology that we need to come back to and revisit in 20 years to either laugh at how primitive it was or marvel at how prescient it was.
Isn't this a hilariously poignant commentary on technology though?! It could literally go either way. It's so advanced and fast that we can't imagine anything better, yet we literally have no idea (or at least...I don't) what novel tech could come out tomorrow, let alone 20 years.
@@gnats3266 Indeed... Could you imagine going back to 2002 with this information!
@@gnats3266 Exactly! I still remember thinking back in the day how the CD was the ultimate in storage with its unassailable stability and INSANE capacity of 650Mb and how I would never be able to afford a CD drive. Then a few short years later we were receiving free AOL CDs by the mailtruckload and burner drives were around 20 bucks.
We went with Pure to deal with a DB that was having trouble with IOPS on the spinning disks. Pure was like "We don't even think about it at all until you hit 100k IOPS". And we were getting a fairly basic model, not the one shown here.
That’s true (note: I work for pure) for the block storage flasharray - a different system than what Anthony showed here - the smallest systems can easily do near 100k iops at 32k with 1ms of latency. So most of the time we are looking at capacity and ensuring the data reduction for the environment will fit on the systems. With block flash arrays, random read iops are plentiful so you can deduplicate and compress very aggressively. You can look at the array really as a metadata key -> data value store.
I’m an ltt fan and seeing the company start to have larger scale needs and starting to look at data center workloads has been fun. And Anthony is great to watch.
@@ScottHarney1 I had to do a double take, it was a different Scott we worked with :)
And Pure worked out so well we ended up expanding it to replace all our spinning disks in production.
I found it interesting that the aggression on the dedupe appears to go up as the storage (and thus spare IOPS?) expanded.
What does ""we font even think about it"" mean
@@suntzu1409 It means they don't do any special disk config that'd you'd normally do for databases on spinning disks. e.g. splitting database/ temp db and logs onto seperate disk groups amd calculating how big each group needed to be to meet the IO requirement for each.
(We have a H/A cluster pair of X20's which are the baby sized ones. When we were testing ours, the 20Gb of network I/O became the bottleneck before the storage did)
@@suntzu1409 That even their base model will handle 100k IOPS easily.
Love these types of videos, seeing awesome tech that you never see anywhere else!
I only noticed how CLEAN the Branding, the Website, and the Server Room Is!
Logo also seems PURE ;)
Anthony has an excellent way of explaining stuff. And his calm voice makes him much more pleasent to listen to than others.
🤮
calm voice? server go brrrr 😂 But agree
The sheer scale of this hardware is awe-inspiring. Loved it!
Huge thanks for the subtitles, it really helped 👌
Anthony in a cutting-edge server room with racks of bespoke hardware screaming at him and blowing his hair around... now that's a match made in heaven. You can feel the nerdy enthusiasm through the screen! I loved learning about this stuff from him.
I've used PureStorage at work for about 7 or 8 years now and it is amazing. The speed and deduplication rate on it is absolutely crazy. Well worth it for any datacenter.
I love how genuinely excited Anthony is for these blades ^^
Pure storage is amazing. I bought a used one from someone local to me about 6 months ago . It’s an older model with not that much storage. But god it’s stupid quick to run my DB workloads, plus the VMware integration is really good.
Y'all don't usually under sell so much with the thumbnail and title. This video was awesome and this concept of storage is really cool. I didn't expect this!
This is simply Amazing! Great job of explaining the unexplainable to us pleebs, Anthony!
Very nice to finally see you guys cover Pure. While you didn't cover their block storage side I wanted to say for anyone curious about that (flasharray), they are very efficient for both power and space as they perform inline compression AND dedupe . You can get well over 4X the storage depending on what kind of data is on the array.
Plus all their stuff is simple to use and pretty easy to upgrade. Its a welcome change vs other storage vendors.
Pure’s dedupe is second to none by MILES! We had a brand new unity all flash array nearly identical to our pure flash array. The dell managed a measly 3x dedupe ratio on a bunch of VM’s and SQL data meanwhile after migrating to pure, their dedupe ratio was over 13.2 to 1. Just mind boggling performance
Very detailed and excellent explanations in every detail about computer related stuff and how it works. Thanks Anthony u doing a great job!
Anthony standing in front of racks with the fans blowing is the content we all need more of. Keep up the good work Anthony. I hope you had as much fun as it looks like you did!
Man, we got a pure for our company about 2 years ago and it's been awesome. Cool to see it on LTT
really enjoyed the video man, thats mind blowing stuff they doin. looking forward to more more vids from ya
cheers 🤟
It's great seeing Anthony doing a video on this. You can really see his knowledge being put to thr test with the level of thinking he is doing throught the video and it's impressive.
The Pure Storage arrays are amazing. We went from a different vendor's hybrid SAN to a Pure SAN, and the performance increase blew us away. Plus, the space savings with their dedupe helped bring the cost and resale values down to the old hybrid array that had much more space. Pure works wonders and I am a huge fan. Glad to see recognition for some of the more Enterprise-grade solutions out there.
We use Pure Storage at my company (large credit union) - interesting to see the perspective shown here on the manufacturer end.
Great video!
I am pretty sure Anthony is the one and only visitor they ever had who really understood what they are doing.
This is super awesome! I actually have worked with purestorage flash arrays and their object storage. Having LTT explain how their arrarys work is incredible. I didn't realize how advanced purestorage's technology really is.
Just need some more Linux video from Anthony :(
Anthony is a blessing for us.
Stay safe man
Always stoked to see Anthony host an episode
10% understanding Anthony
90% enjoying watching him enjoying himself
I worked with both FlashBlade and FlashArray on my previous job as SRE, amazing products.
Ahhh man I love Pure. We've had them for a few years now. We have the FlashArray//X housing our virtual infrastructure and FlashBlade (currently looking at FlashBlade//S) for some backups.
Love Pure. Simple to use. Simple to administer. Amazing support. Best storage solution I've ever dealt with.
Amazing Anthony, nice work!
I like this kind of videos so much, and Anthony does this job right! Big Thumbs up ;)
I SAW the thumbnail and screamed. I knew this was going to happen. Great video presentation
Love Anthonys videos, very in depth and more "geeky" than the usual content. Please keep producing his content!
Absolutely superb video Anthony. Loved it. More vids from you bud!
Fun fact: that is where Anthony vacations every July for 2 days, they just happened to run into him with a camera and decided to shoot a piece.
I can see him camping next to the server room.
Anthony is a great talent and a wonderful host. I always enjoy his videos. The man is a sage. I’m glad Linus noticed his talent.
Editor Feedback: I'm sure some people will complain about the data center noise. I for one thought you all did an amazing job with the audio knowing just how loud it is in there. Seeing Anthony there with the gear in front of him to talk about it I'm sure added to his excitement level and that gets passed right long to us. Well worth the audio tradeoff thank you!
There's this thing called B-roll. Also, there are audio filters in post production. Anthony's excitement was great, but this was painful to listen to. Actually, literally painful.
Wow. GREAT video Anthony. Loved your presentation
9:05 I love how Anthony's hair wave in the wake of wind that the rack is producing, true PC Master Race endgame
Just started working with Pure at my job and was going to start recommending you guys cover them as an interesting topic here, so cool to see
Apart from the intel center videos, this by far is the most interesting video to come out of LTT in a long time, and I’m an avid enjoyer of LTT content.
This stuff is really awesome. I was at a company considering one of their FlashBlade arrays for backup storage. They were a great fit for that, because you could run the VMs from the on-board compute without issue.
This was a perfect video, very technical information portrayed in a way that is fascinating and acceptable, well done to Anthony and the team.
I've been a Pure customer at the past couple companies, their support is amazing, and the hardware is no slouch. The FlashArray makes a great SAN replacement, and effectively gives fast nvme storage speeds to all the server VMs in a VM host cluster.
This is an incredibly exciting video for me because I'm starting a SWE position at Pure in September.
Awesome. Welcome to the team!
Kudos LTT for being bold enough to do this type of content. Keep it up.
I love LTT’s “how it’s made” videos! These are the best!
I'd love one of those in my server rack, oh the dreams..
While they're at it they can also tell you why they give consumers almost 0 control over the hardware purchased from them. (Company I work for owns 3 Pure Arrays) That we cannot upgrade software on by ourselves, adjust IP addresses, or even access node level CLI to get more information about possible issues on our own.
There is no documentation for CLI commands, no support documentation on how to support hardware you've purchased, etc.
Would you mind providing examples of "No documentation of CLI commands" ? You absolutely can adjust IP addresses on your own. Pure's approach is just different from "this is your problem". It's meant to be easy to work with and the support team takes care of most monitoring and alerting.
Their support staff have handled our rare issues very well (Even when it was our fault). Our DC never has to dig to a cli level of commands to do anything as their UI is fantastic and handles everything needed, and the predictive analysis software has had someone call us before problems even pop up. From what I've heard, their cli tools would not be like your normal storage commands (but systems engineers use it to automate a lot of great stuff
Are you sure you have the correct access to the unit?
Is it because their customers probably don't want to fix problems themselves? Pure has great support in my experience. Absolutely no vendor will allow you to upgrade your software yourself. You can change IP's. There's a robust API, not sure what CLI you need.
@@aelaan12 exactly. Probably doesn't have array admin or something like that.
love you Anthony! keep being awesome man!
Absolutely lovely video, Anthony is just the best at communicating these incredible technologies
Finally a video from MY world! I've had clients using Pure for over a decade for VDI and DB applications. It was only a matter of time before they started bypassing high-speed arrays like Violin for workloads like AI that blow the needs for IOPS out the window.
I POC'd a Violin against a Pure back when I was a customer. Broke the Violin from the GUI twice. It was cool tech, but wretched implementation. That's 6 years ago though, they don't even have the top-loading drives anymore, so maybe it's better now.
For VDI and virtual machine workloads in general Pure is absolutely amazing, super simple to manage and setup and by using deduplication and compression it takes almost no storage.