I predicted the future! - GRAID Graphics Accelerated Storage

Поділитися
Вставка
  • Опубліковано 18 жов 2024

КОМЕНТАРІ • 2,6 тис.

  • @LinusTechTips
    @LinusTechTips  2 роки тому +1739

    Small note for around 8:34: The pieces of data striped across the array in a RAID0 configuration are typically a power of 2 bytes, not individual bits. A common strip size (the piece of data put onto each drive in a stripe) is 16KB, but you can usually adjust it to be bigger or smaller depending on your use case.

    • @StaticZXC
      @StaticZXC 2 роки тому +7

      First, love you LTT

    • @fireballfurby
      @fireballfurby 2 роки тому +1

      Ok

    • @astronemir
      @astronemir 2 роки тому +22

      Now how am I supposed to “Well Achtually” correct people in the comments??

    • @ItsQualitycontent
      @ItsQualitycontent 2 роки тому +5

      I have to know. Does he actually accidentally drop stuff or does he do it for show these days

    • @Skibidi_Fortnite11
      @Skibidi_Fortnite11 2 роки тому +7

      Were is scrapyard wars

  • @snazzy
    @snazzy 2 роки тому +5513

    I want to believe Linus dropping stuff is a bit now, but deep down, I know it’s real.

    • @Gryever12
      @Gryever12 2 роки тому +42

      seriously lol.

    • @andrew6239
      @andrew6239 2 роки тому +13

      Jesus Christ please stop the cringe

    • @zackthompson9914
      @zackthompson9914 2 роки тому +8

      Honestly it's both

    • @ulmekuubis
      @ulmekuubis 2 роки тому +8

      Linus is just like me -> clumsy 😆

    • @cleanlens
      @cleanlens 2 роки тому +3

      linus is a bit energetic

  • @thedorkequine7517
    @thedorkequine7517 2 роки тому +3492

    Linus almost dropping it in the first two minutes, just classic.

    • @d3fyne
      @d3fyne 2 роки тому +40

      more like first 30 seconds. It's Linus we're talking about.

    • @lucassadik
      @lucassadik 2 роки тому +3

      lol linus is what we're talking about now?

    • @Starvexx
      @Starvexx 2 роки тому +2

      Just business as usual

    • @karehaqt
      @karehaqt 2 роки тому +27

      Linus has worse hand/eye coordination than my grandma who has Parkinsons.

    • @TennSeven
      @TennSeven 2 роки тому +1

      Linus dropping things and his lame segues into into sponsor and LTT Store shilling. Name a more iconic duo.

  • @montecrysto33
    @montecrysto33 2 роки тому +1617

    Fun facts: RAID originally meant "Redundant Array of Inexpensive Disks", but "inexpensive" didn't sell as well as "independant"

    • @Kamel419
      @Kamel419 2 роки тому +118

      I've never heard the "independent" variant until now. I'm quite sure this is another case of enough people saying it wrong that they began accepting both. This was definitely a question on my A+ exam

    • @stacksmasherninja7266
      @stacksmasherninja7266 2 роки тому +26

      I've never heard of inexpensive tbh

    • @Safetytrousers
      @Safetytrousers 2 роки тому +100

      The term "RAID" was invented by David Patterson, Garth A. Gibson, and Randy Katz at the University of California, Berkeley in 1987. In their June 1988 paper "A Case for Redundant Arrays of Inexpensive Disks (RAID)"...Industry manufacturers later redefined the RAID acronym to stand for "redundant array of independent disks"
      Wiki

    • @imadecoy.
      @imadecoy. 2 роки тому +27

      And LTT messed it up by writing "Discs"

    • @alangarde2928
      @alangarde2928 2 роки тому +11

      Thankyou! I had a moment where I doubted myself as I thought have I been saying it wrong all this time? Turns out I'm just old instead.

  • @leon11235
    @leon11235 2 роки тому +53

    Why you're confused with RAID5 results? Here's some points to consider.
    1. To calculate parity it's required to send data to and from GPU, or calculate with CPU. It's a possible bottleneck.
    2. Was our array in optimal state before tests? It should calculate parity data(process called build/rebuild/resync) before going to optimal state. That can limit performance too, and it explains 100% GPU usage without host I/O.

  • @stevenclark2188
    @stevenclark2188 2 роки тому +25

    7:07 12v 7a, probably sounds like a fighter jet with the afterburners on, of COURSE it's made by Delta. Their little 60mm monsters and the sound they made is part of why we started getting 80mm and then 120mm CPU coolers.

    • @jrcowboy1099
      @jrcowboy1099 2 роки тому +1

      HOLY... 84W?!?! WOW! It need a lot of that power to cool itself!

    • @ujiltromm7358
      @ujiltromm7358 2 роки тому +7

      @@jrcowboy1099 It's not a piece of silicon which almost entirely dissipates its power input as waste heat. It's an electric motor showing an efficiency above 95%. Of those 84W, maybe 5 are converted to heat, the rest moves air. A LOT of air.

    • @jrcowboy1099
      @jrcowboy1099 2 роки тому +1

      @@ujiltromm7358 Lol, yeah you're right, I guess I was apparently brain dead when I wrote that.

  • @DigitalJedi
    @DigitalJedi 2 роки тому +1956

    GPU is going to start standing for "general processing unit" before long. They do physics, they do math and hashing, they do rendering and texture mapping, and now they are freaking hardware controllers too!

    • @ipanesm
      @ipanesm 2 роки тому +71

      You know what? Thats pretty cool

    • @tbuk8350
      @tbuk8350 2 роки тому +62

      Yeah, like how GPUs being incredibly fast and having stupidly fast memory that the processor can directly access from less than an inch away happened to be perfect for running ML tasks at fast speeds.

    • @liam9393
      @liam9393 2 роки тому +26

      Applications beyond graphics....now the language is "accelerator" as GPU seems outdated/limited usage.

    • @Klokopf52
      @Klokopf52 2 роки тому +19

      That's kind of what Xeon Phi was for. Parallel processing taken to the max. I cast my vote for PPU

    • @ninabeer4959
      @ninabeer4959 2 роки тому +4

      for some reason i read harrasing and hashing...

  • @bobbygetsbanned6049
    @bobbygetsbanned6049 2 роки тому +298

    As someone who works in enterprise tech, I enjoy these videos significantly more than 70+ slide power points from our engineers.

    • @thedude4840
      @thedude4840 2 роки тому +12

      Oh you poor soul. If there’s nothing corps love more than profit it’s PowerPoints.

  • @maxvaessen
    @maxvaessen 2 роки тому +8

    The vibe you guys were in during the filming of this episode made it really enjoying to watch. more of this!

  • @leetebbens8858
    @leetebbens8858 2 роки тому +36

    Jake really has a similar combination of knowledge and charisma that made Linus so popular and enjoyable to watch.

    • @alexn78666
      @alexn78666 Рік тому

      except he has some personality traits that are.. fairly annoying imo. hard to put words to it, but I'd have to disagree on the charisma part. he comes across as a smug know-it-all who likes to tell people how much he knows because he thinks it's impressive. unlike Linus who does it because he genuinely wants other people to learn. not always, just most of the time.

  • @Hopgop1
    @Hopgop1 2 роки тому +239

    Killing the videos lately, been great content, love Alex and Jake's hosting/co-hosting.

    • @ShadowLinkxMaster
      @ShadowLinkxMaster 2 роки тому +6

      Did they recently stop using the intros though? I could’ve sworn I hadn’t seen it on another recent upload.

    • @scottyvan
      @scottyvan 2 роки тому +1

      Right? These two together are electric

  • @TheOriginalNCDV
    @TheOriginalNCDV 2 роки тому +853

    I remember when a "T1000" was something else completely different. And deadly. But not good with extreme temperatures...

    • @Felipemelazzi
      @Felipemelazzi 2 роки тому +20

      That's a nice Terminator reference you've got there👌

    • @nathanlowery1141
      @nathanlowery1141 2 роки тому +8

      Wonder if sky net used these

    • @durururururururu
      @durururururururu 2 роки тому +19

      @@nathanlowery1141 Skynet is a LTE internet service provided by Skytel telecommunications company in Mongolia.

    • @muneshify
      @muneshify 2 роки тому +5

      You just made me laugh harder than I should, office mates looking at me having a geek attack

    • @fajaradi1223
      @fajaradi1223 2 роки тому +6

      He'll be back

  • @mazgazine1
    @mazgazine1 2 роки тому +288

    Its really neat when they do tests on stuff for their studio, that they ACTUALLY USE. Like the investment in the stuff isn't wasted, and the reaction is genuine to the performance to the point they they would definitely use/not use a thing is nice.

    • @Hjorth87
      @Hjorth87 2 роки тому +8

      I'm pretty sure they often have to return some of the more sophisticated nicknacks they show off. They directly talked about it when they played around with that petabyte of nvmes.

    • @fl4shbangz
      @fl4shbangz 2 роки тому +2

      Linus said on the WAN show they would have to return most of the stuff for this project

    • @rukia4473
      @rukia4473 2 роки тому

      Please read my name💕

    • @luijo633
      @luijo633 2 роки тому +1

      Yeah, i know right? like when Linus was so happy with the Framework laptop that he fraking bought it on cammera lol

  • @TheOriginalFaxon
    @TheOriginalFaxon 2 роки тому +84

    it makes me really happy that these are exactly the same as GPUs, because that means that A: The software could run on ANY gpu, and B: you can use these cards AS FUCKING GPUS if needed, meaning they won't go to waste if you no longer need them for running a RAID with. No doubt you'll need some kind of hack because of the license thing, but yea that's wild lol

    • @jettdragon3337
      @jettdragon3337 2 роки тому

      I wonder if you could use it as a basic display output at the same time.

    • @ViciousTuna2012
      @ViciousTuna2012 2 роки тому +9

      It would work the other way around. These are older GPUs. It's more likely that industry would repurpose existing but outdated GPUs to use for this application, instead of what you described.

    • @wayland7150
      @wayland7150 2 роки тому

      Mining only GPUs perhaps. Nvidia's thing is CUDA, I expect if you can run CUDA code then you can run this RAID thing.

    • @curvingfyre6810
      @curvingfyre6810 2 роки тому +2

      @@ViciousTuna2012 god I hope so lol, then I might actually be able to access this technology within my lifetime. With how the setup is described, it makes me wonder just how much processing and bus bandwidth you really need for this. Presumably memory is a factor, but for simple user-oriented tasks, you legit do not need 100gb a second for *anything*. I wonder how this would interact with different solid state tech like Optane and optane hybrid. You might be able to blow the price, capacity, features, and performance of the top end raw pcie drives on the market using an old junker display processor, and 2-5 consumer optane hybrid m.2s. Of course adapters to fill that many slots may ramp up costs prohibitively. Pcie bifurcation and slot adaptation is way more expensive than it should be.

    • @ViciousTuna2012
      @ViciousTuna2012 2 роки тому +1

      @@curvingfyre6810 I wouldn't think of this in terms of user-oriented speed requirements. This tech is going to be most useful for server applications, which will be able to utilize that level of bandwidth (100GB/s).

  • @dumaneduard
    @dumaneduard 2 роки тому +1

    These banter videos are the best videos :)

  • @nathanfife2890
    @nathanfife2890 2 роки тому +249

    I like the videos where Jake does cool stuff and Linus just watches and reacts.

  • @MasterJack2
    @MasterJack2 2 роки тому +417

    Lately Jake has been very good on camera, he got a lot better since 1-2 years ago when he was no good at all, to the point when I remember Linus telling the viewers and i am paraphrasing "I promise Jake is very good at what he does". Now we see he is knowledgeable and he manages to be entertaining too.

    • @Shadowcast140
      @Shadowcast140 2 роки тому +17

      he would be even better on camera if he eliminated the pedostache

    • @TimmyTurner421
      @TimmyTurner421 2 роки тому +42

      @@Shadowcast140 your momma loves it though

    • @DerrickRG
      @DerrickRG 2 роки тому +31

      He's finally filling the role that Luke had on camera.

    • @Igorrr3k
      @Igorrr3k 2 роки тому +8

      I remember the "Jake needs a sack" phase but he's massively stepped up his game, it's amazing to see!

    • @tylernestor2431
      @tylernestor2431 2 роки тому +12

      I'd love to see him healthy!

  • @AmateurCrastinator
    @AmateurCrastinator 2 роки тому +49

    As a tech geek it always makes me smile how giddy they are when talking about extraordinary hardware / software solutions. 😄

  • @Bisqwit
    @Bisqwit 2 роки тому

    “Parody calculations”? What are you using to subtitle your videos? You could consider firing them and hiring someone more competent.

  • @Oriansenshi
    @Oriansenshi 2 роки тому

    I don't know any of the computing stuff that he was talking about in this episode, but I just enjoy watching linus get excited about stuff. It brightens my day.

  • @wap300
    @wap300 2 роки тому +1203

    Linus says "CPUs are fricking expensive" in 2022 while literally waving a GPU in his hand. The audacity

    • @LovelyBlazingRush
      @LovelyBlazingRush 2 роки тому +8

      Haha

    • @satakrionkryptomortis
      @satakrionkryptomortis 2 роки тому +66

      we are all clear that he speaks about CPUs that are like 2 3090ti with enough money left to buy a descend car second hand.

    • @cyborgmike9210
      @cyborgmike9210 2 роки тому +28

      @@satakrionkryptomortis yup. And licenses are significant in VM infrastructure cost measured per CPU core.

    • @sputnik13
      @sputnik13 2 роки тому +31

      Funny comment, but yeah enterprises pay way more for software licenses than for hardware, oracle, esxi, etc can easily become 100s of thousands or millions a year and are priced per socket or per core

    • @Vatharian
      @Vatharian 2 роки тому +16

      pair of Epyc 75F3 cost over $12k, pair of Xeon 8380HL will drain you of 28k Euro. And you still can't buy 5950X for less than a kidney - if you find one, that is.
      Edit: It may depend on use case, but usually RAM becomes the biggest money sink, unless you are fine with dropping 64 GB in a dual socket server.

  • @jseen9568
    @jseen9568 2 роки тому +176

    GPU accelerated raid, NVME drives attached with a GPU, PCIe 5 coming.
    I still say there could be some really interesting devices coming that could handle several different things at once, without performance issues.
    e.g. A single GPU, with 4 drives, in Raid, with the raid being taking care of by the GPU, and the GPU sending video output (perhaps some other computation happening as well). All without a performance being impacted with any of it.

    • @timsmith3743
      @timsmith3743 2 роки тому +8

      It's like a return to the past when some Enterprise GPUs had inbuilt SSDs.
      Certainly not common, but not a new idea.

    • @calebschmucker4698
      @calebschmucker4698 2 роки тому +7

      Back to the days of a math coprocessor

    • @rukia4473
      @rukia4473 2 роки тому

      Please read my name❣️

    • @Rich-qs6kn
      @Rich-qs6kn 2 роки тому +1

      Are we going to see less of a push for improvements to the CPU in the future then? maybe that's why Intel are moving into the GPU space.

    • @Finder245
      @Finder245 2 роки тому

      You are underestimating the software complexity of these solutions. Anyone can duct tape together a bunch of components, but making them actually work together seamlessly is not trivial, and when something goes wrong, they are just too difficult to debug. If you look at the history of computing, simpler solutions tend to win. Only the most performance critical applications tolerate some complexity.

  • @IsaacWH
    @IsaacWH 2 роки тому +234

    30 secs in and Linus's already dropping the thing. Legend.

    • @bustex1
      @bustex1 2 роки тому +3

      What?

    • @BillyBonesYT
      @BillyBonesYT 2 роки тому +1

      @@bustex1 what do you mean "what?" just read it again

    • @bustex1
      @bustex1 2 роки тому +4

      @@BillyBonesYT read it and watched the first 30 seconds five times. Happened at like 34 second mark not first 30 seconds. What.

    • @athe5217
      @athe5217 2 роки тому +2

      He's just too good. Somebody stop this man

    • @bigo975
      @bigo975 2 роки тому

      Clumsy=Linus

  • @moremaddness
    @moremaddness 2 роки тому

    I love these server tech videos! Keep them coming guys!!!

  • @lasthopelost9090
    @lasthopelost9090 2 роки тому

    Good job you guys getting a telus sponsor thats pretty big

  • @ayen0nymous
    @ayen0nymous 2 роки тому +136

    I kinda had a feeling this man was able to look into the future.

    • @thegamera6963
      @thegamera6963 2 роки тому +2

      Yep

    • @WayStedYou
      @WayStedYou 2 роки тому +3

      Why does he keep dropping stuff then

    • @philsburydoboy
      @philsburydoboy 2 роки тому +23

      @@WayStedYou Dropping stuff is required to look into the future

    • @Sithhy
      @Sithhy 2 роки тому +14

      That's the downside of being able to look into the future

  • @guspaz
    @guspaz 2 роки тому +333

    LTT: We just had a massive storage failure where data checksums were critical to recovery.
    Also LTT: Let's switch to this new RAID system that has no data checksums!

    • @88porpoise
      @88porpoise 2 роки тому +48

      Well the server that had the issues would have a completely different use case than this server.
      The failure was on a long term archival storage server using HDDs. This type of server would be used for short term storage of ongoing work on SSDs.
      So, what they are discussing here uses more reliable equipment in a situation where any error would almost certainly be detected extremely quickly and relies on high transfer speeds and much more expensive storage.

    • @konzo5942
      @konzo5942 2 роки тому +20

      this is block level only, so use a checksumming filesystem? a bit unfair to compare a filesystem to a raid only software.

    • @kommentator1157
      @kommentator1157 2 роки тому +7

      @@konzo5942 The nice thing about zfs (and btrfs) is that they can detect corruption within raid pools and AUTOMATICALLY CORRECT it. That probably won't work with this setup as everything is exposed as one single drive. You will know something failed, but not which copy is correct and you won't be able to restore it.

    • @konzo5942
      @konzo5942 2 роки тому +7

      @@kommentator1157 a purely filesystem software that does checksumming is going to work to correct bit rot irrespective of the underlying hardware. Also it's less of an issue with SSDs which this is only going to be used for.

    • @Momi_V
      @Momi_V 2 роки тому

      @@konzo5942 not really. This solution (like most raid only systems) presents the pool as a single logical disk. The filesystem could do checksumming and tell you something is wrong, but I doesn't have the necessary information to correct it. This solution only uses the parity data if there is a read error, regardless of whether the data from a particular drive is correct, because the raid abstraction does not utilize checksumming. Wendel from L1 techs was able to corrupt the data easily during his tests (by inserting a discrepancy on one drive to simulate the random changes to the saved values due to bitrot) and because the drive didn't report an error it was not detected. ZFS on the other hand caught and corrected the same scenario. I agree this is not a huge issue for short term live data, but if there are no protections, such discrepancies could find their way into the backups and archives because they were not detected/corrected

  • @tibr
    @tibr 2 роки тому +559

    I wonder if this would be possible to do with any GPU with custom firmware. Would be a cool purpose for spare GPUs...

    • @635574
      @635574 2 роки тому +115

      In b4 nvidia makes this a software feature and obsoletes this thing. Probably doesn't even need to buy them to kill them.

    • @firefly2472
      @firefly2472 2 роки тому +80

      Spare gpu's.
      HOW DARE YOUUUUUUU

    • @doggo_woo
      @doggo_woo 2 роки тому +68

      @@firefly2472 I'm sure they're talking about 10 year old cards

    • @firefly2472
      @firefly2472 2 роки тому +11

      @@doggo_woo I know :)
      Have a few myself.
      And no, not gonna sell them :p

    • @doggo_woo
      @doggo_woo 2 роки тому +8

      @@firefly2472 Gotta collect em all lol

  • @actng
    @actng 2 роки тому +3

    linus: with these enterprise drives, they're not likely to fail
    jake: they usually all fail at the same time
    :D

  • @mkusanagi
    @mkusanagi 2 роки тому

    These are my favorite types of videos on this channel. Crazy stuff, thanks

  • @UntouchedWagons
    @UntouchedWagons 2 роки тому +19

    That's actually really cool. I'd love to see a 3090 or that super top of the line A1000 run the software raid stuff.

  • @kernelpickle
    @kernelpickle 2 роки тому +68

    The part of this whole concept that I find most interesting is the fact that someone basically found a useful way to repurpose old GPUs that would otherwise be eWaste. Someone that’s into farming Chia might find something like this useful as well, so there’s still a way to earn some crypto with it.

  • @AgentSmith911
    @AgentSmith911 2 роки тому +52

    I love that Linus is still mega hyped about tech even after all these years 😀

  • @alecdonaldson6272
    @alecdonaldson6272 2 роки тому

    For a few minutes of this video, the server fan tone fit well with the key of the background music like a droning common tone. Enough that it distracted me while they were talking

  • @franksinatra2530
    @franksinatra2530 2 роки тому

    Loved the more technical aspects of this video :D

  • @raphaelsback
    @raphaelsback 2 роки тому +69

    Linus now: On these enterprise level devices it should be fine.
    5 years later: Yeah guys it failed and we didn’t see it through

    • @Brogboolius_Maximus
      @Brogboolius_Maximus 2 роки тому +5

      5 years of INCREDIBLY heavy, daily use.

    • @Qyngali
      @Qyngali 2 роки тому +1

      And no way to detect bit rot, unlike ZFS. Having backup of bit rot is kinda pointless. :P

  • @N54.S6
    @N54.S6 2 роки тому +53

    Two minute's in and linus is already dropping thing's. Absolute legend.

    • @Sithhy
      @Sithhy 2 роки тому +1

      Even less than 2 minutes; more like 40 seconds

  • @uncle-ff7jq
    @uncle-ff7jq 2 роки тому +12

    Seems like an exciting step in making alternative hardware accelerators common place in systems. It's wild to think that despite how far innovation has pushed the capabilities of modern gpus in terms of video encoding and rasterization, they are but one manifestation of hardware accelerators in a wide field with new opportunities coming from things like fpgas or asics.

    • @Naetrox
      @Naetrox 2 роки тому +1

      It's interesting because this is much like an echo of the past. In the 90s we had co-processors and such. Sound cards were also hip until everyone had their baked-in Realtek chip. We kinda went backwards and are now seeing the start of a boom of new accelerators, possibly due to the progress of performance improvement slowing down.

    • @uncle-ff7jq
      @uncle-ff7jq 2 роки тому

      @@Naetrox Good point, it doesn’t seem as viable to just throw more general compute at a problem. Instead better specified architecture provides much more real performance. I wonder if someday the almighty cpu might become a compute analog to a clock generator.

    • @Naetrox
      @Naetrox 2 роки тому

      @@uncle-ff7jq I'm holding out for quantum computers, I think we'll see adoption of them in a few decades as we figure out how to operate them at room temperature.

  • @trevorsmith470
    @trevorsmith470 2 роки тому +5

    For the Kioxia BG5, I'm surprised you didn't mention its application in the steam deck, as it uses M.2-2230 SSDs as well.

    • @technicavivunt
      @technicavivunt 2 роки тому

      I wish I could find one too. Seems like everywhere I look they’re still unavailable

  • @Mountain-Man-3000
    @Mountain-Man-3000 2 роки тому

    That wardrobe change though. Super high production quality!

  • @HapticNoise
    @HapticNoise 2 роки тому +69

    Yeahhhh gonna need you guys to either spoof or secure a license for that big boy card to see what would happen. That would be insane lol

  • @OfficialSamuelC
    @OfficialSamuelC 2 роки тому +10

    Gotta love the knowledge and expertise of Jake and the videos he does where Linus is a spectator. Jake’s skills are impressive, he seems to know everything!

  • @jbrown-acuity
    @jbrown-acuity 2 роки тому +104

    RAID originally stood for "Redundant Arrays of Inexpensive Disks"

    • @majorbogart3476
      @majorbogart3476 2 роки тому +48

      My experience has been "Risking All Important Data"...

    • @satakrionkryptomortis
      @satakrionkryptomortis 2 роки тому +22

      @@majorbogart3476 thats the lack of raid shadow legend..

    • @TechnoBabble
      @TechnoBabble 2 роки тому +2

      And it still means that if you compare any kind of RAID to a dedicated, proprietary storage machine in a datacenter.

    • @ILikeGoodMusic313
      @ILikeGoodMusic313 2 роки тому +2

      @@satakrionkryptomortis you could have not said that but you did it anyway

    • @jakeaustin901
      @jakeaustin901 2 роки тому

      @@majorbogart3476 yea, if RAID 0 and not any other form

  • @progammler
    @progammler 2 роки тому +1

    Since decades now memory transfers are accelerated with DMA (direct memory access) controllers. The CPU just sets the registers of that controller and the controller notifies the cpu when it has completed the transfers. In these extreme cases simply telling the DMA controller what to do is already demanding for the CPU. I'm guessing that they are simply offloading this to the GPU since it can set the DMA registers as well.

  • @hiltonvusi7483
    @hiltonvusi7483 2 роки тому

    I just bumped into one today and I can't believe that I am learning more about it today(all in the same day)

  • @88Xlmk
    @88Xlmk 2 роки тому +26

    I bought relatively cheap Kioxia SSD this month - Toshiba NAND and 4GB DRAM controller from Samsung. it was even cheaper than a lot of low end drives from Chinese manufacturers without DRAM. Its performance is pretty good, but I'm not much of storage purist.

  • @HrafnRaff
    @HrafnRaff 2 роки тому +7

    This is nuts. I know I'll never get to work on these kinds of projects, but man I'd love to. I have no need for it, I just want it lol Amazing stuff

  • @eldibs
    @eldibs 2 роки тому +306

    With the kind of airflow going through that chassis, would the RAID GPU card stay cooler if you took the shroud and fan off? Assuming the heatsink fins are oriented horizontally.

    • @Vatharian
      @Vatharian 2 роки тому +32

      From experience, there is no difference. A lot of bus cards, FPGAs, expanders and other PCIe appliances come in with a fan, so they can be put in a tower desktop, mostly for development purposes, but in general when you put it inside a server (especially in 1U or half-width 1U on dual node systems) it just doesn't matter.

    • @seldoon_nemar
      @seldoon_nemar 2 роки тому +2

      gotta remember that it's a positive pressure system in that thing so it's forcing air though those fins even with the integrated fan turned off. when it's on it's more boosting the speed over the server's insane baseline by helping air maintain speed. it's only ever going to be a single digit percentage diffrence

    • @eldibs
      @eldibs 2 роки тому +1

      Informative answers from both of you, thanks. I simply don't have rackmount server experience, and am happy to learn from those who do.

  • @CharlesAnjos
    @CharlesAnjos 2 роки тому +1

    nice F1 simulation at 18:10

  • @iamnickdavis
    @iamnickdavis 2 роки тому

    This is super exciting. Its awesome where storage is right now!

  • @gabrielhmi
    @gabrielhmi 2 роки тому +16

    This thing is sick. Could be a small revolution in scientific computing.

  • @HoshPak
    @HoshPak 2 роки тому +15

    I am looking forward to the day someone is releasing an open source driver accelerating storage with any GPU.

    • @trevorjex3146
      @trevorjex3146 2 роки тому

      This would be awesome

    • @trevorjex3146
      @trevorjex3146 2 роки тому +1

      @@Prophes0r I don't think that hardware getting more capable and more general purpose is ever a bad thing. If a TON of people start using features like this in the short run it could affect the supply chain. But honestly I don't think there'll be enough people using this that it'll affect anyone's ability to get a GPU. And honestly it just means your card you have can do more things. Why would that be a bad thing?

    • @Naetrox
      @Naetrox 2 роки тому

      @@nicekeyboardalan6972 Aight rich kid, just know if war comes, you'll be first to get eaten. That said, expensive GPUs make for half decent impromptu weapons. See you on the battlefield, come sit down for some soup and bread with us.

  • @Hobbles_
    @Hobbles_ 2 роки тому +18

    This was such a cool concept and video!I would love to see the open source community come up with their own solution of this! Please see what else you can do with this, and I await the videos that will relate to it!

    • @mbourd25
      @mbourd25 2 роки тому

      Hi @Hobbes, there is the mergers + snapraid combo of you want open source projects. That's what I use in my OpenMediaVault server.

    • @nullnull2128
      @nullnull2128 2 роки тому

      This!

  • @de_stroyed
    @de_stroyed 2 роки тому +1

    The TELUS Fiber sponsor talking-points were a little misleading because I live in a high-density area and the 2.5 Telus Fiber isn't here yet and hasn't been here for over 1-2years because I check every month and when I saw the sponsor message, I got excited because the message made it seem like it was rolled out everywhere now only to find out my area still doesn't have it. :(

  • @apPaulpie
    @apPaulpie 2 роки тому +1

    its not gonna be a LTT video without linus actually or almost dropping stuff... its kind of a tradition now

  • @sitedel
    @sitedel 2 роки тому +10

    The main interest of RAID for hard drives is the ability to hot swap any faulty drive on a running server.
    Could you test hot swap in this beefy configuration ?

  • @Buzzfly
    @Buzzfly 2 роки тому +158

    Surprised to hear them talking so positively about RAID 5 and dismissing RAID 10 as "expensive". Yes, you do lose half your capacity with RAID 10, but you get more performance, more resiliency, and importantly rebuilds are faster / less resource intensive. Rebuilding your array from a failed disk doesn't matter so much when all the drives are new, but when they're all end of life, the extra strain from a RAID 5 rebuild can cause a chain of failures, potentially causing a totally array loss. Coming from industry, I'd never deploy a RAID 5 array again, RAID 10 all the way. RAID 1 also has some good use cases.

    • @wobblysauce
      @wobblysauce 2 роки тому +14

      Rebuilding an array is the worst part of a process when you do get a failure.

    • @hicknopunk
      @hicknopunk 2 роки тому +3

      How do you feel about raid 6?

    • @88porpoise
      @88porpoise 2 роки тому +25

      He did specify that there are use cases for RAID 10, but it was severe overkill for the hardware/use case they were considering.

    • @giornikitop5373
      @giornikitop5373 2 роки тому +22

      the extra stress for raid5-6 etc while rebuilding, is more of a problem for the mechanical hard drives. ssd's, especially of that class, don't suffer the same drawbacks, only write wear matters, reads don't affect them. also due to much higher transfer speed, the rebuild will complete way faster. still, with a bit of patience and thinking, you can use a combination of different raid levels, that will fill the needs better...

    • @AllanSavolainen
      @AllanSavolainen 2 роки тому +1

      I prefer RAID 50 if you wanna go with the mirroring route.

  • @jestersheep9647
    @jestersheep9647 2 роки тому +7

    The T400/600/1000 line of GPUs are underrated gems. Tiny little powerhouses in an otherwise completely screwed GPU market!

    • @mycosys
      @mycosys 2 роки тому +1

      Amazes me nobody knows about the T400, low profile, full Ampere NVenc/dec in effectively the 1630 that never happened for $150 US, in this market its a great card for HTPC/Encode servers/plex/streaming etc etc

  • @lubu602
    @lubu602 2 роки тому

    i love whenever you guys work on server stuff. just absolutely top-tier stuff

  • @i_am_macgyver84
    @i_am_macgyver84 2 роки тому

    Love the video. While I've never ran anything greater than Raid 1, between your channel and others I have been running Unraid for almost 2 years. Yes I know there are pro's and con's of both, but at this time Unraid has been great for me needs.

  • @gamebrigada2
    @gamebrigada2 2 роки тому +47

    This is like the opposite of ZFS in every way. ZFS is like "ecc for resiliency on top of hashing everything"! Graid be like "speed!!!!". It'd be interesting to see how much data corruption would happen on one of those in a real world heavy write workload.

    • @timsmith3743
      @timsmith3743 2 роки тому +9

      While I agree, you response may lead a novice reader to mistakenly believe ZFS protects against corruption, when infact it an be the opposite.
      - The hash in ZFS detects corruption, can't actually be used to recover data
      - ZFS has next to zero protection against bitrot
      - ZFS can't detect errors introduced by the host, so ECC is critical at all layers, RAM. ie: Don't run ECC on cheap hardware, overclock ect.. as errors introduced on the host will get written to the ZFS and NOT detected.
      ZFS is perfect to host VMs but the ZFS server itself should never be virtual due to higher risk of corruption.
      So while ZFS is about as good as you can get in the enterprise, due to the extreme robustness, ease of recovery and tons of features. Running it on consumer hardware introduces a lot more risk over other filesystems and will generally perform poorly without a crap ton of memory.

    • @gamebrigada2
      @gamebrigada2 2 роки тому +7

      @@timsmith3743 ZFSs protection against bitrot is literally a focus in it's initial design. If your pool is using raidz, ZFS not only protects from bit rot, it eliminates it in real time. The hash that ZFS stores with every write, and the parities of your pool config allows ZFS to determine which version of data is correct and only return that data. Not only does ZFS protect against bit rot, it also protects against file corruption.
      ECC is recommended for ZFS systems because it's the only part of the system that is not protected against corruption. ECC protects the data while it is processed by ZFS.

    • @timsmith3743
      @timsmith3743 2 роки тому +3

      @@gamebrigada2 , ZFS detects bit rot, but can only perform the bitflip if a replica exists. To understand your risk, you need to review the results of the scheduled scrubs and often need to replace the lost data where it can not be repaired automatically.

  • @SkillisForNoobs
    @SkillisForNoobs 2 роки тому +4

    We need a continuation making it work with other GPUs

  • @Je-kg8up
    @Je-kg8up 2 роки тому +46

    My prediction for the future- this type of card will quickly be obsolete and become integrated into CPUs or motherboards. This is a PhyX card for storage. They might continue to exist for servers though.

    • @RandomnessCreates
      @RandomnessCreates 2 роки тому +11

      Perhaps, but it's using GPU Compute at 100% and I don't think it'll be in CPUs anytime soon since it seems to be very much an enterprise solution. It might be compared to like a PhysX card but this is more akin to using a dedicated GPU for tensor applications.

    • @Finder245
      @Finder245 2 роки тому

      If there is a market for this, AMD and Intel will integrate it into their CPUs in a more refined way.

    • @mariuspuiu9555
      @mariuspuiu9555 2 роки тому +4

      i can see RISC type chips made specifically for this task becoming popular.

    • @jameslake7775
      @jameslake7775 2 роки тому +8

      "This type of card" is just a GPU. There doesn't seem to be any special fixed-function hardware or special firmware as explained, It's just offloading what the CPU would do onto what's effectively a GTX 1650 with the TDP pared back to fit under a smaller cooler. Integrating it into CPUs would just be doing GPU compute on the iGPU.
      For home users, the processor overhead isn't that high anyway. For servers there isn't an iGPU to offload on, and even if they did add one, it would be fighting the main CPU for die space and power budget where an add-in card would not.

    • @Finder245
      @Finder245 2 роки тому +3

      @@jameslake7775 chiplets change this equation slightly. AMD could put a dedicated RAID accelerator on the I/O die of Epyc without affecting the rest of the products.

  • @takehirolol5962
    @takehirolol5962 2 роки тому +4

    Linus, you are an insider and the number one Tech channel, of course you knew...

  • @ivanevans2820
    @ivanevans2820 2 роки тому

    The energy in this video is the best

  • @ImLunaUwU
    @ImLunaUwU 2 роки тому +27

    We didn't even have to wait a minute before Linus almost dropped it.

  • @Aaron_Jensen
    @Aaron_Jensen 2 роки тому +6

    Hello and welcome to another fine installment of Linus loves ridiculously awesome storage solutions.

  • @AtomusGuy
    @AtomusGuy 2 роки тому +6

    "Compared to the documentation of anything Microsoft" I felt that Jake, I felt that

  • @Thehoeh
    @Thehoeh 2 роки тому

    Looking good, Jake. Keep it up!

  • @insnprsn
    @insnprsn 2 роки тому +21

    You should run some tests with degraded RAID5, see what really happens with CPU utilization at that point. Expect it'll still offload to the GPU. Or a fully degraded RAID6 (two disks failed)

    • @richlee91
      @richlee91 2 роки тому

      Based on the diagram, in that read does not go through the GPU. I would expect it to hit the CPU. That's a great question.

  • @biggestballer9206
    @biggestballer9206 2 роки тому +4

    0:34 Linus drop this strikes again

  • @karehaqt
    @karehaqt 2 роки тому +33

    IBM and Nvidia are working on a much better version of this concept, enables a GPU to connect directly to a computer's SSD to bypass the CPU completely.

    • @karehaqt
      @karehaqt 2 роки тому +3

      @@marcogenovesi8570 Will this be open sourced like IBM/Nvidia plan to do with what they are doing?

    • @Rokkprojekk
      @Rokkprojekk 2 роки тому +10

      @@karehaqt does Nvidia have any open source products?

    • @eabelcourt
      @eabelcourt 2 роки тому +6

      This system is completely a different use case to what Nvidia recently announced with IBM. What Nvidia-IBM are making are something akin to DirectStorage where pulling dataset blocks from storage for number crunching/training are quite slow going via the CPU so like MSDS is cutting out the middle man.
      What this GRAID system is doing is using a relatively inexpensive workstation card (stability etc) to be the write target for the disk are so it can use the massive amount of mathematical capability of the GPU cores to calculate parity data which is pure math of block A + block B = block C and if you were to lose either A or B you could get the missing data back because you have 2 parts of the 3 sided equation.
      In short, it's just using the Nvidia card as a write accelerator which is pretty impressive and am also a little surprised this hasn't been posited before now.

    • @karehaqt
      @karehaqt 2 роки тому

      @@marcogenovesi8570 The software is what I was implying, not the hardware.

  • @davidbronke5484
    @davidbronke5484 2 роки тому +12

    "This server from Gigabyte handles all that through a backplane here in the front of the chassis."
    Wouldn't that be a "frontplane" then? Har Har.

    • @VitalVampyr
      @VitalVampyr 2 роки тому +1

      It's in the back of the front.

    • @acojo8205
      @acojo8205 2 роки тому +1

      You see, David, this is why your mom left

  • @m4ttendo
    @m4ttendo 2 роки тому

    Love your videos I'm addicted to them love the t-shirt swap at 15:30 on timeline 🤣

  • @emt56399
    @emt56399 2 роки тому

    Im exited to see the next video on this.
    Very exciting results

  • @timsmith3743
    @timsmith3743 2 роки тому +3

    The disk load should ideally be created on another system, as it's likely a decent % is used by the benchmark took, to produce the output. As performed, you can't estimate the CPU impact.

  • @mattcandy
    @mattcandy 2 роки тому +4

    Wow, on a RAID 5 getting 30+GB/s with barely any CPU usage is insane! This card is definitely going to help us all in the DC! Edit: 6.5M IOPS?! Whooaaa

  • @RobinDale50
    @RobinDale50 2 роки тому +4

    But hardware raid has one huge, show-stopping (at least for me) drawback: If the RAID *controller* goes out, your need the EXACT same chipset and version, for the most part, in order to access your drives again. Any deviation and it will not see the data, unless things have changed significantly in recent times. Software raid wouldnt suffer from this, since if the hardware (or windows/linux) host dies, you can just stick the drives in another computer and as long as you install the same software, it should work.

    • @chedatomasz
      @chedatomasz 2 роки тому +3

      This seems very solvable. This solution seems to just be a cuda-capable software raid, only bundled with a gpu it's been validated with. Barring the license, you should be able to swap the hardware for anything you want if it's capable in regard to cuda versions

  • @bencove717
    @bencove717 2 роки тому

    Love these videos, so cool!! Aslo explaining everything that is happening and how is fantastic, even if you don't really understand, linus and team will talk it through so it's understandable to everyone, great job 👍🏻

  • @natasmanonfire007
    @natasmanonfire007 2 роки тому

    I don't know crap about what they are talking about but I really enjoyed seeing how pumped they were about what was going on.

  • @aidengohlke9713
    @aidengohlke9713 2 роки тому +4

    I kind of really want to see this on something like an RTX 3090. Probably wouldn't work, but imagine if it did.

    • @chedatomasz
      @chedatomasz 2 роки тому

      3090 is cuda capable and afaik has a compatible cuda version, so barring the device version lock it should work.

    • @aidengohlke9713
      @aidengohlke9713 2 роки тому

      @@chedatomasz I see. I'd assume the (probably) massive differences in whatever the hardware equivalent of an API is might make it a bit more difficult than a simple lock removal, though.

  • @jpmrblood
    @jpmrblood 2 роки тому +4

    A modern filesystem like ZFS has its own RAID-like function and it's advised that you don't use any RAID card and expose the drives directly to the filesystem.
    And from the video, it seems it has LVM-like function.

  • @1981AdamGs
    @1981AdamGs 2 роки тому +15

    Not going to lie, I found Jake incredibly annoying when he first started. But now the videos with Jake and Linus are my favorite videos. Those two have found a really nice chemistry.

    • @chocolate_maned_wolf
      @chocolate_maned_wolf 2 роки тому

      yeah they kinda cute ngl 🥴

    • @sune9578
      @sune9578 2 роки тому +1

      Agreed. I went back to a few older videos just to see what changed and it seems that he's definitely mellowed out a lot. They've had this "close friends" type relationship for awhile but I think Jake might've been overdoing it for the camera back then. Seems like he's a lot more comfortable now.

    • @chocolate_maned_wolf
      @chocolate_maned_wolf 2 роки тому +1

      @@sune9578 gay erasure

    • @sune9578
      @sune9578 2 роки тому

      @@chocolate_maned_wolf Excuse me. I think it is you that is doing the erasing of the gay.

    • @chocolate_maned_wolf
      @chocolate_maned_wolf 2 роки тому +1

      @@sune9578 ok boomer 🤓

  • @Nobe_Oddy
    @Nobe_Oddy 2 роки тому

    FRIKKIN AMAZING!!!! - Thanks for bringing 5this mindbending tech to our attention!! :D - Wendell is gonna LOVE THIS!!!!

  • @iTzBrillianTFX
    @iTzBrillianTFX 2 роки тому +1

    You just gotta love Jake's laugh - even if he remembers me to the grumpy Jake of Two and a half men (8. Seasons). 🤭

  • @relims
    @relims 2 роки тому +5

    "This only runs on Linux server operating systems"
    Me: Yes!
    "So we are running Ubuntu Server 20.04 LTS"
    Me: Ubuntu? Noooooo

  • @octa8992
    @octa8992 2 роки тому +4

    Yes Linus, you indeed called it...

  • @mikejakubik
    @mikejakubik 2 роки тому +6

    Meh, I'll take ZFS with NVMe drives instead. Plenty of performance, low CPU overhead and excellent data integrity. TrueNAS would work just fine on that server.. Pull the power cord out while you're running that benchmark, let's see how it handles recovery.

  • @SomethingSomethingAirsoft
    @SomethingSomethingAirsoft 2 роки тому

    I love how that G710+ has hung around for so long. I bought mine like a week before your video covering it came out.

  • @Garbimba1900
    @Garbimba1900 2 роки тому

    Man, the noise at 18:03! I don't miss the server room noise which this reminded me of. Geez, its really working!

  • @bayanzabihiyan7465
    @bayanzabihiyan7465 2 роки тому +5

    It's crazy how even a little bit of GPU acceleration can impact a "high throughput" application like this.
    Frankly, you'll eventually be bottlenecked by DDR4 memory bandwidth.
    HBM CPUs anyone?

    • @RobertSmith-lh6hg
      @RobertSmith-lh6hg 2 роки тому +1

      We already are bottlenecked by it tbh.

    • @DigitalJedi
      @DigitalJedi 2 роки тому

      Octa-channel ddr5 will be interesting for bandwidth. I would also like to see some HBM3 CPUs. It wouldn't be out of the question for somebody to cram 16 or 32gb on a package and still have lot of space for a CPU left in there.

  • @dragofand
    @dragofand 2 роки тому +8

    I've heard tape drives are still around as a backup because while slow, they are super cheap. Would you guys ever do a video on those?

    • @TheCrazyCanuck420
      @TheCrazyCanuck420 2 роки тому +1

      With more and more people running network storage I'm surprised tape drive backups are not more common.

    • @VitalVampyr
      @VitalVampyr 2 роки тому +3

      They made a video on that years ago.

  • @NeoNeoNeo
    @NeoNeoNeo 2 роки тому +4

    "redundant array of independent disks" has a k in disks, not a c, as in "Hard Disks". Disc with a "c" is used to refer to optical media like Compact Discs or DVDs.

    • @johnschroeder3072
      @johnschroeder3072 2 роки тому

      Thank you. I was hoping someone else noticed that.

  • @rileymannion5301
    @rileymannion5301 2 роки тому

    Man I was not expecting telus as the sponsor! That's a really big company

  • @TheRossMadness
    @TheRossMadness 2 роки тому

    It's nice to see the Level 1 Techs merch on display.

  • @ChristopherCobra
    @ChristopherCobra 2 роки тому +4

    I just got a glitch in the matrix. All the comments disappeared.

  • @yeapthatsme2982
    @yeapthatsme2982 2 роки тому +23

    Welcome to another episode of things I won't buy as I can't afford thanks to Nvidia.

  • @MrMartinSchou
    @MrMartinSchou 2 роки тому +9

    Anyone taking bets on how long it'll take for an open source version of this software to show up?

  • @IBETA7
    @IBETA7 2 роки тому

    I think that telus ad was the first canadian targetted ad I've seen in a long time on this channel

  • @eTiMaGo
    @eTiMaGo 2 роки тому

    I just want to say thanks for introducing me to Termius, was looking for something a bit more modern than MobaXterm :D