Fastest Storage Possible: SPDK & P5800X Are More Like Memory than NVMe

Поділитися
Вставка
  • Опубліковано 24 гру 2024

КОМЕНТАРІ • 119

  • @starluxstudio619
    @starluxstudio619 3 роки тому +65

    If this is still level one, I'm pretty scared of the what the level 2 boss will look like.

    • @hookback
      @hookback 3 роки тому +4

      Level 2 comes with a mullet.

    • @craig_s_bell
      @craig_s_bell 3 роки тому +2

      You are not ready for Level2Techs ua-cam.com/video/chL2fBZUh8c/v-deo.html

    • @neurosync_x
      @neurosync_x 2 роки тому +1

      The level2 boss lives in a junk yard of computer parts that you get sent to in person. He has helper minions that chase you, and you can only kill them in VR, so you have to search the junkyard for parts to build a VR capable PC from scratch; soldering parts, building custom cables, daisy chaining battery cells charged by a diesel engine to create a stable power supply; everything. It's a lot.
      Once you kill the minions in VR, you have to use the PC to code a neural network that will generate the weapon needed to kill the boss.
      No one ever gets enough training data for the neural network. That's why we're still at level1.

  • @GroundGame.
    @GroundGame. 3 роки тому +74

    When Linus has a crazy project, you call in "Special Server Forces": Wendell. 😉

    • @kalervonakki2527
      @kalervonakki2527 3 роки тому +7

      Linus is just trash level clickbait these days. Forget him.

    • @GroundGame.
      @GroundGame. 3 роки тому +4

      @@kalervonakki2527 yeah, his recent click bait is getting rather obnoxious these days.

    • @iQKyyR3K
      @iQKyyR3K 3 роки тому +2

      @@kalervonakki2527 sure, but if he even gets a dozen people or so into more specialized stuff it was worth the trouble.
      Different audiences, different presentation style, same interest, same goal
      Though I would prefer it if they'd publish their test data and methodology in text form somewhere... like you've got the data, you've got all the shit already written up. Just let me read instead of watch it.

    • @kalervonakki2527
      @kalervonakki2527 3 роки тому +1

      @@iQKyyR3K I would be happy if they would just clearly say the product name or what the content is about in the video title.
      I feel like they(and many others like lts) don't really care about their viewers at all anymore. Keep the thumbnails but just give me some useful information at least. I'm sure they work for the intended audience. But sadly, they are part of the problem..

    • @jonkoops
      @jonkoops 3 роки тому +3

      @@kalervonakki2527 absolutely this. I really don't mind the presentation style, but the clickbait titles with the waaay to over the top and non-descriptive thumbnails are just in poor taste

  • @rujigo69
    @rujigo69 3 роки тому +63

    This is video is one of those that make you actually think if you really know computers lol

    • @SirReptitious
      @SirReptitious 3 роки тому +12

      While I have 30 years experience building/maintaining/troubleshooting desktop PCs, I will freely admit that my knowledge of enterprise computing is microscopically small. But I still watch these kinds of uber-high-end IT videos with fascination. It's like tech porn to me. ;-p My main system is so old that I am still using SATA SSDs and HDDs for storage, yet I still feel it is plenty fast enough for my needs. ;-)

    • @MaxUgly
      @MaxUgly 3 роки тому +4

      @@SirReptitious I have about 20 years doing the same for myself and friends. Videos like this have inspired me to start studying for some certifications. A+ seems pretty simple but I really want to get my CCENT and I am realizing how little I know about enterprise and networking stuff!

    • @xbox360Rob
      @xbox360Rob 3 роки тому

      @@SirReptitious you haven’t tried one that’s faster

    • @SirReptitious
      @SirReptitious 3 роки тому

      @@xbox360Rob That's true. My AM3+ mobo doesn't support NVMe drives(yes, I know they can be added via PCIe cards in x8 and x16 slots). But MANY people before me have said that the difference between using a system with HD and SATA SSD is much larger than between SATA SSD and NVMe. Even though NVMe 4.0 can be like 12x faster than SATA in sequential copies, that is not the normal operating pattern of a normal PC. Last year I built a new Ryzen 5 2600 system for a friend, and installing windows & office, copying over his old files, and generally configuring and optimizing it for him felt only a little faster with the NVMe in his system versus the SATA in my system.

  • @Psychx_
    @Psychx_ 3 роки тому +4

    Wendell is on an uploading spree. I love it!

  • @AdrianDucao
    @AdrianDucao 3 роки тому +8

    I've downloaded most of Level1Tech's videos and some other youtubers and archived in on my server so even when after WW3 or any other apocalypse ruined this g forsaken planet at least we can still preserve some knowledge

    • @monsterous289
      @monsterous289 3 роки тому +1

      Pair it with some basic research papers and you're good to go

    • @AdrianDucao
      @AdrianDucao 3 роки тому +1

      @@monsterous289 good idea... imma start hoarding some research papers and pdf books

  • @GlennBerrySQL
    @GlennBerrySQL 3 роки тому +8

    Another great video from Wendell!

  • @theWanAndOnly
    @theWanAndOnly 3 роки тому +7

    Loving the deep dives. Thanks for sharing!

  • @titaniummechanism3214
    @titaniummechanism3214 3 роки тому +7

    Exciting times to be into computers! I'm starting my first job in that space soon and I can already tell that a lot is going to change and evolve over the next couple years with ever higher demand and serious competition going on now. I'm personally not that into enterprise hardware, but I like big numbers and I appreciate big computing power!

  • @Prophes0r
    @Prophes0r 2 роки тому +2

    It genuinely saddens me to think back to this time when we were all so amazed by Optane, and so hopeful for how it would change everything.
    3DXPoint was SUCH a good tech. But we don't get to have nice things because the marketing department at some NAND flash companies convinced the world that big numbers from Q64T64 are what consumers should care about.
    If only the general public knew just a little more. If only they bought a few more Optane drives. Just enough to see the price steadily drop from economics of scale.
    We could all have SSDs that a normal user is incapable of using up, with 10x more iops per chip, and latencies so fast that most software will just report 0.0μs.

  • @osgrov
    @osgrov 3 роки тому +4

    I'd love to hear much more about SPDK - hope you'll make a deep dive on that soon. :)

  • @samgao
    @samgao 2 роки тому +1

    I have a 905p as my boot drive. It’s not the fastest boot, but jeezus everything launches like it was nobody’s business

  • @DragonTamerCos
    @DragonTamerCos 3 роки тому +11

    This is phenomenally exciting aaa

  • @skybuck2000
    @skybuck2000 3 роки тому +1

    Do a read and write test at the same time, to see how this device performance under that condition/scenerio.

  • @TravisHershberger
    @TravisHershberger 3 роки тому

    Steve Gibson is finding that flash drives can have huge performance differences depending on where the data is located in the drive as well. I'm confident that will hold true with NVMe as well. Because nothing can ever be easy.

  • @drportland8823
    @drportland8823 3 роки тому +12

    How do you do no locks when you are doing writes? I obviously have some reading to do.

    • @jamegumb7298
      @jamegumb7298 3 роки тому +1

      Zoned Name Spaces is one method iirc.
      I have to really read up on it though. It is still very new.

    • @ABehrooz
      @ABehrooz 3 роки тому +1

      Look at the lockless google group for actual code samples.

    • @GeekProdigyGuy
      @GeekProdigyGuy 3 роки тому

      as long as you have enough memory you can ensure that all new writes don't go in the same place as any old writes.

  • @johnkristian
    @johnkristian 3 роки тому +1

    I think I love you, Wendell

  • @jimiscott
    @jimiscott 3 роки тому +2

    Spinlocks are not constrained to linux....it's a common method for handling multithreaded operations. Instead of the consumer/producer waiting and then locking for the other....they spin (do nothing) for a very small amount of time, as it's expected after the spin there will be data to consume/be able to write to write to the resource/queue/etc.

  • @Mallchad
    @Mallchad 3 роки тому +3

    These storage engineers at Intel are doing gods work right now.
    And I don't even have the PCIe lanes to keep up!

  • @embersdestiny
    @embersdestiny 3 роки тому +11

    Whats above a hyper-scaler a Hyper-ulta-super? I had nothing to add to this video but it was great :)

  • @johngogo17
    @johngogo17 3 роки тому +12

    I didn't catch it: Did Wendell ever sign out? Also, where can I find him?

    • @Onihikage
      @Onihikage 3 роки тому +1

      He signed out very quickly at 14:50 and then got distracted again. It's kind of amazing.
      "i'mwendellthisislevelonei'msigningoutyoucanfindmeattheleveloneforums"

    • @johngogo17
      @johngogo17 3 роки тому +2

      @@Onihikage I totally understand, I was just foolin' since he said it twice lmao
      I love Wendell and could totes listen to him for hours even with most of it going over my head lol All just a bit of fun!

  • @Ang3lUki
    @Ang3lUki 3 роки тому +3

    I wonder if there will be a shift to main memory having speed instead of capacity, and the main working capacity would be 3d Xpoint

  • @brianeckley4388
    @brianeckley4388 3 роки тому +1

    Okay, you have officially reached God tier I.T. Wow.

  • @ianranson3570
    @ianranson3570 3 роки тому +1

    Excited for Wendell to become the new Allyn Malventano! Definitely missing good storage reviews

  • @bertnijhof5413
    @bertnijhof5413 3 роки тому +2

    I think, I run into a somewhat comparable problems with IOPs and latency on my own potato. My hardware is a Ryzen 3 2200G; 16GB DDR4 (3000MHz); 512GB Silicon Power nvme-SSD (3400/2300MB/s). I run Ubuntu 21.04 on OpenZFS 2.0 with L1ARC

    • @tanmaypanadi1414
      @tanmaypanadi1414 3 роки тому

      I don't understand much but I am commenting so I get notified if someone reply's to this 🙂

  • @MegatronAngel
    @MegatronAngel 3 роки тому

    Awesome information, thanks!
    Also for our edification, when creating the test suite mentioned at the end of your video please include RAM drive I/O comparisons. Right, with 256GB of RAM and 256GB NVMe being so fast and so cheap using the two for system or application execution environments are interesting to say the least. :)
    PS: I really hope said test suite is available for DL. :D

  • @kelownatechkid
    @kelownatechkid Рік тому

    RIP optane. Love them, use the 380GB 905P as my boot drive and have one in most of my servers. Hopefully I can upgrade to one of these in a few years lol

  • @michaelrichardson8467
    @michaelrichardson8467 3 роки тому +3

    I really am excited for optaine. I hope Intel can keep it going and get it adopted more. Someone needs to compete with Samsung

  • @AI-xi4jk
    @AI-xi4jk 3 роки тому

    Great video and analogy with zero copy. Hats off to Intel for messing with the kernel.

  • @jameskurian6914
    @jameskurian6914 2 роки тому +2

    So much for Optane :(

  • @bw_merlin
    @bw_merlin 3 роки тому +2

    Any chance of working with Linus again and seeing if you can get that server going with SPDK?

  • @ReQuiem_2099
    @ReQuiem_2099 2 роки тому

    So now that this is likely the best 3D Xpoint drives we'll ever see, what workloads/scenarios do you see these best utilized when scooped up off eBay?

  • @tommihommi1
    @tommihommi1 3 роки тому

    Nice to see these developments, basically a necessity for CXL working at some point

  • @davidgrant5245
    @davidgrant5245 3 роки тому +1

    THE BADGER??

  • @fullysilentpcs
    @fullysilentpcs 3 роки тому

    Fascinating stuff!

  • @MsHojat
    @MsHojat 3 роки тому +1

    I want to see someone run a PC with as little memory as possible (like 1-2 GB; maybe less), with just a somewhat fast SSD (probably nothing crazy like this P5800X) operating for the page file and/or as a readyboost file (I'm not sure if the Readyboost gives any benefit over a page file or what).
    Like some of these cheap Optanes have 32 GB of memory on them themselves. I presume that's really garbo memory but still it would be interesting to see how it responds.
    I feel like it could potentially be a pseudo-viable solution for certain people on a budget or something (at least if they had some sort of niche case where they needed a lot of memory on a cheap system). Well actually, that's not really something I think is possible, but rather I just want to see how such a setup would perform.

  • @robertotomas
    @robertotomas 3 роки тому

    I have an interesting test… almost funny really. Some maps on cities skylines have many tens of gigabytes of data, across many thousands of assets. When you start the game you load the map… there is a loading screen mid to gather details on what is loading when, you might have to turn that off for best performance… but seeing how long it takes for the game to become playable on initial load on such a map would be a test

    • @tanmaypanadi1414
      @tanmaypanadi1414 3 роки тому

      basically city skylines with mods on steroid .

  • @sasuke671
    @sasuke671 2 роки тому

    How do you fit the p5800x in the pcie gen 4 slot below the gpu slot on my motherboard?

  • @EyesOfByes
    @EyesOfByes 3 роки тому +1

    I wonder what 3DXpoint on PCIe 5.0 paired with HBM2 can do. And Perstistent Memory of course 😁

    • @Patrick73787
      @Patrick73787 3 роки тому +1

      3rd gen Optane Persistent Memory (Crow Pass) will be compatible with DDR5 memory slots and ship with Sapphire Rapids CPUs next year. Intel will very likely make a 3rd gen Optane PCIe 5.0 SSD as well.

    • @exilonone
      @exilonone Рік тому +1

      @@Patrick73787 Unfortunately not anymore.

    • @Patrick73787
      @Patrick73787 Рік тому

      @@exilonone Yes, Optane is dead unfortunately.

  • @_Randwulf
    @_Randwulf 3 роки тому

    What frameless monitor is showing the 15 million IOPS ?? 👍😎

  • @KarlMeyer
    @KarlMeyer Рік тому +1

    I wish you still shot your videos at 60FPS

  • @johnkristian
    @johnkristian 3 роки тому

    THIS is good material!

  • @theownmages
    @theownmages 3 роки тому +1

    Can you get SPDK to work on regular Samsung NVME SSD's ?

    • @TheSilviu8x
      @TheSilviu8x 3 роки тому

      Spdk is meant to be open source, so it's a matter of time it became mainstream.

  • @StephenMcGregor1986
    @StephenMcGregor1986 3 роки тому

    Didn't the Level1Techs news mention something about a new theoretical technology called Dynamic Flash Memory? This would be great with helping to reduce latency :-)

  • @pkt1213
    @pkt1213 3 роки тому

    Videos like this make me realize how much I hate my organization sometimes (I love my job). I am fighting to replace a Dell R820 with dual 4617 and no real oboard storage. The 5900x I just built is so much better.

    • @pkt1213
      @pkt1213 3 роки тому

      Trying to get a dual epyc and 4-8tb of NVME because delivering rasters takes a lot of space.

  • @doxydoxdelamanca9902
    @doxydoxdelamanca9902 3 роки тому

    Did you tell Linus?

  • @rocketr2
    @rocketr2 3 роки тому

    Wendell enough with the mumbo jumbo, I need to know if the P5800x will make my system feel like when I went from HDD to SDD ? I have a 11900K system and I need it to be snappier and instantaneous. NVME is not doing it for me.

  • @GooberBrainTrollingCorp
    @GooberBrainTrollingCorp 3 роки тому

    This didn't pertain to me but it was pretty interesting to watch

  • @lanklaas11326
    @lanklaas11326 3 роки тому

    How does 80 mil iops compare to mainframe performance?

  • @nikolaj5054
    @nikolaj5054 3 роки тому

    Nice, had not heard about spdk

  • @tudalex
    @tudalex 3 роки тому

    We need more Cat Tax!!!! @TechTechPotato knows how to do it!!

  • @LampJustin
    @LampJustin 3 роки тому

    Wow this is nuts! 🤩

  • @mochikanin1000
    @mochikanin1000 3 роки тому

    the smartest guy i have ever met

  • @titaniummechanism3214
    @titaniummechanism3214 3 роки тому

    0:10 He said "share", but what he meant was "brag".
    I'm not jealous. You're jealous!

  • @zeusde86
    @zeusde86 2 роки тому

    if you want to test an ssd that does bog the system down, try a kioxia exercia 480gb 2.5". by far the worst ssd i've ever encountered.

  • @ViniciusMiguel1988
    @ViniciusMiguel1988 3 роки тому

    SPDK will be available on desktops or only on server hardware?

    • @Patrick73787
      @Patrick73787 3 роки тому

      It is Linux and ARM exclusive for now (being desktop or server).

  • @Chris_miller192
    @Chris_miller192 3 роки тому

    Why would storage ever need to be faster than main memory?

  • @dunastrig1889
    @dunastrig1889 3 роки тому

    Woot!

  • @b2bb
    @b2bb 3 роки тому

    Nvme _engagement_

  • @benjamintrathen6119
    @benjamintrathen6119 3 роки тому

    C'mon Intel, gimme that P5800X!!

  • @cheesefries7436
    @cheesefries7436 3 роки тому

    Neat!

  • @Spacefish007
    @Spacefish007 3 роки тому

    Intel should just support io_uring instead of making there own shit SPDK fork

    • @kelownatechkid
      @kelownatechkid Рік тому

      It's funny because they did/do and even send Jens (the io uring dev) some optane drives like the ones from this video lol

  • @marcasswellbmd6922
    @marcasswellbmd6922 3 роки тому

    God Wendel is so smart.. All I can do is build a PC and optimize it and Windows 10.. LOL.. I can't do what Wendel does.. And I'm pretty Techie, I work work the Cable company.. I never got into Lenox or trying to write my own programs. Thats just way above my pay grade, but I still like watching his stuff..

  • @andljoy
    @andljoy 3 роки тому

    Work more on this stuff intel and leave the CPUs to the people who know what they are doing :)

  • @philosoaper
    @philosoaper 3 роки тому

    "I just wanted to brag".. lets be honest..

  • @EyesOfByes
    @EyesOfByes 3 роки тому

    So....When are you gonna jerryrig that P5800X into a PS5? 😁

  • @CoreQ
    @CoreQ 3 роки тому

    I know he speaks English but that's it ...

  • @linkdude64
    @linkdude64 3 роки тому

    Super delicious wonderful extra terrific meme dream technology, here.

  • @wmopp9100
    @wmopp9100 3 роки тому

    thanks for doing a terrible job so well.

  • @ytytiuiu2590
    @ytytiuiu2590 3 роки тому

    How to get rid of freaking Covid 19 YT popup .

  • @matthewpalmer9820
    @matthewpalmer9820 3 роки тому

    128

  • @JoshuaCChan
    @JoshuaCChan 3 роки тому

    3rd

  • @excitedbox5705
    @excitedbox5705 3 роки тому +1

    Intel will find a way to detect AMD/ARM servers and then throttle performance down to floppy speeds :D

    • @tanmaypanadi1414
      @tanmaypanadi1414 3 роки тому

      they won't get away with it with L1T and STH making it public as soon as they get their hands on the stuff

  • @NickF1227
    @NickF1227 3 роки тому

    First

    • @ytytiuiu2590
      @ytytiuiu2590 3 роки тому

      this video only got 124 views yet