Important notes: Enterprise drives of the same model, but different capacities, can have much different performance. The P4510 is a good example of this, just check the product page of 1TB vs 2TB and you'll see a big difference in Random IOPS based on the capacity. Just something to consider! Also U.2 drives usually run MUCH hotter and consume much more power as they are designed for servers they expect active cooling.
I think their advertised specs are measured differently than consumer drives, though, being focused more on sustained performance than burst. They usually don't have a pSLC cache, either.
Yes, especially when compared to M.2. A lot of the cost is the memory chips, so that is mostly what you are paying for. The controller can be older, slower, and cheaper, but that is offset by the need for the SATA connector, and the 2.5" case that it comes in. In a perfect world, SATA would be cheaper, but I'm not surprised that it isn't.
@@harrkevServer world simply move towards SAS and PCIE (with PCIE being dominent) when they move to ssd. It is faster, more iops. Nowadays u can find cheaper large capacity u.2/u.3 ssd 2nd hand than sata ssd
@6:20 I have found IOPs have gotten a lot more important recently, Just windows 10 will cream older drives with its constant read and writes, even if it not using the full drive speed older drives (especially mechanical drives) just dont have the IOPs to handle all the requests Windows throws at it anymore, especially with windows updates. Fresh windows installs will show 100% disk usage on anything that is mechanical or eMMC, unless you basically disable all non essential services including windows update (which i find to be the biggest killer of disk access)
Bought a DL380G10 with U.2 slots, but when I saw the used prices for those enterprise SSDs I switched back to SAS backplane :D Will wait few years ahah
I wish they made a compact nas case for U.2 NVMe drives. I have a few of these from HGST at 8TB. My switch was the bottleneck but recently picked up the QNAP 12 port 100/25 GbE (QSW-M7308R-4X-US) switch it’s nice and super quiet.
That's hard as hell. These things can do 25w apiece. A small nas case for 4 of these now has to dissipate 100w in a smaller form farcor than a hard drive with less heatsink area, which means way louder and or bigger fans. If you're doing 8 of these u.2 drives, that's up to 200w just in drives that need a large volume of airflow in a small case. The manufacturers are over there wondering why you want this stuff in a small case where its going to be loud and not hold many and consume a lot of power vs just a small m.2 nas that can comfortably cool 8 with a lot quieter and smaller fan in a smaller case. It just doesn't make sense to them when compared to the low power m.2 version. If you want to build your own you're going to have a great time finding and buying an expensive u.2 backplane, expensive risers, and expensive cables. Been trying to hook up 8x u.2 drives to my server. Its not easy or cheap. It'd be a great thing for them to make and sell, but its not nearly as easy as you're putting it.
@@inflatablemicrowave8187you should see my DIY nas I have 4 8TB U.2 HGST on a x16 adapter card with a itx server ASROCK motherboard dual 10G in a FormdT1 SFF case. All sufficiently cooled with two 120mm top fans. Plus it’s quiet. It’s running Xpenology DSM7.2.2 with full NVMe support. All drives reporting maximum of 55c under full load. Yes these drives get extremely hot with no active cooling.
yup, sadly no such device seen, using a pcie 16x adapter card for four u.2 drives from amazon for 40 euros -the mobo supports 4x4x4x4 bifurcation with 1,92-7,68TB random drives, there is one 5 bay mini ssd nas/das that supports the intended successor form factor for u.2/u.3 the "E1.S" the QNAP TBS-h574TX, you can mount either native e1 form factor drives or use the adapter for m.2 /which soon should be available in 16TB capacities/
NAND prices have to come down, or there needs to be a breakthrough on density. PCIe Gen 4/5 are starting to get where a singe lane can do some serious bandwidth, so stacking up on NVMe will become more practical for systems less than Xeon's with tons of lanes. Right now it's not practical for homelab unless you want to keep it pretty small, and even then U.2 drives of decent capacity (GT 4TB) are too expensive even used. But I'd still trust a used enterprise drive over a used consumer drive any day - had some bad luck with used consumer stuff and outright fraud from sellers.
@@kchaney56client class drives are completely fine nowadays. You can get fast and cheap gen 4 drives with 1000 tbw/tb easily (lexar nm790 for example). And they'll most likely exceed that rating. The innovation that made enterprise ssd's better at first has long since trickled down to client ssd's.
@@game-tea Conflating the warranty value with some kind of write endurance rating is silly. Mentioning the nm790, which has export-control violating NAND is even sillier. "They'll most likely exceed that rating." You mean like *literally* all drives would? Why are you using apostrophes to pluralize acronyms?
That was a great analogy for the differences between bandwidth and IOP's. It seems like I always stumble across content from you and a few others whenever I start to think about expanding my homelab beyond just a pi-hole and a NAS. It is like you can sense a tech nerd thinking, about to spend money, and like magic, the content appears to inform the Adderall fueled masses.
I just racked up 2 new storage units for work with 18 1.9TB NVMe u.2 drives in a 2U form factor, with 8 64Gb FC ports each. I take care of the systems Hitachi Vantara uses for professional training, and they just released the new VSP One line of products. The ones I got are the VSP One Block 26.
Thank you for addressing this topic! It has annoyed me for years that the outdated SATA interface has not been replaced by something more up to date. And U.2 / 3 would be the perfect candidate. Not only is it an existing and established standard. The interface is also backwards compatible to SATA. So you could connect your NVME drive as well as (several) SATA drives to this port. Techquickie made a video about NVME 2.0 3 years ago. An extension / improvement of the protocol, which also includes hard disks. But how are NVME hard disks to be rolled out when the predominant interface for hard disks in the desktop market is still SATA?
I so look forward to your videos. Big Fan. I never heard of U.2 and cant wait to see what consumer level products come out. Like NAS. Keep up the great work and the jokes. Loved the laugh track.
The early days of SSDs and back when OCZ was in the market, tried to join the band wagon with the budget friendly/low capacity SKUs at the time, bad idea 😂
@@Casper042 While expensive compared to consumer stuff you can pick up smaller capacity optane pretty cheap right now. I just grabbed some P4800x's for less than $150 each for some testing and previously got some P1600x's super cheap when Newegg had them on firesale.
Worth mentioning those were a mix of older/newer Gen3 and Gen4 drives that were tested and the Gen4 drives are read optimized (iirc), when you factor that in the results make a lot more sense. Pretty sure a P5510 would destroy the 5316/5336 for mixed use. After burning through consumer M.2 drives on my old proxmox server I hunted around ebay till I found a good deal on some P4510's and for my use at home (10gbe network) gen3 is fast enough. IOPS less of a worry than endurance for my use case and the difference in endurance is massive.
Also the 2.5 inch ones may have better cooling if they are in a good metal housing. M.2 is not a terrible format but it is designed for laptops really but found its way into desktops. Those things you have shown at 4:49 are EDSFF E1.S or E1.L. The E1.L is a longer one known as the ruler since it is a long stick like a ruler. Their connections have some similarities to M.2 but will not work in an M.2 socket. E1.S and L are for datacenter use mostly. EDSFF is Enterprise and Datacenter Small Form Factor. I have seen PCIe cards that can be used to adapt those to a PCIe slot in a way like you would M.2 but don't plug these into M.2 or you may damage your hardware. That is unless you know for sure it will work safely and I doubt it would without an adapter of some kind.
I remeber when NVME was new. I was hoping U.2 would become the standard on motherboards because it makes so much more sense on desktops.Now I have many useless HDD bays.
I am upgrading GMKtek G3 and K8 nmve sticks. Mechanical clearance is a serious issue. Please investigate with a mechanical engineer and encourage mini-PC makes to ensure heatsinks fit between ssd and fans.
My very first Computer 1980 was a TRS-80 Molel 1 It had 4 5&1/4" Floppy drives 3 35 trac & 2 *0 Track Double sided. Even still have A SANOY Lugamle with 2 5&1/4" Floppys and a 10MB (MEGA) Western Digitak Harg Card. Also had a Tower with 5 HDD one 3.5" and 4 5&1/4" HDD 2 being 5 GB Bacarudas that ran so hot I had to leave the Casr off. Stil have every computer I've Owned excepy for the 1st 3. TRS-8o, Apple II & a Commode 64. I've had 286,386,486,Pentium 1,2 &3's Exectra. Presently running an ASUS GL702VSK Laptop with 5TB Internal a 2TB WD_Black SN850X NVMeSSD Boot Drive, Samsung SSD 870EVO 1TB, and 2 1TB NVMe SSD's in enclousers. I don't Game Just Video Edit. As a Note: Never ever had a Problem with the Orignal 1TB 7200 rpm HDD Doing 1080P video but then I don't do Fusion or Color Grading or 4K.
+1 for endurance as a must! I've been running some write heavy workloads on my M.2 NVMe SSD (Samsung 990Pro) and in just a few days I went from 3% to 5% `percentage_used`... when I googled that I started to panic a bit, does this mean I got like a year before my drive goes read-only?!?!?! Oh, I also cooked an NVMe drive making it tweak and crash my server (OS drive) so I put a cheap $6 heatsink and that think has stayed 40C max since! So cooling is important too.
Yeah hold up I’ma need to get one of those for my servers and yes they use support SAS because they are literally enterprise grade servers. I have five of them and they could hold four guys each and they are from three different brands😅
If I look around what you can buy, doesn't look like E1 type storage servers are easy to buy, they were more available 5 years ago than now, so maybe the format didn't take off ?
Thanks!! How the resell or used markets are with these. Maybe how and what the different controllers or jack you plug these into look like. Maybe some new and used prices.
TriMode controllers are only a few years old so they are not going to be popular on eBay and 2nd hand market just yet. Plus HW RAID will end up being the bottleneck there. The screamin demon designs we do for customers all have the drives direct connected to the PCIe lanes on Xeon Scalable / AMD Epyc processors. You can stuff 32/36 drives in a standard 2U server easily. That's 128/144 PCIe lanes and a modern 2P server only has 160 total.
Since SATA is pretty much a dead end, I do hope we start seeing U.2 as a replacement. With PCIe 5.0, motherboard manufacturers can start leveraging the fact that we need less lanes to reach the maximum performance for consumer NVMe SSDs. It's also nice to just have an option to have a stack of traditional form-factor drives that I can place in other parts of the system instead of being limited to daughterboards.
U.2 is dead You won't find Enterprise SSD makers using it beyond Gen4 EDSFF is a family of drives picking up where U.2 and U.3 leave off EDSFF E1.S is very close to the physical size of a M.2 if you removed the heatsink from it, and supports Hot Swap and Gen5 (and beyond in the future). EDSFF E3.S = More like a credit card or a thin 2.5" drive. There is a sub variant called E3.S 2T (2T = Double Thick) which is about the same size as a 2.5" enterprise drive. So just like NVMe was designed for SSDs and we're all switching to that instead of AHCI, EDSFF is a physical design for Enterprise SSDs taking over from U.2/U.3
NVMe are blazing fast indeed. while the most used form factor are M.2. I don't think U.2 or U.3 are going to regular consumer class, only on enterprise grade hardware. what I like with U.2 drive's are the cooling that the case it provides. many NVMe are crazy hot. even more on higher gen drives. even modern M.2 drives are already equipped with cooling fins, not as good as those U.2. heck even SATA SSD can get pretty hot on high usage. keep the silicon cooled properly can make it last longer. time to fire up that enterprise grade delta fan. LOL
I disagree, try scale 10TB+ on M.2 form factor. Yeah you can't. Plus, with higher hotter controller, you barely get the advertised speed, or worst performance than PCIE 4.0 or 3.0 max speeds. QLC and PLC can go 10TB+, but then again, your endurance tanks, and so does your R/W, when SLC cache runs out. The only reason manufacturers don't move off from M.2 because: they don't want SSD price to crash like SD card. U.2/U.3 drive should be on mainstream, heck, bring back SATA express, it combines 2 SATA ports + x4 PCIE bus to obtain around 16Gb/s speed.
@@AlfaPro1337Don't forget the m.2 form factor is perfect for laptops, chrome books, and mini PCs vs a thicker and bigger u.2... then there's the whole most consumers don't need crazy storage density either... Even the more data usage hungry folks typically have an nas and their daily driver can get by with a terabyte or two
@@AlfaPro1337 thank you for your reply man. yes. U.2/U.3 are great on high TB needs. but at what price? U.2/U.3 needed larger footprint, more power, and more cable to connect to mainboard. and not many mainboard offer many U.2/U.3 connectors. unless it's a enterprise/server grade mainboard. Yes U.2/U.3 are great. And the drive are also great feature, like speed, hot swap capable, high cooling as I previously mention. But in the end, it would cost more, and high TB count are available in enterprise applications only. At work, we use 30TB U.2 NVMe using triple parity RAID. blazing fast. but cost more than $100k.
@@pieteryts U.2/.3 still uses the same SATA power standard, accepting 3.3, 5 and 12V. In fact, if it's using 12V, it's more efficient than M.2 power, which is using 3.3V. U.2/.3 still uses the 2.5/3.5 inch form factor. Heck, if possible, the rare 1.8 inch form factor. Or really, they could scale back to 5.25 inch like the old HDD days. No, most of the cost of the SSD is not the number of NAND, it's the controller. Plus, Enterprise grade SSD has extra features like a large capacitor, so that if there's abrupt power loss, it's still able to complete the flush before data loss. Look, there's the other spectrum of consumer: They want very large single SSD storage only. Sure a NAS might work, but it's external, network and file system dependent, etc, and has way more footprint than a single, large SSD.
@@AlfaPro1337 Yes. its true for power standard. I agree with that. But no please no more 5.25 inch drive again. 🤣 in some servers these days, I see more U.2 and M.2 style drive. or new E3.S (EDSFF). Dell even use M.2 SATA (in RAID 1) as BOSS drive for their modern server boot. most U.2/U.3 are directly connected to the CPU or custom PCIe bridge or some U.2/U.3 HBA (cheap but not as fast), so yes that would cost a lot. drive also not that cheap. I saw U.3 drive 15.36TB at $3,000. but yeah that a single drive only. while 4TB Crucial P3 can cost $350 (4 drive 16TB would cost around $1,400, adding a HBA, you can do RAID). but yes I agree there are some needs for a large single SSD drive. can't argue with needs🤣 but for multi drive, and regular consumer use, i think M.2 can't be beaten yet in case of cost effectiveness. just my opinion 😁
Nvme is exclusively PCIe, Sata is Sata they both are data transfer standards. M.2 is the physical connection and can service either, just like Usb-C can provide a thunderbolt signal…
You omit to mention how many lanes each of these drives needs for full bandwidth. sas and sata need 4 lanes per drive. This way an HBA 330 controller can ran up to 8 drives, 4 for each sas port of the controller. Is it the same for u.2 and u.3 as well? I don't think so.
No, NVME capacities are getting bigger, the problem is M.2 is too 'small' to do much more than 8tb with current NAND density and there isn't a form factor that easily replaces it for consumer hardware.
1:30 - that SAS number is 12G SAS, 24G SAS does about 2x those numbers. And why is Gen4 slower than Gen4 x4 ? Most NVMe drives are x4 so those should be the same number... 3:45 - "Allows you to plug in SATA SAS or U.2 into the same port" = NO, Bad Brett. U.2 uses a different pinout than U.3 and you cannot put a U.2 drive into a U.3 slot. There are some U.3 "Dynamic" drives which will auto sense and adapt between a U.2 / U.3 slot, but the reverse is not true. 4:45 There are 4 main variations of EDSFF and what they look like depends on which one you are talking about. E1.S = what you showed. E3.S looks more like a credit card. E1.L is similar to "Intel Ruler SSDs" (before they sold off their SSD division)
@@RaidOwl I wouldn't, for the reason it would just add more confusion for consumers. Your title and thumbnail are equivalent to saying "Why is TCP/IP networking like this?" and showing a CAT6 cable and an SFP+ DAC cable. By the way the answer is the same for NVMe and TCP/IP, one is for consumers and the other is for enterprise businesses.
QLC in commercial products are fine as they have enough channel and nand stack to give enough write speed even when cache go full On regular M2 they usually max out 100-200MBps wrote which takes aged to rebuild/resilver P3 or P3 plus avoid at all cost as their controller are bad on multitask / read write mix activities
Yes, Consumer wants. Intel Optane Chip used, so lasted for YEARS, what the hell is TBW. Data means hold for years not for read speed race. 4TB probably the standard and I agree with the other post, under $200 each. someone probably holding our storage technology leap, hope AMD can sell storage cheap, so others will follow. READ ONLY DRIVES. CACHE DRIVES. ARCHIVE DRIVES. NAS DRIVES. FAST DRIVES for video editing.
@@RaidOwl No, you clearly didn't talk a minute about what NVMe is and how the protocol works! Most of the video was somewhat related to what NVMe is but you probably spent more time talking about U.2 than NVMe. I don't get why you would try to gaslight me? Since you think it's okay to do that I am banning your channel from my recommended. Keep being like that, see how that works out for your engagement in the long run.
Important notes: Enterprise drives of the same model, but different capacities, can have much different performance. The P4510 is a good example of this, just check the product page of 1TB vs 2TB and you'll see a big difference in Random IOPS based on the capacity. Just something to consider!
Also U.2 drives usually run MUCH hotter and consume much more power as they are designed for servers they expect active cooling.
Also did you just call me a SATA drive? Don't get SAS-sy with me.
😅😅
😨
I think their advertised specs are measured differently than consumer drives, though, being focused more on sustained performance than burst. They usually don't have a pSLC cache, either.
I just want SATA SSD - they don't even have to be that fast - to be like 4 and or 8 tb for under $200 each. Is that too much to ask for?
Yes, especially when compared to M.2. A lot of the cost is the memory chips, so that is mostly what you are paying for. The controller can be older, slower, and cheaper, but that is offset by the need for the SATA connector, and the 2.5" case that it comes in. In a perfect world, SATA would be cheaper, but I'm not surprised that it isn't.
NAND is NAND , so the price not gonna be so much different , sata is slow because of interface not the NAND.
@@harrkevServer world simply move towards SAS and PCIE (with PCIE being dominent) when they move to ssd.
It is faster, more iops. Nowadays u can find cheaper large capacity u.2/u.3 ssd 2nd hand than sata ssd
Yes, Consumer pc chip maker probably shouldn't be cheap and actually provide sufficient amounts of pcie lane for nvme ssd
😢
We also had PCIe storage on M.2 before NVMe. It used AHCI, it did not last long tho.
The comparison of IOPs and bandwidth did help thanks. Helped me understand the difference
@6:20 I have found IOPs have gotten a lot more important recently, Just windows 10 will cream older drives with its constant read and writes, even if it not using the full drive speed older drives (especially mechanical drives) just dont have the IOPs to handle all the requests Windows throws at it anymore, especially with windows updates. Fresh windows installs will show 100% disk usage on anything that is mechanical or eMMC, unless you basically disable all non essential services including windows update (which i find to be the biggest killer of disk access)
Windows 7 64Bit on modern hardware is faster then windows 10/11 weird huh?
Laugh track really help land that joke
😅😅
@@RaidOwl Oh Nana.... Were you Trying to selling your Life Alert Pendant on a Cash for Gold Network again?
Bought a DL380G10 with U.2 slots, but when I saw the used prices for those enterprise SSDs I switched back to SAS backplane :D
Will wait few years ahah
AFAIK you can use consumer grade NVMe drives in U.2 if you spend a few on an adapter caddy.
I wish they made a compact nas case for U.2 NVMe drives. I have a few of these from HGST at 8TB. My switch was the bottleneck but recently picked up the QNAP 12 port 100/25 GbE (QSW-M7308R-4X-US) switch it’s nice and super quiet.
That's hard as hell. These things can do 25w apiece. A small nas case for 4 of these now has to dissipate 100w in a smaller form farcor than a hard drive with less heatsink area, which means way louder and or bigger fans. If you're doing 8 of these u.2 drives, that's up to 200w just in drives that need a large volume of airflow in a small case. The manufacturers are over there wondering why you want this stuff in a small case where its going to be loud and not hold many and consume a lot of power vs just a small m.2 nas that can comfortably cool 8 with a lot quieter and smaller fan in a smaller case. It just doesn't make sense to them when compared to the low power m.2 version. If you want to build your own you're going to have a great time finding and buying an expensive u.2 backplane, expensive risers, and expensive cables.
Been trying to hook up 8x u.2 drives to my server. Its not easy or cheap. It'd be a great thing for them to make and sell, but its not nearly as easy as you're putting it.
@@inflatablemicrowave8187you should see my DIY nas I have 4 8TB U.2 HGST on a x16 adapter card with a itx server ASROCK motherboard dual 10G in a FormdT1 SFF case. All sufficiently cooled with two 120mm top fans. Plus it’s quiet. It’s running Xpenology DSM7.2.2 with full NVMe support. All drives reporting maximum of 55c under full load. Yes these drives get extremely hot with no active cooling.
yup, sadly no such device seen, using a pcie 16x adapter card for four u.2 drives from amazon for 40 euros -the mobo supports 4x4x4x4 bifurcation with 1,92-7,68TB random drives, there is one 5 bay mini ssd nas/das that supports the intended successor form factor for u.2/u.3 the "E1.S" the QNAP TBS-h574TX, you can mount either native e1 form factor drives or use the adapter for m.2 /which soon should be available in 16TB capacities/
@@radeksparowski7174 that’s the big hurdle the pcie lanes. QNAP has one with an EPYC CPU and U.2 bays but that thing is extremely expensive.
NAND prices have to come down, or there needs to be a breakthrough on density. PCIe Gen 4/5 are starting to get where a singe lane can do some serious bandwidth, so stacking up on NVMe will become more practical for systems less than Xeon's with tons of lanes. Right now it's not practical for homelab unless you want to keep it pretty small, and even then U.2 drives of decent capacity (GT 4TB) are too expensive even used. But I'd still trust a used enterprise drive over a used consumer drive any day - had some bad luck with used consumer stuff and outright fraud from sellers.
Enterprise drives only for me, home class drives are not trust worthy.
@@kchaney56client class drives are completely fine nowadays. You can get fast and cheap gen 4 drives with 1000 tbw/tb easily (lexar nm790 for example). And they'll most likely exceed that rating. The innovation that made enterprise ssd's better at first has long since trickled down to client ssd's.
Sorry, why does it "have to" come down?
Less than Xeon... is? Less than Xeon's what?
@@game-tea Conflating the warranty value with some kind of write endurance rating is silly.
Mentioning the nm790, which has export-control violating NAND is even sillier.
"They'll most likely exceed that rating." You mean like *literally* all drives would?
Why are you using apostrophes to pluralize acronyms?
That was a great analogy for the differences between bandwidth and IOP's. It seems like I always stumble across content from you and a few others whenever I start to think about expanding my homelab beyond just a pi-hole and a NAS. It is like you can sense a tech nerd thinking, about to spend money, and like magic, the content appears to inform the Adderall fueled masses.
Endurance and capacity are the main reasons why I regret going M.2 instead of U.2.
U2 drives should be introduced to consumer hardware... M2 form factor is extremely limiting.
M.2 was developed for laptops and cooling was an afterthought. There is E1.S and E3.S which basically make M.2 server capable.
I just racked up 2 new storage units for work with 18 1.9TB NVMe u.2 drives in a 2U form factor, with 8 64Gb FC ports each. I take care of the systems Hitachi Vantara uses for professional training, and they just released the new VSP One line of products. The ones I got are the VSP One Block 26.
Thank you for addressing this topic! It has annoyed me for years that the outdated SATA interface has not been replaced by something more up to date. And U.2 / 3 would be the perfect candidate. Not only is it an existing and established standard. The interface is also backwards compatible to SATA. So you could connect your NVME drive as well as (several) SATA drives to this port.
Techquickie made a video about NVME 2.0 3 years ago. An extension / improvement of the protocol, which also includes hard disks. But how are NVME hard disks to be rolled out when the predominant interface for hard disks in the desktop market is still SATA?
I so look forward to your videos. Big Fan. I never heard of U.2 and cant wait to see what consumer level products come out. Like NAS. Keep up the great work and the jokes. Loved the laugh track.
The early days of SSDs and back when OCZ was in the market, tried to join the band wagon with the budget friendly/low capacity SKUs at the time, bad idea 😂
Ok and what exactly is an SKU?
Awe wanted to see Optane U2 in the mix!
750GB = New Mortgage on the house. You mean those? And then Intel killed them off :(
@@Casper042 There are deals from time to time, I picked up an 1.5TB optane for $300 few months ago on newegg.
@@Casper042 While expensive compared to consumer stuff you can pick up smaller capacity optane pretty cheap right now. I just grabbed some P4800x's for less than $150 each for some testing and previously got some P1600x's super cheap when Newegg had them on firesale.
Worth mentioning those were a mix of older/newer Gen3 and Gen4 drives that were tested and the Gen4 drives are read optimized (iirc), when you factor that in the results make a lot more sense. Pretty sure a P5510 would destroy the 5316/5336 for mixed use. After burning through consumer M.2 drives on my old proxmox server I hunted around ebay till I found a good deal on some P4510's and for my use at home (10gbe network) gen3 is fast enough. IOPS less of a worry than endurance for my use case and the difference in endurance is massive.
Thanks for explaining IOPS vs read speed!
Indirection Unit Size and it's effect on Performance would have been interesting to explore. Nice Video anyways!
I remember having some older consumer motherboards with U.2 connectors. Obviously never used them!
I’d love to see that loaner server loaded up to be a multi-tenant end point for all the VM servers. Really test out that 100G networking.
So many toys the server space has that we'll never play with. I think I've seen an m.2 22110 card once in person. Cheers! 👍
You can also get a 2.5" u.2 case with an m.2 socket inside, this way you can plug a m.2 nvme to a u.2 system.
Tired that with IcyBox IB-M2U04 and Supermicro BPN-SAS3-743A-N4 backplane, didn't work out =\
Solidgm is Intel ssd business they sold off right ?
Yeah
Solidigm = Intel's old SSD business
Kioxia = Toshiba's old SSD business
@@Casper042
kioxia = what my laptop came with and my Nt10
solidigm = what my laptop got modified with and my Os10
M.2 is fine for portable devices, but I'd really like to see the 2.5" U.2/U.3 drives make a comeback for desktops.
Also the 2.5 inch ones may have better cooling if they are in a good metal housing. M.2 is not a terrible format but it is designed for laptops really but found its way into desktops. Those things you have shown at 4:49 are EDSFF E1.S or E1.L. The E1.L is a longer one known as the ruler since it is a long stick like a ruler. Their connections have some similarities to M.2 but will not work in an M.2 socket. E1.S and L are for datacenter use mostly. EDSFF is Enterprise and Datacenter Small Form Factor. I have seen PCIe cards that can be used to adapt those to a PCIe slot in a way like you would M.2 but don't plug these into M.2 or you may damage your hardware. That is unless you know for sure it will work safely and I doubt it would without an adapter of some kind.
I’d love to see a Jonsbo N5 build.
I remeber when NVME was new. I was hoping U.2 would become the standard on motherboards because it makes so much more sense on desktops.Now I have many useless HDD bays.
I am upgrading GMKtek G3 and K8 nmve sticks. Mechanical clearance is a serious issue. Please investigate with a mechanical engineer and encourage mini-PC makes to ensure heatsinks fit between ssd and fans.
My very first Computer 1980 was a TRS-80 Molel 1 It had 4 5&1/4" Floppy drives 3 35 trac & 2 *0 Track Double sided. Even still have A SANOY Lugamle with 2 5&1/4" Floppys and a 10MB (MEGA) Western Digitak Harg Card. Also had a Tower with 5 HDD one 3.5" and 4 5&1/4" HDD 2 being 5 GB Bacarudas that ran so hot I had to leave the Casr off. Stil have every computer I've Owned excepy for the 1st 3. TRS-8o, Apple II & a Commode 64. I've had 286,386,486,Pentium 1,2 &3's Exectra. Presently running an ASUS GL702VSK Laptop with 5TB Internal a 2TB WD_Black SN850X NVMeSSD Boot Drive, Samsung SSD 870EVO 1TB, and 2 1TB NVMe SSD's in enclousers. I don't Game Just Video Edit.
As a Note: Never ever had a Problem with the Orignal 1TB 7200 rpm HDD Doing 1080P video but then I don't do Fusion or Color Grading or 4K.
I wish there would have been more Tri-mode compatible and accessible backplanes
M.2 to U.2 adapters are also very hard to get working right if at all
Lmao what was that ending
Idk what was it?
5:03 I laughed similar to the sound effect
mini sas and u.2 is very confusing, still navigating that
+1 for endurance as a must! I've been running some write heavy workloads on my M.2 NVMe SSD (Samsung 990Pro) and in just a few days I went from 3% to 5% `percentage_used`... when I googled that I started to panic a bit, does this mean I got like a year before my drive goes read-only?!?!?! Oh, I also cooked an NVMe drive making it tweak and crash my server (OS drive) so I put a cheap $6 heatsink and that think has stayed 40C max since! So cooling is important too.
New to the channel. 99.1K subs. You are getting that silver YT button any day now! 👍
i love my p4510 SSDs i have a pair of 8tb drives that i got since they are way cheaper than the same capacity in m.2.
Yeah hold up I’ma need to get one of those for my servers and yes they use support SAS because they are literally enterprise grade servers. I have five of them and they could hold four guys each and they are from three different brands😅
Hold on man, a lot of information ! I only buy from Amazon with the highest reviews :)
Not a bad idea
Need HDD to get to 48TB so my 16TB drives are $200...
If I look around what you can buy, doesn't look like E1 type storage servers are easy to buy, they were more available 5 years ago than now, so maybe the format didn't take off ?
Thanks!! How the resell or used markets are with these. Maybe how and what the different controllers or jack you plug these into look like. Maybe some new and used prices.
TriMode controllers are only a few years old so they are not going to be popular on eBay and 2nd hand market just yet.
Plus HW RAID will end up being the bottleneck there.
The screamin demon designs we do for customers all have the drives direct connected to the PCIe lanes on Xeon Scalable / AMD Epyc processors.
You can stuff 32/36 drives in a standard 2U server easily. That's 128/144 PCIe lanes and a modern 2P server only has 160 total.
Algorithmicly appropriate comment here
thanks! interesting info
Since SATA is pretty much a dead end, I do hope we start seeing U.2 as a replacement.
With PCIe 5.0, motherboard manufacturers can start leveraging the fact that we need less lanes to reach the maximum performance for consumer NVMe SSDs. It's also nice to just have an option to have a stack of traditional form-factor drives that I can place in other parts of the system instead of being limited to daughterboards.
U.2 is dead
You won't find Enterprise SSD makers using it beyond Gen4
EDSFF is a family of drives picking up where U.2 and U.3 leave off
EDSFF E1.S is very close to the physical size of a M.2 if you removed the heatsink from it, and supports Hot Swap and Gen5 (and beyond in the future).
EDSFF E3.S = More like a credit card or a thin 2.5" drive. There is a sub variant called E3.S 2T (2T = Double Thick) which is about the same size as a 2.5" enterprise drive.
So just like NVMe was designed for SSDs and we're all switching to that instead of AHCI, EDSFF is a physical design for Enterprise SSDs taking over from U.2/U.3
NVMe are blazing fast indeed. while the most used form factor are M.2. I don't think U.2 or U.3 are going to regular consumer class, only on enterprise grade hardware. what I like with U.2 drive's are the cooling that the case it provides. many NVMe are crazy hot. even more on higher gen drives. even modern M.2 drives are already equipped with cooling fins, not as good as those U.2.
heck even SATA SSD can get pretty hot on high usage.
keep the silicon cooled properly can make it last longer.
time to fire up that enterprise grade delta fan. LOL
I disagree, try scale 10TB+ on M.2 form factor. Yeah you can't. Plus, with higher hotter controller, you barely get the advertised speed, or worst performance than PCIE 4.0 or 3.0 max speeds.
QLC and PLC can go 10TB+, but then again, your endurance tanks, and so does your R/W, when SLC cache runs out.
The only reason manufacturers don't move off from M.2 because: they don't want SSD price to crash like SD card.
U.2/U.3 drive should be on mainstream, heck, bring back SATA express, it combines 2 SATA ports + x4 PCIE bus to obtain around 16Gb/s speed.
@@AlfaPro1337Don't forget the m.2 form factor is perfect for laptops, chrome books, and mini PCs vs a thicker and bigger u.2... then there's the whole most consumers don't need crazy storage density either... Even the more data usage hungry folks typically have an nas and their daily driver can get by with a terabyte or two
@@AlfaPro1337 thank you for your reply man. yes. U.2/U.3 are great on high TB needs. but at what price? U.2/U.3 needed larger footprint, more power, and more cable to connect to mainboard. and not many mainboard offer many U.2/U.3 connectors. unless it's a enterprise/server grade mainboard. Yes U.2/U.3 are great. And the drive are also great feature, like speed, hot swap capable, high cooling as I previously mention. But in the end, it would cost more, and high TB count are available in enterprise applications only. At work, we use 30TB U.2 NVMe using triple parity RAID. blazing fast. but cost more than $100k.
@@pieteryts U.2/.3 still uses the same SATA power standard, accepting 3.3, 5 and 12V. In fact, if it's using 12V, it's more efficient than M.2 power, which is using 3.3V.
U.2/.3 still uses the 2.5/3.5 inch form factor. Heck, if possible, the rare 1.8 inch form factor. Or really, they could scale back to 5.25 inch like the old HDD days.
No, most of the cost of the SSD is not the number of NAND, it's the controller. Plus, Enterprise grade SSD has extra features like a large capacitor, so that if there's abrupt power loss, it's still able to complete the flush before data loss.
Look, there's the other spectrum of consumer: They want very large single SSD storage only.
Sure a NAS might work, but it's external, network and file system dependent, etc, and has way more footprint than a single, large SSD.
@@AlfaPro1337 Yes. its true for power standard. I agree with that. But no please no more 5.25 inch drive again. 🤣
in some servers these days, I see more U.2 and M.2 style drive. or new E3.S (EDSFF). Dell even use M.2 SATA (in RAID 1) as BOSS drive for their modern server boot.
most U.2/U.3 are directly connected to the CPU or custom PCIe bridge or some U.2/U.3 HBA (cheap but not as fast), so yes that would cost a lot. drive also not that cheap. I saw U.3 drive 15.36TB at $3,000. but yeah that a single drive only. while 4TB Crucial P3 can cost $350 (4 drive 16TB would cost around $1,400, adding a HBA, you can do RAID).
but yes I agree there are some needs for a large single SSD drive. can't argue with needs🤣
but for multi drive, and regular consumer use, i think M.2 can't be beaten yet in case of cost effectiveness.
just my opinion 😁
Great video 👌
Also… How about a Silverstone CS 382 build with an ultra HD blue ray ripper optical drive??
u.2 drives have much better sustained writes and reads . The 1T 4K performance is much better
❤ awesome vid.
No NVMe is NOT exclusively designed for PCIE, you can buy SATA NVMe drives, not sure WHY you would want to but you can.
No you can’t. You can buy an m.2 sata drive but a “nvme sata drive” is not a thing.
Nvme is exclusively PCIe, Sata is Sata they both are data transfer standards.
M.2 is the physical connection and can service either, just like Usb-C can provide a thunderbolt signal…
Mmmm. Crunchy gum.
Tastes like NAND
You omit to mention how many lanes each of these drives needs for full bandwidth. sas and sata need 4 lanes per drive.
This way an HBA 330 controller can ran up to 8 drives, 4 for each sas port of the controller.
Is it the same for u.2 and u.3 as well? I don't think so.
Each u.2 drive natively uses 4 lanes
Yeah looks like SATA but internally it's not
Are these drives why Ssds haven’t gotten bigger all that quickly? Manufactures moving away from the smaller medium?
No, NVME capacities are getting bigger, the problem is M.2 is too 'small' to do much more than 8tb with current NAND density and there isn't a form factor that easily replaces it for consumer hardware.
i expected u.2 would utilize more lanes than m.2......
NVME spec is 4 lanes regardless of physical form factor.
1:30 - that SAS number is 12G SAS, 24G SAS does about 2x those numbers.
And why is Gen4 slower than Gen4 x4 ? Most NVMe drives are x4 so those should be the same number...
3:45 - "Allows you to plug in SATA SAS or U.2 into the same port" = NO, Bad Brett. U.2 uses a different pinout than U.3 and you cannot put a U.2 drive into a U.3 slot. There are some U.3 "Dynamic" drives which will auto sense and adapt between a U.2 / U.3 slot, but the reverse is not true.
4:45 There are 4 main variations of EDSFF and what they look like depends on which one you are talking about. E1.S = what you showed. E3.S looks more like a credit card. E1.L is similar to "Intel Ruler SSDs" (before they sold off their SSD division)
Gen4 NVMe meant "around what a typical nvme drive will do" while Gen4 x4 is the max spec
Idk if i would call that pc a sweaty nerd gamer pc 😂
I chuckled
Did you see the RGB tho?!
Good luck with QLC drive ☠️
Nvme is pcie. They just trying to mislead you.
FFS, NVME is a protocol, not a form factor. This video should have been a short.
You make one then BasheeBunny
@@RaidOwl I wouldn't, for the reason it would just add more confusion for consumers.
Your title and thumbnail are equivalent to saying "Why is TCP/IP networking like this?" and showing a CAT6 cable and an SFP+ DAC cable. By the way the answer is the same for NVMe and TCP/IP, one is for consumers and the other is for enterprise businesses.
@@BansheeBunny lol ok...
2:29 Why is there prejudice against gamers?
I hate nerds
QLC in commercial products are fine as they have enough channel and nand stack to give enough write speed even when cache go full
On regular M2 they usually max out 100-200MBps wrote which takes aged to rebuild/resilver
P3 or P3 plus avoid at all cost as their controller are bad on multitask / read write mix activities
M.2 vs U.2...
Yeah…
🙏
E1.L for me. . .
I want my 1 petabyte nvme🤔🤔
so funneh that big boy datacenters buy 60tb ssd for a few hundred while ppl buy 4tb for 250$...
ultra sweaty nerd gaming pc's hahaha jeez man
Yes, Consumer wants.
Intel Optane Chip used, so lasted for YEARS, what the hell is TBW.
Data means hold for years not for read speed race.
4TB probably the standard and I agree with the other post, under $200 each.
someone probably holding our storage technology leap,
hope AMD can sell storage cheap, so others will follow.
READ ONLY DRIVES.
CACHE DRIVES.
ARCHIVE DRIVES.
NAS DRIVES.
FAST DRIVES for video editing.
What? I see words but there is not a single coherent sentence in there. You want AMD, a processor company, to provide NAND?
Did you spend even a 1minute of the 11 minute video explaining what NVMe is? How the protocol works? This is such a fail of a video!
Watch again, I def do. If you don't see it then watch again. Also comment again. Keep doing these as it helps my channel :)
@@RaidOwl No, you clearly didn't talk a minute about what NVMe is and how the protocol works! Most of the video was somewhat related to what NVMe is but you probably spent more time talking about U.2 than NVMe. I don't get why you would try to gaslight me?
Since you think it's okay to do that I am banning your channel from my recommended. Keep being like that, see how that works out for your engagement in the long run.
@@kwinzman another comment? Wow, you're really helping my channel grow! It's nice to have such awesome interactions with fans like you :)
Crosstalk Solutions, ShortCircuit, RMT Family