16TB SSD NAS For Under $1200!
Вставка
- Опубліковано 19 гру 2022
- This video is brought to you by Manscaped! Get 20% off + free international shipping @manscaped with code CRAFT at manscaped.com/craftcomputing
The Wiwynn Lyra SV315 1U server returns from certain eWaste, this time in the form of a 16tb TrueNAS powered monster! This dual Xeon server didn't live up to expectations a year ago, but how will my server rack like it today?
But first!... What am I drinking?
It's the End All Be All limited series coffee oatmeal stout. From McKenzie Brewing. It's the perfect breakfast substitute at 6.5% ABV.
Links to items below may be affiliate links for which I may be compensated
Check out the Wiwynn Lyra SV315 here:ebay.us/XGcrEX
Wiwynn Lyra SV315 PCIe Riser: ebay.us/E31JMW
(x2) Intel Xeon E5-4627v2: ebay.us/NNYfvf
(16x) 16GB REG-ECC DDR3 1600: ebay.us/tY8FhV
LSI SAS3008-i HBA: ebay.us/NwGnzO
HP Mellanox Dual 10Gb PCIe: amzn.to/3VcUMR8
(2x) 120GB Patriot Burst Elite: amzn.to/3HQRwYw
(8x) 1.92TB Patriot Burst Elite: amzn.to/3Wj70Jh
MiniSAS SFF-8643 to SFF-8087 (2pk) : amzn.to/3FM6i0b
Install TrueNAS Core: • TrueNAS CORE 12.0 Inst...
TrueNAS Core Datasets, Permissions, Snapshots: • TrueNAS CORE 12.0 Tuto...
TrueNAS ZFS DeDuplication: • ZFS Deduplication in T...
TrueNAS for your Game Library: • Use your NAS as a Stea...
Grab yourself a Pint Glass or Hoodie at craftcomputing.store
Follow me on Twitter @CraftComputing
Support me on Patreon or Floatplane and get access to my exclusive Discord server. Chat with myself and the other hosts on Talking Heads all week long.
/ craftcomputing
www.floatplane.com/channel/Cr...
Nouvelle Noel by Kevin MacLeod
Link: incompetech.filmmusic.io/song...
License: filmmusic.io/standard-license
Grab yourself a Pint Glass or Hoodie at craftcomputing.store
Follow me on Twitter @CraftComputing
Support me on Patreon or Floatplane and get access to my exclusive Discord server. Chat with myself and the other hosts on Talking Heads all week long.
/ craftcomputing
www.floatplane.com/channel/Cr... - Наука та технологія
Nah screw the tech, can we appreciate the saxophone skills? Love your funny ads Jeff!
I was coming here to say exactly this! We need more saxophone epicness!
That's an amazing setup. Something I have been seriously considering. Have gone back to Linus' 24TB server he built years ago. Keep up the hard work.
Considering how that entire setup is less costly than a single 8TB Sabrent Rocket Q NVMe drive, I call this a win. :D
a lot bigger and consumes more power but damn
I saw some 4TB NVME on sale at around $275. not the best NVME SSD but still will be much faster than those SATA ones at the same cost
Not sure if that's actually you playing but first thought, "of course he plays an instrument" and second... your "commercials" are top-tier in my opinion. Gets me every time. I watch the "commercial" just to see what you come up with this time.
I’m excited for this build!
Amazing build! Thank you for this information!
I can't believe Manscaped approved that ad!🤣
Manscape has always been into cheeky double-meaning-based marketing, their slogan like "your balls will thank you" or kit name "perfect package 4.0" for example. So that's perfectly acceptable to just go ham with it in the ads
This is becoming an _addiction_ ...
I have just assembled the components for my first (digital photo editing) TrueNAS build based on an AsRock Rack MB and I'm already looking over the fence and thinking about that video editing NAS rig that _of course_ my wife would want me to have...
Argghhh....
You're feeding the Monster, buddy!
Wonderful video! Thanks for sharing your solutions and warning of pitfalls. That's a huge help.
Cheers, mate!
J
This is exactly what im building for too. photo injest , photo editing than moving to archive. should be interesting.
Ditto. What I'm working towards is separating _storage_ from _processing_ . I'm aiming for a high-speed (10 GbE LAN) networked NAS to house the media files that can be processed by any workstation on the network (I flip between macOS and Win10 for various reasons).
Good luck!
J
Nice. The bang for the buck is truly impressive. The Manscaped ad at the intro was hilarious! :-D
My tip for working from home: Laphroaig in a whiskey glass looks just like scotch. I'm at home, so I'm gonna drink what I want, when I want, dammit.
This looks great. If you could do another clip, or a simple update after a few months on how it is going with this setup in your production workload.
Nice build man
Aww, it's sweet you gave your house band a break for the holidays! 😃
This is prime for a 25gbps upgrade!!!
E: Glad to hear that teaser at the end haha, looking forward to it
Alternatively, if he doesn't want to shell out for a new switch, he could get a 40GbE card and use a break out DAC cable to give 4x10GbE.
@@BobHannent I just picked up a UBNT 10g aggregation switch with four SFP28 ports on it. I get it that those are for connecting to other switches but since I will eventually have one on the first and second floor then I will have two ports on each floor running at 25g. I only see that changing if I build a garage/shop and that will end up housing a lot of the network equipment. Even then 50 gig to and from the house should be plenty.
Solid work tip at the start
Hadn't realized what the pears were about, and what on earth they could ever have to do with a NAS, or even a saxophone… until I did, and immediately thought that's the most hilarious manscaping commercial I've ever seen! 🤣
😆
Good on ya for revisiting this after determining the problems with the initial review. To avoid simultaneous drive failure, you might want to buy 1-2 more Patriot Burst SSDs and rotate an original drive out once a month or so, straight replacement. This should protect you a bit more from the whole thing falling over at once if the drives were from the same batch, AND give you a couple of spares.
Yes yes, cool computer. The thing I'm impressed about is that you find stouts drinkable xD! I have not yet acquired the taste for burnt beer.
I just picked up some 40gb cards for my R720 with 8 1TB Micro SSDs in it. Excited to see what it can do.
Was not expecting to see a WX5 cameo in a Craft Computing video- Nice!
And of course he put “the lick” at the end of his cover
That would make a hell of a solution for redirected home directories.
It would be AWFUL. Unless it all ends up sitting in cache.
Those speeds are slower than a PCIe 2.0x4 NVMe drive.
You want low latency and 4k random read performance for all your OS stuff.
You would honestly be better off spending $5 on a Gen1 16GB Optane drive (they are only PCIe 2.0 x2) and putting your home directory on that.
@@Prophes0r home directory is not OS stuff, it's mostly configs, save files and email archives.
Nice! What are the idle and full-load wattages? Power consumption is always a key factor for my system builds.
just git a deal on local recycler for 16 1TB SSD... I may just copy your design ! Love it.
I upgraded to the latest TrueNAS Scale and I’m more than happy with the progress they have been making with the program. I use two separate arrays in my system and have found that when using SSDs, it’s essentially the perfect NAS OS.
This is because with SSDs, you get all the benefits of ZFS with none of the drawbacks. All metadata is on SSDs, the ZIL is on SSDs, and there’s little practical reason to use L2ARC. You can even enable deduplication (on benefitting data) without issue. I even run several low-CPU overhead VMs perfectly. In fact, with SSDs in a large array, you can even set primarycache to Metadata only, which will allow the system to use the RAM for deduplication.
I’d still recommend many platter drives with SSD component acceleration for people who want to do mass storage or backups, but with SSDs, you get so much more with TrueNAS.
With cheap rdimms and plenty of ram, SSD caching and metadata vdev's are both practically useless. With the prefetching tunables setup correctly, Core will run rings around Scale using only spinning rust. At least in my use cases anyhow. I find the bottleneck to be networking almost every time. And if you use UPS there is no need for an external ZIL. Quite a few now are recommending disabling sync writes if you have proper battery reserves.
Deduplication is a lot more nuanced than what you make it sound. Such broad/generalized statements about enabling deduplication are pretty risky and I can only caution people about using it without a lot of research.
@@wishusknight3009 SLOG is not made unnecessary by a UPS, in that respect the two are independent. Also, disabling sync writes for VMs only because you have a UPS is generally not recommended. There are more aspects to it.
Unless you have redundant ups, is be wary of trusting it with your data
This is the first time I've ever subscribed to a channel because of a Manscaped ad, but here we are
Hearing THE lick at the end of the Manscaped ad made me laugh so hard lol
I even had to rewind the video, because something seemed too familiar
Not great reviews on those SSD so would be good to see how they hold up long term. Thanks for the video !
BEST manscaped ad EVER!
Price to performance is pretty damn ridiculous. I thought that price was only for the SSDs alone.
4 real!
A fitting home, directly beneath ye olde Craftinator.
2U leftover for a Stornado too!
I hadn't heard of the Patriot Burst Elite drives until this video. Funny part is you could totally skip the Lyra entirely and get the same 8 drive config it has by default all into any machine with a single 5.25 bay using just an Icy Dock MB998SK for about the same price. Something I'm definitely doing to my T7920.
I've seen quite a lot of patriot burst drives go through warranty. I'd say more as a % than even the cheap Kingston ones, which are not too reliable themselves
LOL! Dude, your advertising skits are getting better and better.
kind of tempted to try it ngl
Excellent news! The result is very functional, but it seems like we will need to wait for 10Gb networking to REALLY see the array stretch it's legs. Looking forward to THAT test.
His test IS with 10Gbit networking...
10Gbit ~= 1GB (Very slightly more, but there is always encoding and networking overhead. So it's close enough)
O. M. Goodness! That Manscape commercial! 😳🤣🤣🤣
The "Licc" at the end of your ad was gold hahaha
I was looking for a setup like this, amazing!
I would have to loved to see power consumption figures.
It's a fair concern to worry about power consumption if you're planning to run this 24/7, so I suppose the idle power draw would be the most prominent?
Hands down, the best Manscape ad of all time.
Bold move please keep this running and let's us know the failure rates
Love to working from home tip :D
Oh! This is asking for another 40gig upgrade! I recommend Arista’s DCS-7050QX-32, they’re so cheap at the moment and they’re not pickey when it comes to qsfp compatibility.
That Manscaped ad got me crying xD
Time for 25GB!
...MORE!
That commercial was disturbing
If you like the glenlivet you have to try tomintoul 16yr old. Great vid as well👍🏻👍🏻
I'm waiting for the day when 8TB and 4TB gen 4's will become even more cheaper.
While i dont have a rack, This right here would be a fantastic NAS for my plex server. I could make this work for instantaneous streaming over my network.
like these videos i can relate to , not using 500$ SSD's and using something i can afford. I have a 2 Dell R620's with 768GB Ram laying around. Going to get some of these bursts for it and do the same.
something something LTT something something lol
R620 and R630 would be better for this type of use case mainly due to cheap and easily available spares
Now you have me looking. Amazon has some for cheap right now
@@joshfairchild eBay, I’ve picked up 2 r620s for $75 a piece recently. Need one more to complete my HA project
I'm curious to hear about the durability of this setup in the long term.
Would have been interesting to see in an RAID-10 configuration and hearing something about the ARC-Performance with this much RAM.
Since its basically a cache Server for the Projects, such optimization attempts sound promising.
Impressive!
Stout is fine. But a nice whisky and a good cigar are the ticket to flavor town.
Thanks for the videos,
isn't the back-plane also limiting the speed of the sas controller/ssd speed on this unit ?
"Well Well, Look whats inside again" AMAZING. LOL
You play the electric sax that's cool
That sponsor spot was quite something. :D
i would like to know the longevity of the rives. the reasearch i have done is confusing and spotty at best regaurding what ssds to use, or even what to look for.
What happened with the brocade switch? That thing has multiple 40G ports that would really help this thing shine
You have two nics! Don''t forget SMB Multichannel
lol Best manscape ad. Thats hella funny.
How are those prices so good for the SSD units??? Might use them to update my Synology
For editing which matters more - random or sequential? If the later, how would swapping to a pool of mirrors help out?
Lol that ad read 😂
Hmm... I've tried using Patriot SSDs in the past because they are inexpensive. 1.92TB for $80 on Amazon as I write this, which is an *amazing* value. I'm planning to replace some spinning platters (4x1TB drives in a RAID 10) in my desktop system with SSDs. But I'm hesitant to go with Patriot because the drive controller on the Patriot Torch SSD I owned just... flaked out with some interesting lockup issues. These do have much better reviews on Amazon compared to the Torch, but I've also gotten much better luck from Micro Center's Inland SSDs.
There must be some unique US pricing for these drives because in the UK the cheapest they are going for is £223.56 + shipping each. That makes it about £1800 for the drives alone.
@@AdrianBawn The price of the drive in Taiwan corresponds to USD $80.
i'd just get U2 drives - unless you're just storing movies, DWPD is an important factor andwhy enterprise SSD cost so much
running the same box, half the RAM but a pair of E5-2650 v2 @ 2.60GHz giving my 32 threads (just a little overkill for Truenas) because that is what I found in my junk bin.
This is probably the sexiest video so far. Also that ad is the best I've seen in a long time. Nice work!
Kind of large for a system based on 2.5” drives. There some serious ventilation by the looks though and a substantial board and PSU.
Not wanting a full size rack I was looking forward to something somewhat more compact compared to existing solutions.
Could you use mellanox 40GbE QSFP cards?
I upgraded my Server with an i7 12th Gen Supermicro Motherboard and 512 GB DDR4 ECC Memory for another $3.200.
Reused my old HDD's 24x 10TByte HDD from my old System and 4x 1TB NVMe Cache.
I payed $1.700 for "NEW" 8x 2 TByte Intel Server SSD's. You made a good deal with $1.200!!!
Hang on, you said that your raid array was corrupted. Since raid is your only backup how did you cope?
5:54 Wouldn’t it be beneficial to split the data into multiple vdevs? Less capacity but better trouhgput could be beneficial especially for video editing
I want to see hot swap nvme bays! I wanna load new hard drives like they're CD-ROM-thin units!
Is sambad with winbind a suitable way to setup a controller and will Trunas core work well with it, as I look to the clouds and then a whisper in the wind says: Install a new linux vm and start testing.
A coffee stout that looks like coffee...I can get behind that.
9:00 Seagate or Samsung 250GB? :) Also a cheap solution would be SMB Multipath you do have 2x10G ports there after all just one more cable and tweaks done.
hey when are you going to do a 2022 rack update?..:)
For the network how about used inexpensive infiniband cards/switches?
it would be good to know how the ssds hold up. the sp ssds don't run well on linux and dell servers.
@craftcomputing Jeff can you explain how HDDs are able to saturate 10Gbps network? Are the running in a mirror? Also how do you estimate appropriate network bandwidth for your NAS server. Cheers 🍻
He's got a ton of em in raidz I believe. Plus a huge amount of ram in the storinator.
Easy, the amount of data the read/write head has access to on a 20tb drive, and the dram caches on disk make it so that in a sequential read/write operation you're pushing well past 10gbps with a fairly modest number of drives.
In terms of bandwidth estimation, he's using crystaldiskmark, which is great for an apples to apples comparison when evaluating hardware. It's not great at real world performance metrics, and the only way you get real world numbers is in the real world honestly. Now, if you already have an environment where you can test it with crystaldiskmark, you can safely assume that a change that say, give you a 30% higher score will give you a 30% improvement in the real world as well, even though the numbers are usually lower.
What is the woodwind MIDI controller? in your hands there, singing that whoa hold me back aria?
That's a Yamaha WX7
Hey Jeff if you see this could you tell us what the power draw on that thing is if you happen to track it that is. I know that older Xeons were less effecient so im just trying to build a decently low wattage 24/7 system and energy prices are rising. Thanks
OMG. I LOVE IT. Is it possible to know if the Tesla p4 would be able to stay cool in that server?
I think there would be enough airflow for that, though I haven't tried it.
@@CraftComputing 2 tesla p4's. Where do I sign.
never seen the burst line. those prices for a more brand name are amazing. has anyone used these in a HP 380p 25sff?
filling up a hand full of bays for my VM boots then using the mechanical drives for storage seems like a good way to go. or hell at this price might be worth it to go with some 480/960's for storage rather than paying 25$ per seagate constellations. at 20$ each
Are the 2x 250GB SSDs for the OS/TrueNAS? Are those setup in a software raid or hardware raid?
You could get something very similar thing in a smaller desktop size using M.2 NVMe (and in Thunderbolt) with the OCZ ThunderBlade😂
Jeff, great video. I was in the process of looking for economical ways to increase our storage at work. We have an actual TrueNAS 50TB SSD array, but it cost a pretty penny and the boss was not keen on adding a second, but we are in need of more storage. This at very least looks like a good stop gap, build two and and synchronize them for redundancy for less than the annual maintenance on our TrueNAS.
Also only heard it running in your already populated rack, if I were to build it for home as well how awful are the fans?
@@CLEARRTC They're loud, like a hair dryer.
Also, show your boss the monetary impact of running out of storage and not having a solution. Odds are a new truenas box will pay for itself in lost productivity very, very quickly.
Yeah so i got the chenbro nr12001, but i slept on this one.
Where is the product page or support page that shows CPU and ram compatibility? Google was not my friend on this. Wywinn has the SV310V4 shown, but no listing or search for SV315
I like how things like this shoot up in price as soon as they're featured in a UA-cam video by someone, anyone.
May rack is in my office. How loud is that 1U server?
Gave u a like for the ad 😂😂😂
Has anyone been able to source the drive trays for the SV315? Or know what will work with the SV315?
curious what the power draw on something like this?
2x cpu with 130W TDP, no option for us Dutch people anymore😭
When someone is freshly awoken, seeing the pear fondling is especially unsettling.
Hey man, I own the same server. But mine only came with one mini-sas cable. What cable did you use. All the ones I’ve tried haven’t worked. Also what about the pci riser cards. I’d love to build something like this.
Links for everything in the description. If you're using the onboard controller, you'll need an SFF-8087. For the HBA I used, it's an 8643-8087 Cable.
Anyone know where I can find that riser? I can't seem to find it anywhere anymore.
I believe MikroTik has released a 40Gbit switch recently :)
A used Intel DC P4510 8TB has only 80% of the capacity, Outperforms that RAID by a decent margin in every way, costs half the price over ebay & needs 'only' 15W ... (ok you need an adapter to connect it to your m.2-slot & an additional SATA-powerconnector).
What is faster and better Windows Sever 2022 or TrueNAS?
I hope that Patriot SSDs are better than before. I have terrible memories because of Patriot SSDs.