My server is broken :( - Fixing Linus' Home UNRAID Server
Вставка
- Опубліковано 19 тра 2024
- Use code LTT50 to get 50% off Keeper personal or family plans at bit.ly/3rZMQdb or try it out with a 30-day free trial.
Check out the MSI RTX 4060 GAMING X TRIO at lmg.gg/msi4060gamingxtrio
My home UNRAID server has some serious issues, but it turns out fixing them is WAY more complicated than It needs to be.
Discuss on the forum: linustechtips.com/topic/15241...
Buy Seagate Exos 16TB Enterprise HDD: lmg.gg/pFyb0
Check out the 45 Drivers Storinator XL60: lmg.gg/MyYtu
Purchases made through some store links may provide some compensation to Linus Media Group.
► GET MERCH: lttstore.com
► GET EXCLUSIVE CONTENT ON FLOATPLANE: lmg.gg/lttfloatplane
► SPONSORS, AFFILIATES, AND PARTNERS: lmg.gg/partners
► EQUIPMENT WE USE TO FILM LTT: lmg.gg/LTTEquipment
► OUR WAN PODCAST GEAR: lmg.gg/wanset
FOLLOW US
---------------------------------------------------
Twitter: / linustech
Facebook: / linustech
Instagram: / linustech
TikTok: / linustech
Twitch: / linustech
MUSIC CREDIT
---------------------------------------------------
Intro: Laszlo - Supernova
Video Link: • [Electro] - Laszlo - S...
iTunes Download Link: itunes.apple.com/us/album/sup...
Artist Link: / laszlomusic
Outro: Approaching Nirvana - Sugar High
Video Link: • Sugar High - Approachi...
Listen on Spotify: spoti.fi/UxWkUw
Artist Link: / approachingnirvana
Intro animation by MBarek Abdelwassaa / mbarek_abdel
Monitor And Keyboard by vadimmihalkevich / CC BY 4.0 geni.us/PgGWp
Mechanical RGB Keyboard by BigBrotherECE / CC BY 4.0 geni.us/mj6pHk4
Mouse Gamer free Model By Oscar Creativo / CC BY 4.0 geni.us/Ps3XfE
CHAPTERS
---------------------------------------------------
0:00 Intro
3:20 Hard Mode?
5:27 Don't do it this way
6:25 Fixing the array
8:20 Why not a cloud service?
12:35 The OG
15:59 A future problem
17:38 Goodnight, sweet prince!
20:08 Outro - Наука та технологія
CORRECTION: We stated in this video that the parity drives in a dual parity setup in UNRAID contain the same data, that is incorrect, so we've cut that clip out of the video. UNRAID uses the P + Q redundancy system in dual parity setups, meaning one parity drive stores standard XOR parity data, and the other a Reed-Solomon code.
For more information on how parity and dual parity works in UNRAID, see the UNRAID Wiki here: docs.unraid.net/legacy/FAQ/Parity/#how-parity-works
I mean you were wrong but in lame terms saying they both have the same data is not bad lol
radio
Around 11:15 the audio goes out of sync.
@@rgar2255I wondered why nobody seemed to have noticed, I’m getting out of sync audio too ☹️
This thing breaks so many times it’s PERFECT for content.
I'm confused though, he mentioned his Uncle Bob fixed it but Bob wasn't in the video 🤔 🤔
True
Car dealer: *slaps* this baby can fit so much content
Plot twist: he deliberately messed up his server when setting it up to create future problems for future content
Damm I thought Linus was pro right to repair. Then he builds a server designed to fail. Oh, wait, nevermind.
Linus: runs unraid
Jake: wears trunas shirt
Classic Jake. Love that guy.
Came to post the same :)
Just come down here to say this, beat me to it! 😂
Jake is the backhanded complement to Linus. The videos work so well that Jake let's Linus do his thing after offering a suggestion....then after 20 minutes of Linus tinkering, Jake sneaks in to implement his suggestions. 🤣🤣
Damn multiple people beat me to it. HAHA
To Jakes credit, Truenas is way better than Unraid. Unraid is easier to use but is terribe performance wise. On the same system with Truenas i can fully saturate a 2.5gbit link but with Unraid i only get ~600mbit. Also using an USB drive for the operatingsystem is a big nono for me.
Linus, if you replaced a parity drive before a dead drive, I don't know if you would ever live it down if anything went wrong.
keyword: "if" nothing did go wrong
IT'S HIM
Some people forget that popular UA-camrs have a life and watch yt
That's what I thought 😂
But ccommenting on Ltt?
tip: buy half the drives from a separate distributor to get different runs of drives. drives can die surprisingly close to each other if they're all off the same assembly line in sequential order, so the chance of double fault is much much higher than people imagine. ask me how i know 😂
but by having two sets of drives from different batches, they'll live for different periods of time and you lower the chance of two failing at the same time
Also you can change a drive every year, even if neither have not any signs of failing (you can always reuse the changed drive to another system).
But running you NAS on shingled drives... wow, that takes some balls
How do u know?
@@rohansampat1995 had a double fault. one died, replaced it, and within an hour of starting the rebuild, a second one died. lost the array. replaced that one too and within a few weeks the rest died. they were all one serial number apart. i think the rebuilding load makes them fail closer in time than they otherwise might
Sad to say that sounds logical.
@@jfernandez76 Running NAS on SMR drives doesn't take courage, only lots of time and a good UPS.
Jake being like "It tastes like 5'1''" has got to be a workplace violation 💀
I just didn't get it.
@@Metal_Maxineshort joke against Linus, as dust is mainly old dead skin particles. It was quite funny 😂
Yeah that almost got me spit out my food
And a t-shirt!
Also means he knows what 5'1" tastes!
HR ought to be interested in more ways than one!
It’s so nice to see Linus and his husband working together on this fixing project.
his husband?
@@cosnovaeit's a joke that Jake and Linus are basically married. It makes sense if you watch all the house upgrade videos
The other joke is that Jake is Linus's son
His son you mean?
@@marcusborderlands6177no, his son.
Jake and Linus made this seem way harder than it needed to be. The Parity Swap the UI referred them to is the process they should’ve followed, it has its own section in the official Unraid documentation.
Also the two parity drives do not contain the same parity data, they have two separate parity calculations so that two drives can fail simultaneously and still be able to recover the data. If the parity disks were simply mirrored and you had two data drives fail, Unraid would be unable to calculate the data missing.
Noticed that too. Pretty dangerous misinformation too. You cannot swap parity 1 and 2 around, and if a data disk has failed you'll LOSE YOUR DATA!
Agreed, there is a lot of misunderstanding here and incorrect information being presented. Please dont follow this video as a guide, refer to the Unraid documentation and forums. There are plenty of others who have documented this situation and the proper procedure.
Perhaps swapping Parity Drives means actually coping the data to another drive, therefore preserving the two different parity calculations.
At 8:40 "Just store it on Google Drive" Yikes! Even with encryption (which can be broken by hacking the Google account) I don't trust any online server, ever. My data stays local in multiple physical locations. Linus seems to agree. ;)
@@BillAnt No, Linus specifically and inaccurately made the point that a big advantage of Unraid is that Parity 1 and 2 are interchangable. This couldn't be farther from the truth. Parity 1 is a bitwise XOR of the aligned blocks on all data drives. By itself it can recover data on any one missing data drive in the array. Parity 2 uses a Reed-Solomon code to recover data if the other parity is working and two data drives are missing, or if one data drive is missing along with Parity 1.
Also, no, encryption cannot be broken by hacking into the Google account. Besides the impossibility of "hacking into" a Google account if you have a unique random password stored in a password manager, YOU can manage your own encryption on the client side and upload bytes to the cloud already encrypted, only storing the key locally, using APIs to directly access cloud storage instead of using the web UI.
The server never receives the encryption key for your data, therefore not even Google can see what you're uploading, only the size of it, that is the entire point of encryption. Cryptomator, Rclone and many other solutions will do that for you.
(obviously, if you lose the key then you're completely fucked, and in addition you won't be able to preview files on Google Drive directly or easily open/download them individually, depending on whether you're using software that encrypts filenames as well and/or maps a single file to multiple encrypted blobs and vice versa)
Well, by following the guide there would be no drama, and no video.
8:45 As someone who works in cloud storage, there was recently a nightmare scenario in astrailia iirc where a company just shut off their cloud server there without enough warning and dozens of companies lost everything. As we like to say at work, cloud storage is only useful if the cloud is yours
Sounds like something Unit8200 would do. 🙄
Maybe it was a different incident, but Influxdb did that to their users in Belgium just a few weeks ago.
it should be fine if it's only one of the other copies of the backup
@@kaukospotsyeah idk people need to realise that it should be one place for your backups. But cloud services like Google with Photos or Drive and Microsoft OneDrive made it way too convenient for a lot of people as their only backup solution:/
That was probably InfluxDB, and they actually also nuked their Belgium region at the same time (though that was mostly recovered I think)
Jake and Linus videos are almost guaranteed to always be entertaining
Not quite as entertaining as Linus & Alex videos though.
@@RichWhiteUM Linus and Alex are both the same kind of chaos, but Jake is always the opposite energy.
"Happy Wife's Boyfriend Happy Life"
"Happy Boyfriend's Wife Happy Life"
The LTT Upper-management Polycule.
@@yourguysheppy We need more Jake and Riley content, real Ren & Stimpy vibes.
IKR
Should've just done the Parity-Swap, which does exactly what you wanted to do in one step. The UI even said to do a Parity-Swap. It's been a function for over 10 years but was called swap disable previously.
Something that wasn't brought up was that with Unraid. if they did lose another drive during the rebuild, the only data lost would be on the drives that died. Since Unraid doesn't "stripe" data across multiple drives, you won't lose the data on the rest of the drives.
I’m glad the updates on the new house are starting to become more frequent again, it makes me realize that I’ll probably never be able to afford anything similar.
Git gud.
i litterally cant save more than a terabyte of data, so im fine with just 1
Linus’s house setup is so unnecessarily complicated. I hope no one watching these videos actually hope of emulating whatever he’s doing.
@@kreuner11 Rookie numbers.
@@KellyWu04 I mean, this part is just a big nas, so not too weird.
At this point, about 28% of Linus's content is his server breaking.
Gotta keep milking faking & exaggerating whatever minor issue and acting like something they used before was worse to justify something newer.
@@CheapSushi It's interesting yet i also guess they've got enough brains to make a full backup to a TrueNAS Server at work/the next room before their stumbling around in there ;)
oh come on, you're being unfair. it's only 26% of his content
We love the home lab disasters 😅😅😅😅
You're excluding the content about servers breaking, that he's lost.. because of broken server :)
Hearing the intro: no way Linus will do this by himself. Also: no way nothing will go wrong.
Seagate has recently refreshed their lineup of ironwolf pro drives referred as NT variants in the model number instead of NE for the older model. Main difference is expected life-span is much higher. NE drives are going cheap to clear inventory.
now a million year life span🎉
Put the radiator on a hinged door frame to move it to get room.
thats actually kinda genious
the rad is gone now i believe since he swapped the server to the pool cooling
“I always use protection” have they padded all the floors or something to stop him damaging stuff when he drops them? 😂
Also said by the guy that had 3 kids 😂
There's not enough padding in the entire universe for that.
@@thegriningnumber12 lol
@@thegriningnumber12 but he's got the ultimate protection against hellspawn after tho. So, win?
15:40 You can wear a dust mask with filters when dealing with dusty hardware. It makes a world of difference in the course of years to decades.
10:30 - important correction: In UnRAID, the two parity drives do NOT contain the same data. How else would it be able to restore two failed data drives from parity? The data is obviously different.
I’m glad you are always improvising so that these things always happen, and we get the content.
* single RAID drive fails *
Linus & Jake: Oh well, let's replace the entire server and add three new hard drives.
It wasn't until Jake said "Why's there water on the floor?" that I realized exactly which video Linus went to help Alex with.
The crossover of the two videos!
For UnRaid, if you have a large array I highly suggest running the Disk Location plug in. You can make mapping of all disks with visual representation and also force any disk to blink to locate it.
Unraid has come a long way and is pretty good about preventing you from screwing things up, but several plug-ins fill some big gaps, such as Unassigned Devices...
What are you favorite plug-ins besides that?
I will always love Jake's devotion to TrueNAS. 🤣
And its supported by facts
Its the better software
@@lastrae8129. Both have their place. I actually agree it’s the “better” choice for many, but Unraid is a great choice for others.
@@lastrae8129 scale specificy core has been left behind in the past year or so. scale is the future.
Truly a POS operating system.
Jake has matured a lot, Really enjoy watching his videos
Yeah especially his on-camera personality. He’s so much more pleasing than he used to be
He's stopped 'trying to be funny', and started 'being actually funny'. I really look forward to his content, as opposed to dreading it.
Well he joined LTT around 16 y/o. He's currently still only 22/23 y/o, so it makes a lot of sense.
No, he should zone 2 cardio and make more videos until his death at 130 years.
@@TheXshot Yvonne says she hired him to tidy up after Linus and take everything Linus 'borrowed' back to inventory. Since Jake also has an ADHD diagnosis and light fingers, it might not have been the greatest hiring decision.
7:07 - My understanding of TrueNAS is that you can chuck in replacement larger drives willy nilly, but it's only when all members of the pool have been replaced will the whole pool suddenly see the new full capacity. So can be done, you just don't see the benefits straight away.
There's a mention of plugins for TrueNAS to achieve this, any idea what they're called? Never heard of those before, that could be quite a game changer.
I read they recently added a feature that allows you to add more data through replacing only some drives with larger ones by redistributing how data is striped.
@@grex2595 that's awesome! Do you have a link or a name of the feature? Would love to try it out
I definitely need me that "normal" screwdriver Jake was using. Hands down the coolest version I've seen on the channel so far.
If we can get it in N64 purple I'm in.
I'd happily buy transparent/frosted.
Jayz2Cents has a blue/green one he made at LTX that looks SICK
What I love in Unraid (besides the variable disk size support) is that your data is in a totally readable and usable form in the disk. So if you have one parity drive and lose two drives, you will lose data, but not everything. I can even move some data to a disk and put that disk alone to a different computer, and will be readable.
What I don’t like is that in the scenario we saw today (replacing a failed drive with a larger one), because unraid uses dedicated parity drives and requires replacing a parity disk at the same time as a failed disk to use a larger size, any read error on that parity drive while rebuilding the failed drive will be a fatal read error. It’s a massive risk.
@@guspaz It is because LTT made this process and video complicated for entertainment value. If they read the Unraid manual before starting messing around, it would look much less dramatic. Also, most Unraid user knows "parity disks need to be larger than data disks" this limitation. So user will upgrade the parity to be the largest disk when disk price falls. Also LTT didn't preclear the new drive. Preclear is recommended not mandatory for replacing a disk. But if they end up shuffle around rather carelessly without reading manual, if their operation at any step become a equivalent of "adding" a drive, then the "added" drive must be precleared to all zeros to maintain valid parity.
@@guspaz That's a general risk you take when you're rebuilding 2 drives at a time, it's not specific to unraid. There's 2 parity drives and 2 drives being rebuilt, so if 1 more drive fails, obviously the whole thing fails. It doesn't matter whether the parity drives are "dedicated" or not.
@@chaoster111 The problem is that unraid forces a 2-drive rebuild to replace a single failed drive if the replacement drive is larger. In a ZFS vdev with raidz2 (the equivalent setup), if a drive fails and I try to replace it with a larger drive, then it just works, resilvering to the new drive with single-drive redundancy, leaving the extra space unused. In the same scenario, however, Unraid appears to force you to simultaneously replace one of the parity drives, forcing a zero-redundancy rebuild. In the unraid scenario, not only does a drive failure during the rebuild cause data loss, but any read error whatsoever during the rebuild causes data loss. I can't think of any good reason for unraid to force this requirement instead of just provisioning less space on the larger drive.
@@guspazunraid doesn't force anything like that, no idea why you think that.
16:00 Ah, so this was the other video they were shooting at the same time as swimming pool water cooling!
My server is loaded with 8TB renewed HGST drives, all CMR, and actually renewed, even the helium is replaced. $68 each with a 5 year warranty and Zon's 90 day warranty. I pulled the two 4TB Ironwolf's out because I needed more storage. They run fantastic.
I really enjoy your network/rack gear problem solving videos.
They're some of the absolute best.
I hope to see more and more in 2024!
booting unraid from usb is perfectly fine as it only reads from the drive during boot and writes very infrequently. My OG thumb drive from 2012 when I started using unraid is still going strong and many many hard drives from that first build died a very long time ago.
saying thumb drives are unreliable in this scenario is uninformed.
vmware also used USB / SD flash drives right up to version 7. I'm using 64 gig usb flash drive for my TrueNAS core for years without issues. I'm planning to change it out for USB to nvme adapter soon.
12:50 free windows key!! lol
13:50 The use of a USB drive for booting is not problematic because it is an immutable file system except for the config folder that its mounted very rarely. UNRAID and its FreeBSD brothers run basically entirely from ram and use very little write ops.
Source: immutable FreeBSD OS dev
Its more that USB drives have a habit of dying completely at random, not necessarily due to writes. Which is of course why you're supposed to have a backup to quickly swap out should that happen.
FreeNAS/TrueNAS hasn’t run mostly from memory for years, mainstream FreeBSD never has.
@@philiprobar yea not mainstream BSD, but BSD Router project, nanobsd, and microbsd which are all used to make these appliance OS’s do
@@davidcozziii
FreeNAS/TrueNAS stopped using monowall and switched to FreeBSD in 2010. I lost several flash drives to the beta releases.
@@philiprobar okay… I’ve been running production systems for the last five years without fail, in fact I’ve burned significantly faster through HDDs and SSDs because of how I configured it. Idk what TrueNAS did, but it’s no where near as janky as everyone makes it out to be.
FYI, Unraid has UPS integrations and can automatically shutdown gracefully when the battery gets low/the power goes out!
This video makes me miss my time working for enterprise-grade IT shops. I was confused when you weren't just pulling out the drive with a red (amber) light and putting in a new one, then letting it automagically rebuild. I was like "why did they power it off? The drives aren't hot-swappable!?!" I never realized people had to actually rebuild RAID arrays manually!
He is not matured enough to make professional videos. He really suffers lack of knowledge.
Really love unRAID. You’ve got to stay aware of updates and breaking changes. But it has shown to be solid on my setup for years now. The instantaneous downgrade from any update is a great feature too. If the update gives you work/errors/crashes you can easily go back to the working setup and try later on after maybe applying some fixes first in the working software. It’s neat.
Yeah, make sure to always check the forums for change logs and issues, I usually wait a while before upgrading.
IIRC one of the recent updates does require a config change when downgrading because of some changes (documented on the site).
What sold it for me was that the community is so much more friendly than FreeNAS/TrueNAS. You can ask a question in the UnRAID forums and and get a useful answer, instead of being told that if you're not running triple-redundant enterprise-grade hardware then you clearly don't care about your data and you might as well delete it. (I'm only exaggerating slightly).
UnRAID is perfect if you don't have a lot of money, but you do have a pile of old hardware that you want to reuse.
@@phuzz00 Personally I'm quite happy with my truenas mini I bought from truenas. While I'm not that wealthy, I didn't really have much pressure to buy nas as it's mostly something I wanted, not needed. So I waited for two years and bought something I thought would be the best for me.
While I like building pc's and tinkering with tech, I didn't want bulky nas system and I wanted system that's as reliable as possible with good support as it's going to be storing all my data and cloud.
Due to official build and sticking to supported plugins, I'm probably quite insulated from community stuff, and I haven't really had much problems anyways.
@@phuzz00 So basically unraid has their own forum and truenas uses stackoverflow?
@@phuzz00why would you suggest unRAIDNAS over FreeNAS specifically for people with not a lot of money? That would be the opposite.
I am fully aware that I pay a synology tax, but for me synology hybrid raid is the killer feature. It is so easy to just mix and match drives. My first synology was a used 5 bay model and back then I would be savaging old drives from ewaste pc and every time a drive diede I would just plop in a bigger better drive. And core critical data was always offsite backed up.
I came here to say the same thing. I got given one of their rack mount models and their hybrid raid is awesome. Just going to keep adding drives until it fills and slowly up the size of the drives.
Observation:
Why is furmark running for no good reason on a home server setup?
Knowing what he has for cooling I'm wondering if he is heating the pool for a swim later!!
The water comment made me suspicious and I just checked the pool water cooling video and they're both wearing the same t-shirts and then Lnus checks the Pc performance with the same monitor on top of the same case. This was shot in the same day and probably around the same time as the pool video!
This is my favorite type of content on this channel. I used to work as an admin in a small ~50 people company, and it reminds my of good days
I love that this was being filmed at the same time as the pool water cooling video so you can see a slight cross over between the two.
That's why despite other issues with Synology (drive "compatibility" list), SHR-2 allows you to mix-match drive sizes (upward) and still be capacity efficient.
I can do the same on Windows with StableBit DrivePool. I don't have to care about specifics and can just add anything to a pool and it gets duplicated as often and as much as I want.
@@CheapSushi Their website has no mention of parity and a Google search yielded no straight forward answers. Does it support two disk parity or redundancy?
you should do clear plastic LTT screw driver but then do the colors like the see through N64's you reviewed. i would buy in a heart beat!
“I always use protection.”
Says the man with three kids.
He's just bad at it, that's all lol
8:32 Clouds are for rain 🌧 - Louis Rossmann
14:00 Unraid is probably the same deal as ESXI regarding Flash Drives - it just loads some stuff from the Stick into RAM and doesn´t really write anything to the Stick itself, instead writes config, logs etc to the drives.
the rebuild only needs to take as long as the largest drive in the array. the extra space on the parity drive does not have to be calculated in this intermediate step. Once the 2nd new parity drive is installed and you have to run the parity check again - you can let it run it's full check.
you can do a new config and check the "parity is valid" to skip the 14 extra TB calculation.
there's a lot of bad information in this video, and it hurts to watch, since unRaid has come so far over the years.
I love these server/homelab videos. Its always great to see all these different setups in action and their issues.
I always love these storage related videos since I can relate a lot, I run my own NAS in a Supermicro 24 bay chassis at home, but use mdadm raid, and way older/cheaper hardware. Recently added 7 10TB drives to grow 2 of my arrays. That was an interesting undertaking, basically replace one drive at a time and let it rebuild. I have a file system limitation where I can't have partitions bigger than 16TB though which is kind of a bummer. I need to fully update the OS but I don't want to take it offline. The challenges of storage servers... :P
FYI, there are a couple of mistakes in what was said here. First, the parity drives in unraid are not exact copies of each other. If there is one parity drive it uses raid 5 math, if there are two parity drives, it uses raid 6 math. This allows any two drives to fail without losing data, if they were mirrored you would only be able to lose a second disk if it was one of the parity drives. Second, there is a simple process for what you were doing. Unraid refers to it as replace and rebuild. First it copies all of the data from the parity drive to the new larger drive, then uses the old parity drive to replace the broken one, and rebuilds the data on it that. It's literally point and click.
Man your servers keep breaking so often, you almost end up producing more content with it than you store on it.
Then again it's only a n expected gradually breakage since as you see the dead one was from 2016. Everything will degrade with due time... just gotta be prepare for when it does.
I would love to know the plugin that will make truenas work like unraid with the disks like that.
Having a big explainer videos about NAS, what they do, how they operate, what kinds of operations they can do, and which software has which pros/cons would be a REALLY useful video!
Looking at 9:46 when linus says "we do a guide but figure it out as we go", it sounds like it could even be useful for you guys!
100% (to both parts!), and also this 100% will not happen until that secret NAS/RAID startup he invested in comes up with a finished product. I wish that would be in the form of a detailed comparison as well, but am afraid it will just be a how-to for the new software with occasional mentions of the competitors and their downsides here and there ...
That loading logo at 18:04 being in time with the music was so satisfying
i NEED that "normal" ltt screwdriver that jake has it looks soooooooooo cool
Finally some server content, I love watching these one's fr🤝
The server stuff is the only thing I enjoy on this channel - so much overkill stuff, I love it and no “hidden ad” in ad sponsored video with youtube ads on top… just geek stuff
At one point Linus says 'Don't you love it when we do a guide but we figure it out as we go?' but I don't really think it's that odd. Like literally the day before yesterday, I called a plumber. What I wanted them to do was install a bidet seat that I had purchased but which I couldn't install myself (limited tools, very old house and toilet, it would just be cheaper to have them do it). They had never dealt with installing one like the one I got. But, they were professionals, they knew the tools, they knew all the necessary concepts, so I had absolutely no problem handing it to them and being confident they would figure it out. And they did, got it completely set up in an hour when it would, without question, have required me buying a bunch of extra tools and taken me 2 days or more to figure out the various hurdles they had to clear. That's what experienced professionals are for. Not necessarily to drop in and be like 'I have done exactly this before, I will repeat my prior actions exactly' but more 'it doesn't matter this situation varies from my experience in many ways, I know how to handle all the ways it could get hairy'.
It's not odd at all to figure things out as you go in normal working conditions, but when you're making a guide on how to do something, it doesn't exactly engender confidence if you're clearly winging it. The point of a guide is to show you the correct or best way to do something. I would take this video as more of a vlog type thing than an actual guide.
11:40 Yeah... I feel ya Linus. I did a server migration cuz the raid card died. 1 of the drives were dead (busted pins cuz prev tech screwed up), oh and the backup drive (WD My Cloud Live), died during the same migration... Had to guess the hardware raid settings to reconstruct it. Never sacrifice a backup 'just because you have a spare'... Because murphy's law, that backup will die too.
I thought the parity drives are Different on Unraid? They use different algorithms, so not perfect copies
True, they are not mirrors
When starting with OMV or unraid, always use the largest disk (or oversize) for the parity drive(s).
Looking at the days of rebuild/recovery time, of the parity and size restriction made me think of going to the EC based solution like local Minio cluster though it has very few support of applications vs those file system based solutions. Other factors include IO capacity of file copy and wiggle room for large file operations of cluster rebuild or upgrade.
4:43 be VERY CAREFUL when pulling a hot drive. You must let the spindle stop before rotating it because it can cause a head crash.
Don’t worried his pull out game is strong
i'm pretty sure modern drives instantly retract the r/w head off of the platters on power down/loss.
the reason you don't rotate the disk while it's spinning is cause the platters are spinning very fast and have a lot of angular momentum like a gyroscope, so if you rotate the drive, the platters will experience lots of perpendicular force, which isn't good neither to the platters nor the spindle motor.
It can't cause a head crash. It could break the spindle motor.
The head unloads the instant the power is removed
Modern drives will park the head instantly when power is lost.
The system is off, otherwise the parity will be completely destroyed when you take out all the drives one by one and you hit both parity drives + extra drive.
FYI - you can plug your UPS in to your unraid server via usb, and it can send a shutdown command when the batteries hit a certain threshold.
Yes, although it sadly doesn't seem to support groups. Using Eaton's IPP instead myself because it was the only way to get the UPS to shutdown the server's outlet group after going off, and make it turn it back on when AC comes back while keeping other outlets on for network and cameras
You can also do this using another server (homeassistant ahoy) and something like Network UPS Tools.
@@superslash7254 You can even run NUT on a raspi with its own usbc backup battery and have it wake on lan your server when power is back up.
I am just barely getting getting into the home server thing (currently running a Libre Computer le potato with a mounted 2TB HDD) but these videos are really fun and encouraging. Looking forward to having a rack unit one day with even one redundant drive!
6:35 He keeps recommending Unraid, but has never checked if it actually restores a degraded array? Top notch 😕
Beware of the "exfiltration" cost of the cloud.
unRAID was extremely critical to me being able to secure my data on a budget, as well as having something I could build a home lab out to learn all my professional stuff on and gain better employment. I would have never been able to afford a system that was running TrueNAS with the disk requirements to build a raid there.
It allowed me to take existing disks from old PC builds and and least cobble something together, while enabling me to upgrade it slowly over time as budgets allowed.
I can understand why Jake doesn't like it, but I don't think it deserves all the hate it gets.
The other nice thing about unRAID is that if you lose more disks than your parity you can still read all the data off the remaining disks by just slotting them into another computer. You only lose the files stored on the individual disks that failed.
I went with Windows and StableBit DrivePool instead but I gave zero Fs about being in that industry, hence zero Fs about Linux and offshoots. I have zero regets. I have 3x 4U Rosewill chassis with drives. StableBit DrivePool is beyond easy, and never have to worry about any issues with drive replacements, drive sizes or expanding pools.
@@JuiceSpringsteen88 Wouldn't this completely negate one of the reasons for using traditional striped RAIDs - the IO speed increases you get from writing across disks? I guess in archival storage it wouldn't be an issue so much but seems like a terrible solution for anything that needs speed. It's definitely pretty interesting that it's basically a spanned set with a couple of dedicated parity drives rather than striped parity.
@@CheapSushi
That’s an interesting way of saying that you done care about the integrity of your data.
@@reemnizzle9134 It's a downside of unRAID. It's literally not RAID (as the name suggests). unRAID is targeted to home users and people just getting into NAS homelabs. It supports unmatched drives so you can upgrade at your own pace and it has a super easy GUI for everything. I recommend it to lots of people because it's super easy to pick up and just put together a simple NAS from old parts they have lying around.
The way I handle this is to not fill up with all of this in the first place and just use a Sandisk Extreme V2 3.63TB SSD for movies&games, a V1 1.81TB for video editing, and a thumb drive to store my tools/drivers/ISOs. If I ever got a raid setup, I would use TrueNAS and find an infinitely replaceable set of drives I can purchase years into the future to replace the failed one. Shouldn't be hard to find individual sellers on eBay that can resell brand new or refurbished drives at a good enough deal.
Funnily enough I have done this in Synology and it's super easy to do. Pull bad drive out, put good drive in, system rebuilds.
8:32 I 100% understand Linus here. For some reason using 3rd party cloud storage for anything but the most unpersonal unimportant stuff creeps me out immensely. I do all of it locally and even host my KeePass database myself (luckily my router has options to do stuff like that though only effectively for small files because of cpu/ram limitations). At the moment I'm in the process of building a data server (coincidentally with the exact 16TB Exos drives Linus showed in the vid) for myself and my partner and after that I will build a second one in my parents house for offsite storage (since The own a previous farmers house with several buildings for animals and 2 barns, so there is lots of unneeded space).
@@Taudris tbf building and maintaining two servers is very much a bonus for me and trusting myself is always easier than some corporations - I also despise monthly payments; it's bad enough I have to pay for the essentials (rent, water, electricity, insurances, etc.) I don't want to add any more to that than I have to
Edit: meaning: even though your reasoning is probably sound - it does not appeal to my feelings unfortunately
TrueNAS for me... I don't mind just planning ahead and getting matching disks... although older arrays with smaller disks are getting harder to find replacements for a good price/Tb. Also If I need more space I have to bite the bullet and grab a stack of new drives. All that aside, using snapshots I have 3-2-1 backups automated across two servers and one offsite in an adjacent building. I can rest at night.
Same here. Starting replacing 4tb drives with 8tb drives as they died or I moved them somewhere else when the pool reached 70%. Now at 79%. Either some of the remaining 3 disks die or I will replace them anyway within two or three years I guess.
You don’t need matching drives for truenas (or at least ZFS in general). As long as the new drive isn’t smaller than the old one, any drive will work.
@@guspaz Yes, that is correct. You can start replacing the drives with a larger size and soon as all drives are replaced TrueNAS ZFS will automatically expand the array.
@@guspaz Don't "need" to be matching... although my tech brain will not let me physically do that. (lol... OCD gets the better of me and I start spending for new matching array)
@@soniclab-cnc yeah you don't need matching... but you won't get the extra space unless you have replaced all the drives. Matter of fact I have another nas that started with 3tb drives now all are 4tb except 1. Guess what: not getting any extra space until I replace the last one. In ZFS that is how it works and it is stupid to have different sizes unless you are doing precisely what I am doing. Talking raidz1/2/3. Of course with mirroring you can have couples or triples of the size you want and stripe them. But different sizes inside a vdev causes waste and makes no sense unless it is transitory or you are repurposing misc drives.
Did Jake just forget how magnetism works? Steel screws are ferromagnetic, so you don't have to like rub a magnet on them to be able to attract them with a magnet(ic screwdriver).
Hi,
for some reason, this video gave me the final push to order a Noctua edition sd. Although, I have been watching you for like a decade now. I mean your youtube content 😅
Love you guys,
Keep up the good work!
Love that the random pool of water near the server rack was completely ignored
Pretty sure in unraid the two parity drives have different data. Parity one is a bitwise checksum across the array, literally if each bit across the array is odd or even. This doesn't work if you lose more than one drive so unraid uses another data algorithm that I have never fully understood for the second parity drive.
Yeah it would be impossible to restore 2 drives worth of data from 2 copies of the same parity data, that doesn't make any sense, the data needs to be different between the two or else you'd only be able to restore 1 failed non-parity drive (though one parity drive could fail at the same time without losing data)
I only mentioned it because at 10:30 they say that the parity drives are exactly the same.
How about thinking of the second parity disk as a way to safely and easily upgrade or replace parity on event. #timemanagement
Samsung BAR drives were tested by SpaceInvader One with the best endurance and cooling potential.
Also - use a USB2 header to USB-A port adapter to keep your USB boot drive internal 😉
Remember kids, RAID is not backup.
I love servers videos, I think they are the best. And the way Jake installed the hard drives saves 5°C on the temps
Working daily with enterprise storage I must say unRAID is exactly what you need for a home server. You dont' get the speed of X spindles in RAID but it's so flexible. If only there was a way to get snapshots...
This. The blind love for truenas in home scenarios is misplaced.
Also, unraid latest release officially supports ZFS now too so you have both types of arrays if needed. Best of both worlds.
@@bearhaus2418 unraid is great for home use for sure. Especially the mismatched drives raid. Saves money. Wouldn't use it in production though.
Can you discuss the scalability of Unraid OS in terms of adding storage drives and expanding the system over time?
8:29 Though I have once before seen the explanation for the 3-2-1 rule as depicted on the screen, the usual one is that the production data is one of the three copies. So you should have (1) production data, (2) a local backup on a different device), (3) an offsite backup.
That's not what 3-2-1 translates to, while the onscreen version also wasn't exactly accurate. Off the top of my head, the rule goes "store [3] copies (as in instances, not as in additional duplicates - so yes 1 of them is production) of data on [2] different media with [1] of them off site". This more concise version rolls off the tongue better, and hence is meant to be easier to memorize :)
Can anyone comment as to which plugin Linus is talking about to allow TrueNAS to have pools with different sized drives?
I'd love to know too. I'm thinking about putting a NAS together, and can't decide between TrueNAS and Unraid. I like the TrueNAS interface and cost (free), but Unraid's flexibility with being able to mix different sized drives in the array would making expanding/upgrading the NAS over time so much easier.
Someone had also made a comment on the LTT forum thread in the video description. I'm hoping I can come back to this comment or the thread in the next day or 2 to have it answered 🙏 😊
Running an 18TB Exos, and really pleased with it. No problems with it, unnoticeably fast read and write speeds, and it was good value at the price I bought it.
Only downside with exos I've found is that they do tend to be a bit louder, if you're using them directly in your PC rather than a home server or nas in another room.
@@Californ1a that's true, it is noisier. Doesn't bother me cos I've always got headphones on, but they wouldn't be as good for a build where low noise was a priority
Great video, as timing would have it, I just went through this very scenario on my unraid home nas. I did it a bit differently though.
Since the content of the dead drive is emulated, using the "unbalance" plugin on unraid, I moved the data from the emulated dead drive to the other drives (of course this only works if you have the space) and then removed the drive altogether. Once both parity drives where replaced (1 at a time, if you do both, I believe you loose parity so if another drive dies while you're rebuilding the parity, then your'e s.o.l. but I may be wrong here, I just did it that way as I wasn't super sure) and done. Once done, I used the 2 original parity drives as new storage drive and used "Unbalance" once more to spread out the data to said drives.
In an ideal world, of course, you'd have that third drive to properly replace the original dead drive.
You're not wrong, and they kind of did exactly that - rebuilding 1 parity drive AND 1 data drive at the same time, putting all data at risk once another drive fails, which is what they said to avoid in the first place but then didn't. 8 green lights while having 8 data drives should instantly ring the alarm bell; ironically not only simple math but even just counting dots is already to much to ask for apparently lol
That unbalance option is an interesting alternative when you don't have a replacement at hand immediately, but enouth space left - thanks!
Love the overlap from the water cooled pc video too
Jake has really grown on me over the past 12 months or so. His knowledge on these server vids is great and is making me wanna setup a home server/raid/nas thingy at some point. Thanks LTT.
Linus: "They're supposed to screwed in-I don’t see any screws-we got one screw, boys. Yep, this server was built by me."
Also Linus: "Two screws is enough."
That's double the previous count! Progress!
Many server and workstation class boards support serial consoles, so you can take a laptop and a serial terminal program to see the console/BIOS screen output.
another tip, all 4 of my 8tb drives are wd externals i chucked, you need to not connect the 3v pins or use a silverstone style sata spitter, but they are not shingled and are full perf drives.. the firmware just causes them to restart over and over if 3v is connected... heh..
Take the array offline and use a hardware drive duplicator for the parity drives you wish to replace, swap out the old with the dupes and power it back up. I've done this with linux mdraid in the past, as I had a (8x4TB) RAID6 array with 2 dead drives and 2 that didn't look like they would survive the rebuild process before the dead replacements were able to complete their rebuild. It was a nail biting couple days, but it worked.
I was also surpised that drive duplication didn't even cross their minds once (unless it was edited out, which I doubt).
Well, to be completely honest, I wasn't. lol
Jake is great - passionate, knowledgeable and skilled, LMG is lucky to have him.
True. Linus isn't as "mediocre" as he plays to be i recon ;) It makes for interesting content though.
Windows Storage Spaces allows you to mix and match drives and just spreads data and parity information across available drives. If you have more disks than the parity needs then it can support different size disks. No need to worry about which disk is data and which is parity because they are all both. I haven't had to rebuild any data tho but I have swapped out smaller disks for bigger disks
Is it possible to expand the array by single drives tho? I'm not aware of any solution allowing this without dedicated parity drives. Or in other words, I don't know any solution with parity spread over all drives while also allowing incremental expansion (without a complete rebuild of the array). From all I know those two features are mutually exclusive.
@@misatzu Yes you can increase incrementally. If you want to change the ratio of data to parity you have to make a new virtual drive so if you want 7+1 you need to start with 8 drives but you can then add drives one by one. That's what I've been doing. I actually started with a JBOD virtual drive but since they are thinly provisioned I could just move data from that one to the parity drive I set up
@@antivanti Hm, you say you can add single drives but also you have to make a new virtual drive when changing the data/parity ratio. At the end you mention a dedicated parity drive when your og comment (and my question) was all about distributed parity. This is all really confusing :3
Also I need dual parity which at least requires 7 disks ...
@@misatzu No drive is a dedicated parity drive. Every drive in the pool is split into 256 MB chunks. With a virtual drive with 5+2 parity every set of 7 chunks has to be on different drives but the next set of 7 chunks don't have to be on the same 7 drives so over a number of such sets of 7 chunks it can spread evenly over 9 drives. And when you add a 10th drive it can move some of those chunks to that drive as long as it only moves at most one chunk from each set. So you still have 5+2 parity but it is spread across 10 drives. And you can still survive 2 drives failing. So adding drives doesn't change the parity setup. But if you do want to change it (like going from JBOD to parity like I did) then you need to create a new virtual disk on your pool
So seeing that chassis also brings up an interesting topic:
What happened to NORCO? I notice that's an RPC-4224 which was a great budget chassis in it's day, but now Norco has fallen off the map completely, their website is down and all of their products are out of stock. Presumably they went out of business but it seems like a topic worth investigating and covering. Plus, getting the word out there to people who could be putting themselves in my shoes (I bought a RPC-4224 later on in Norco's existence) from doing so. Now if any of my backplanes fail, I'm in the market for a new case, as well as whatever damage ends up happening to the drives connected to it.
Good on you for getting that hardware out of there before it becomes a problem.
Oh hey you guys broke the side cable guard off on yours too! I designed a 3d printed replacement for it.
I actually migrated back form True Nas to Unraid as containers are a lot more simple and I was fed up that nextcloud constantly breaks with k8s helm charts and unraid is a lot more flexible and easier to repair
Containers on TrueNAS are horrible when compared to UNR.
I'm pretty sure that in unraid, when you have two parity drives they use different algorithms to allow for two drive failures. So the two parity drives don't contain exactly the same data. And one of the reasons for unraid having a limit of 30 drives in the array is beacuse they don't have two different parity algorithms they can use that work with more than 30 drives.
I ran into this problem and broke my array by trying to go from 4TB drives to 8TB. Luckily i had backups of the mission critical data and only lost the unimportant stuff.
My UA-cam app actually broke during the intro where he was pulling the drives out, right after he said he still had a problem, I thought it was the editors that did some joke. It was jumping between linus talking and playing some disco music, playing and pausing over and over for a good minute.