How To Store LOTS of Footage Without Google Drive - Building an Editing NAS/Server
Вставка
- Опубліковано 15 тра 2024
- Protect yourself with Nordpass and a 30-day money back guarantee ► nordpass.com/senpai
MERCH ►► senpai.tv
UA-cam ►► / harrisheller
DISCORD ►► / discord
TWITTER ►► / harrisheller
Links to the gear in this video (these support the channel 🫶🏼):
Synology RS1221+ 8-bay NAS ► amzn.to/3wCcd7a
Great 2-bay Starter NAS ► amzn.to/42YQqTd
Check out @SpaceRexWill to learn ANYTHING about NASs
-----------------------------------------------------------------------------------
STREAMBEATS Copyright Free Music for Streamers (and UA-camrs!)
15 GENRES! ►► s.enp.ai/streambeats
DOWNLOAD FOR FREE ►► streambeats.com
-----------------------------------------------------------------------------------
Starter Streaming Kit ►► kit.co/HarrisHeller/the-strea...
Pro Streaming Kit ►► kit.co/HarrisHeller/the-pro-s...
MY Streaming Kit ►► kit.co/HarrisHeller/the-harri...
-----------------------------------------------------------------------------------
Chapters:
00:00 - Greatest storage server of all time.. the GSSOAT?
00:55 - Everyone needs a password manager - Nordpass (sponsor)
01:59 - What am I putting inside this first NAS
04:10 - This part took 4 days 👁️👄👁️
06:15 - Testing the speeds.. can it edit 4k?
06:54 - Installing my editor's NAS for INSTANT FOOTAGE SYNC
09:07 - Can it edit 6k?
10:03 - How fast do the two NASs sync up? Speed test
10:57 - 5 Tips for building a NAS
-----------------------------------------------------------------------------------
Other Videos:
USB Mic Showdown: • USB Mics - We Figured ...
50 Twitch Tips and Tricks: • 50 GAME CHANGING STREA...
Turn Your Webcam Into A DSLR: • How To Make A Webcam L...
Buying 3 Logos From Fiverr: • I Paid 3 Different Fiv...
Why Twitch Growth is (almost) Impossible: • Why Growth On Twitch i...
-----------------------------------------------------------------------------------
Description tags, yo: Synology, NAS, server, HDD, SSD, editing, 10gbe, gigabit, ethernet, RS1221+, Davinci Resolve, Final Cut, Storage, footage, archive, Synology DriveSync, Google Drive
Thanks For Watching!
#Synology #NAS #Server #Storage - Навчання та стиль
Ok but like do you have a password manager, yet? This is not a joke, Jim. Sign up here ► nordpass.com/senpai
NO!!!!
include , . : in your passwords to screw with CSV files...
I wouldn't recommend putting consumer grade SSDs in a NAS tho. They're not suitable for that kind of 24/7 runtimes. Pls look at enterprise SSDs or the ones from Synology that are especially made for that use-case.
@Senpai, you should do a video helping your editor finish and clean up his basement! That'd be dope. Homie working in a mess!
Literally in the middle of building my own NAS setup. I can definitely share that excitement because having to wait for long transfer times and dealing with cloud storage with remote editors SUCK
I don't often watch these videos because I'm enthusiastic about hard drives, but I REALLY enjoy your personality, the way you present and deliver information. You're a creator I aspire to be like.
I've been editing for people who use Synology and it revolutionizes workflow. Also worth mentioning is this makes DaVinci Resolve Cloud Editing mindbogglingly efficient.
How does it work on davinci? Can you add that nas as a Black magic cloud?
@@unlockthepicture Footage is already synced with the NAS, so if you’re using Network or Cloud libraries, multiuser editing becomes basically automatic without needing to adjust folder structures, creating new proxies, and uploading/downloading in-software.
This is the fourth time over the last three years that I’ve had a roadblock issue and you’ve given a blueprint to solve it. I sincerely appreciate it!
hell yeah
Last year i did extensive research about NAS myself but this is also a great additional resource. Aprreciate it.
He finally built an Editing NAS/Server. LMG did crush it first. But hell yeah Harris, congrats. A long time coming. (Context Linus Tech Tips has multiple Petabyte storage servers) and I hate making comparisons between creators. As both are extremely accomplished in their fields.
Linus whoooooo?
Yeah, this is awesome!
A dream for every content creator and editor!:D
Good job Harris!
Now let's enjoy the freedom!
I seriously needed this video! I'm shocked you covered this random topic lol, but so glad you did!
At 9:55 Me too , I have a NAS because of Will from Spacerex , Frank from Wundertech and Robbie from Nascompare :)
honestly one of my favorite videos bc no one really makes good info on storage that is also relatable. Might have to look into this.
This video is actually super useful. Glad you shared this!
Now this is what I call SMART time management 👏🏼👏🏼👏🏼
helllll yeahhhhhh
I have a good few bands and regulalry record video from different angles in 4k and then have the multitrack audo files to mix as well as some game recording ive been trying to get into lately. Been thinking about getting a small home NAS to store everything and this sealed the deal. Thanks!
I'm not a video person, I do a radio show so my data volume is no where as big. I use an old SFF office PC (Core i5 4590T, 8Gb RAM, 256Gb SSD) as a Ubuntu Server running Nextcloud AIO, WireGuard (VPN) and a Plex server in Docker (Media for plex stored on my TrueNAS Server) and Webmin for Admin. This automatically backs itself up every night to my TrueNAS server in a different room at 2am every morning.
The TrueNAS server (Core i5 4440S, 16Gb Ram) has 2x 500Gb Seagate, 2x 2TB WD RED and 2x 3TB WD RED hard drives in it. These are mirrored. The 500Gb drives are the boot drives, the 3TB drives are where my Plex media is stored and the 2TB drives are where the backup of Nextcloud goes, along with my software archive.
The TrueNAS then gets backed up to 2 external HDD for a 3rd copy.
This cost me about £3-400 all in, including the HDDs and I have had no problems with it what so ever.
TN
I've been thinking about getting a NAS for a couple years now. Simply so I can edit at my desk orrrr on my couch 😅
Love it, Will 100% use this. will def be on a smaller scale haha. but fkn legendary idea and appreciate the awesome vid as always. my setup and gear looks like it does because of your videos. keep up the good work sir.
Thank you for always sharing the stuff that matters. Not anywhere where I need this yet.... But I know where to find this info when I do.
Great vid, I work in IT and setup 2 Synology's for Photo Editors and they could not believe what was possible
We have a Synology at my office and I ABSOLUTELY love it. And I really want one for my home, but man .. dream. Why do kids eat so much!? Daddy needs a NAS!
Actually, did you know that, biologically, kids can go completely without food? Just not for very long.
@@Senpai Well, well, well ... sorry boys. Senpai said NO SOUP FOR YOU!!! BWAHAHA!!!
bro is just uploading flexes at this point and i love it
Ive been using a NAS setup for years, its solid tech that can flex with your needs.
I use the 8 bay synology unit - I don't like your decision to go RAID 5 I would have preferred RAID 6 since you get 2 drive redundancy but you do have an external backup. I have had to do a rebuild before and its stressful as it thrashes disks as they rebuild - 1 drive redundancy without another NAS backup offsite = Your data is going bye bye at some point
Yeah, once spinning rust got to be larger than 2TB, dual redundancy is really a requirement. With single redundancy and 22TB drives, the odds of an error cropping up just doing the reads required to rebuild after a failed drive is swapped is rather high.
Also, remember that syncing isn't backup. If you sync a delete and don't catch it in time... Or worse malware decides to hit your shares... I'd repurpose that older NAS for actual backup drops instead of just being another sync'd clone and then look at an external option as well ala Backblaze, etc.
As a systems team manager I agree with how amazing this stuff is. We use it to sync our engineering models and drafting documents across multiple sites and factories, it is a game changer.
This is so perfect! Im ready to ditch dropbox because its not as user friendly as it claims and doesnt sync across harddrives as I hoped and synology is top of my list for where im going to next. The 8 bay is what I was looking at but now im looking at your new setup... so cool! Thanks Harris!
thats awesome he got naaackers in the promo lol and thanks this really is awesome great video and def gonna look into one since i was the guy with multiple hd drives laying around my desk so again thank you guys
He said "you don't care... uh..." hahaha. Also just finished so adding more. I'm a super small creator, doing art stuff and inspirational artistic videos from time to time. Love seeing this stuff even if it isn't super important for me right now. But, also following a lot of your stuff it's exciting for me to watch you succeed and see all the cool stuff you're making!
Rebuilding my whole homelab. Proxmox server was first, NAS is coming next. Somewhere in there going to install a 40gb switch to use for even speedier transfers off NVME drives. It's been fun going through lots of UA-cam videos on the subject to see how people handle things like homelab servers, and nice setup!
As a System Admin, great video!
lol, im migrating a 40 TB right now watching this, been running for 18 hrs or so already and showing 12-21 hrs to go still :) Big boy data sets :)
Thanks for this video really timely for me I was wondering what raid means though not really sure how that works but I am definitely going to be building a NAS system
Great video, anyway you can go into another one with a budget friendly build of a NAS system, I time something like this would be amazing, but just starting what would be good options?
I have the El Gato Wave 3 and it has been amazing. Got it on sale for $120 a year ago. Highly recommend .
Love this kind of stuff . $$$ is a thing... Still fun to watch.
I can see your microphone…. the shotgun mic setup was iconically clean!
Can this be a replacement for editors that can't have the same hardware?
I have a Nas synology set up at home, but my editor is in the UK. I wonder if he can just access my server instead of paying $150/month for frame.
do you have any previous videos on how you organize your files all the way from raw footage to what gets used in videos?
great you leveled up and learned some things - i could see you moving to 4tb raid0 and raid 10 with 6 drives to further increase sync speeds? you may be able to goto 40g from your ws to nas and get fiber so there could be some more headroom for perf boosts now or in the near future - good solution and insight - great enthusiasm and praxis - it was earned
Great video! How fast are your internet connections to be syncing two NAS's across town? I'm guessing you both have fiber?
A 4Gb file in 54 seconds is close to 70Mbytes/sec or 560Mbps. So I'd guess they both have 1Gig fiber allowing for external factors.
Awesome video 👌 should check some of the unraid stuff lmg have done
We all know LMG doesn’t count. This is an incredible solution for smaller companies and creators who don’t have a huge team of editors.
We run 4x Synologies, and sometimes they report a fail but succeed at the same time. File names can be an issue sometimes. Also big files can sometimes give them a bit of grief. The BackBlaze app is pretty dope though.
Be sure to don't leave anything sitting on that Raid0 alone, unless you like crushing defeat. The Auto-sync to mechanical is a good approach to keep it safe.
This video was over 500gb.. having the NASs on this saved our lives. Also, the RAID 0 array is always backed up to both HDD arrays as well as my old NAS. We're all safe over here.
Auto rename to yyyymmdd-originalFileName works wonders for me...
also helps that finalcut automatically makes proxies. If you were editing direct compressed mov files over ethernet, you have a whole different story. Shouldve disclosed this because most people edit on adobe, and will try this and realize it doesnt work unless youre using proxies (OR) you have a 10gbps connection to the synology.
I built a Synology NAS, but for some reason I was not getting near the expected gigabit speeds with my NAS connected directly to the Ethernet and my laptop connected to another Ethernet port. I tried troubleshooting it for a while and ended up just building a DAS (direct attached storage) instead with the Thunderbay 8. That thing is soooo fast, and 112TB of RAID 6 has served me well over the years. I’m going to have to get more storage very soon and I’m considering trying to set up a NAS again!
I have one snap and keeping my photos my backups of my 5 pcs in 3 different places I have also I keep a small iCloud and the extra goes to Nas. Now I am trying to build a free Nas custom build not going very well with the remote access but I will fix it😂
12:10 - Just a note that 2 SSD's 1TB each in RAID 0, would give you 1TB of space with the speed of the 2 SSD's combined.
8:51 - "let me be struck by... a flying ice cream truck. AND LIVE!"
You're a braver man than I for storing something on a raid 0'd array.
The stuff you're working off of a RAID 0 is a duplicate of what's on your archival array. So at the end of an editing session you also save a copy to the storage with redundancy.
Storage is always a huge issue for me. I definitely need to look into this when I can work on getting more. I backup all my streams until I get that dreaded output storage error message..
Its the first time I see this in details, so I dont understand everything, but it is very interesting 👀
I was gonna come over and clown on this, but then I saw it was Synology. I have a 100tb synology nas that we have all of our stuff, our backlog of our re-encoded videos, all our family files, and my giant Plex media cache (from my own files - I own all the blurays and cds, calm down Karen). 100% I support this option. Mine isn't as fancy as all this (4x1gbe, and 1tb of NVMe cache), but it still works great.
Question: And I might have missed it, but did you mention the VPN connection and the UL/DL speeds of your ISP connections at the offsite editing NAS and the NAS at your location?
9:31 more UNINTENTIONAL foreshadowing... Can't wait to see that video.
What Mic stand is that? the swivel is sooo cool!
Even tho this sounds like a foreign language to me now, I've been wondering how would I store things like call of duty clips and skate videos etc.... so I'm idk how helpful this video is to me yet but I'm sure once I get into it ima love the hell out this vid 😂 🙏🏽 "...and as always... happy streaming."
I'm thinking of doing something similar. Could someone simple buy 2 of the Synology Disk Stations over buying 2 of the rack mounted NAS? I'm trying to understand why the rack mounted option is superior.
Love the content!
Fight you? No, Linus Media Group already solved that...
I boycott Linus Media Group as should we all.
SIMPSONS DID IT! SIMPSONS DID IT!
@@MrJBA79why??
Linus worked his staff like slaves forcing massive workloads and arbitrary deadlines to keep up a ridiculous pace.... for years and years. This resulted in them basically fabricating data just to keep their heads above water with Linus' pace. So people were making purchase decisions based on inaccurate data or purely fabricated data. Turns out he is a real premadonna and the verbal and mental abuse that he inflicted on his staff can't be justified. @@goldernie
@@MrJBA79? Why?
I would LOVE to have that much storage :D
I would have installed 2 NVME drives ( 3ish+ GB/s write, much faster read) to the 10gig nic as they are way faster than SSD's (500ish MB/s write 1000ish+ MB/s read).
I did. We saw no difference, mostly because we saw zero bottleneck with the SSDs. We ended up attaching them to the HDD volume instead so when we pull data off those drives it's just a fast as the SSDs. It's dope.
Why did you not use the rsync to do the copy it also great to use as offsite backup
Great video.. I liked your setup. Now... can you achieve the same with... off-the-shelf tech which shall we say is now on the aging side of things, that might be slightly more.. affordable to those at the start of their videology journey? That's a video I'd watch.
Question: Are the files on the SSD backup up on anywhere?
With rad 0, if one drive fails, you loose EVERYTHING on that raid
I guess the remote site is a backup, but just curious.
from what i gathered he said in the last part that they mirror to the HDD's aswell basically as a backup other than the long term storrage.
@Senpai Gaming I think you missed some of Linus' videos on this exact topic. Your setup looks dope, but it would habr been great to have some sort of collab on this.
You still need a fast internet connect for it to sync that fast between 2 locations
The things I would do to have this for my house…..I’ve been needing this for 15 years 😢
More of these videos!
Completely off topic, but can you possibly do a review on the roland bridgecast/ bridgecast X?❤
Would adopting SFP+ cages instead of 10gb ethernet be better for internal transfers for large file transfers?
SFP+ is 10gig either way. The difference is in the cabling and infrastructure. Fiber (SFP+) CAN have lower latencies, but on a local network it shouldn't make a noticeable difference.
At 5:18 , why did you choose raid5 since you have a lot of drives ? Yeah long term storage but that much data with only one safety net , you should use Raid6
how can i get build a little NAS setup for a starting channel and small business at cheapest as possible? mainly editor will be me but i would like has someone on remote to work from his house to don't came at the office/workshop. my internet speed is 1Gbps upload/download.
Ways to Level Up Above and Beyond this video:
- TEST YOUR BACKUPS. Try to restore a file from backup every now and then. Untested backups are wishful thinking. Yes, I 100% wish this were automated.
- Synology NASes often support an expansion bay or two, often doubling the number of drives that can be supported by a single NAS. Check the specs for your specific model.
- Evaluate your risk profile before using RAID 0. Yes, it is the fastest. But if one drive fails while you're writing data to it, there goes anything not synced. Given that magic NVMe/10g networking card, I'd rather RAID1 two NVMe drives. Yes, it costs more. For me, the peace of mind is worth it.
The type of nerd I am: I got emotional watching those Read/Write speeds when you transferred files remotely.... 😭
wish this video focussed a bit more on the file/folder organisation!
Im curious what 10 GB card he is using.i am wsnting to update the home network to 10 gb
I like that mic stand what is it?
I am still confused where the backup is going. Is the backup on the same disks as the two production machines? I am also wondering if there are any hot spare disks assigned. This seems like a very risky system. I would think again about this setup because it seems very unsecure.
I think it's going to the local one and immediately syncing to the one in the other location. So the local one is raid5 so if drives fail it can be restored. If there is a catastrophic failure, Dustin has all the information at his site as well. EDIT - he also explained it towards the end of the video.
@@Turbojugend27 And what about malware (crypto ware)? If one side gets infected then the malware is copied automatically over to the other side where everything is also infected and everything will be encrypted. So, where is the backup in that situation?
Great video. Can someone elighten me on the reasons to keep all this footage? I do a yearly purge which is basically the opposite of this...
Was thinking the same. What's the point of saving a 45 min video of Harris building the nas?
Just for posterity. I'd love to have footage of my grandfather or great grandfather building a machine for 45 minutes 🤷🏻♂️
Another use is to eventually use AI to go through all the footage and automatically find interesting bits like "make a video of all the lessons I've learned while building computers in the last decade" and the AI will find the one time you cross threaded one screw and how you learned not to do that (example) where it would be impossible for a human editor to go through 1000's of hours of video to find those
@@goldernie I guess that a reason
if the other storage unit is on his editors house
I dont understand how this could possible make the process of load the files faster for his editor
I would think that he has to transfer the files using the internet regardless.....
could someone clarify that for me, feeling real dummy here for not understanding it
They are ditching a middle man that could be a long ways away on hardware not optimized for the transfers. The server for their Google Drive could be hundreds of miles away, changing ISPs etc. In this case, they're pretty much both likely using the same IP a few miles down the road.'
I agree with ckwi2245. Plus he also mentioned that alot of the transfer was manual so they'd be copying files to/from Google Drive onto local storage. This is no longer needed. They can both access the files directly of the NAS.
As Always 👍
14:00 so since it’s syncing, if someone deletes a file from one, it will delete from all, no? How does that keep the files safe?
I'm a simple person. I see Harris upload a video, I hit the like button before I watch it.
You may not like it, but this is what peak viewer performance looks like
@@Senpai the video has got me thinking about my own storage, so I'm really thankful that you posted it 🙏🏽
I'm filling a box with 4tb external drives of footage probably never to be sed again.
I know you put yours in a different room, but your editors is in the same room as his editing station. What are the noise levels like? Is the fan super loud, or is it fairly reasonable?
This is Dustin the editor. This particular one sounds like a PC on low fan speed. I barely notice the noise
@@Senpai Awesome! Good to know.
And thank you!
Storage is ❤🔥
Maybe i missed it, but it doesn't look like you are using snapshots. Let's suppose you are infected with ransomware. Without snapshots you are simply syncing your encrypted files across three platforms.
In addition to protection from ransomware you can also use it for regular version history (Apple time machine???).
Unless mistaken, i believe you still have some room for improvement in your current setup.
Spacerex is awesome.
how quick is both of your internet connection?
Fiber 1 gig
People stink on Synology for charging a premium for older hardware, but their ecosystem just works. Even though, I do like running TrueNAS Scale in my home lab, it’s not quite plug and play like DSM.
10 gig-nics cool. However do either of you have internet speeds that even hit 2gigs?
As your gonna be limited by both yours and your editor's ISP speeds.
how much power is that pulling ?
10/10 would buy 0.00001/10 when it comes to the pricing. NAS + drives at least 2-3k where I live.
Upgrading to 2 blade style NAS? Damn
your right spacerex rules
This is all great, assuming the ISP internet speed is 1gb upload / 1gb download speed
Yes I use external hard drive for every thing
❤
What was your total price for that? I think you should have included that.
Im guess LTT just laugh in available space :P
That’s sick. What’s the cost 🤔