Still waiting for Part 2 now about 1 1/2 years later. Still is something I want to do but wonder if it will work with Version 6.12.3 and if not is there an updated version?
Hi Ed, thanks as always for the incredible content! Curious if part 2 ever got published. Also, really interested in what this setup would look like if we wanted to do an offsite backup server. 🙏🙏
I got this working, but had to do a simple workaround on the backup server. WOL would wake the backup server, but I couldn't get the backup script to run. The workaround has two steps: 1) set the backup server to auto-start the array; 2) in User Scripts set the backup script to execute "At Start of Array". This works well, as the backup server starts, backs up the data. then shuts down. But I'm (im)patiently waiting for Part 2 of the video. I'd really like to have my (low wattage) backup server take over!
Spaceinvader your videos are a invaluable tool for the unraid community. Thank you for your continued efforts. I'm looking forward to the next part of this video series.
Hi Spaceinvader One, I love your channel and all your tutorials, they are very helpful and simple to follow. Working on building my first Nas build thanks to your awesome videos👍
Hey Ed! Just following up on this. Creating a fail over sever is something that I'm really interested in since there's a lot of important files on my server. Just wondering if you're ever planning on doing a Part 2 to this video?
do you have a video showing how to setup an unraid server at a different location for backup or just syncing to the main server? I want to have a complete clone of my unraid server in a different location and when one thing is downloaded or updated to the main server it gets updated on the other machine too.
This is awesome! I've been thinking about setting up something similar but couldn't figure out how to automate anything more than the data sync. One question though...what happens if there are active streams being served by Emby when the failover script starts? Can clients continue playback seamlessly (if they have enough video buffered) while the server failover is taking place until the failover is complete? Does the client video buffer then refill from the backup server?
Geez I just had a big scare. Went to bed last night and unraid was working just fine. In the morning my phone had some notifications that some nextcloud syncs were failing. I tried to pull up unraid but I couldn't access anything at all. I ended up pulling the USB, moving the config file to my PC, formatting and reinstalling unraid, and then just over wrote the config file with the backup. Put it back in my server and all is well. I'm not even sure that was the problem but it's all working now. 🤷
Do you have a video for a very specific edge case? Mine is: I have unraid at my house, my parents want to have a unraid at their house. I want to set both up. Mine will be the primary at my house and their is primary at that house. I don't want to overide any data on theirs if they sync videos or photos to it. I want mine to get a copy and update whenever they do something on that unraid instance but still have mine sync back to theirs when I do something. Should I just look at getting a third instance and then have that as the primary that syncs to both? The downside would be that I can not transfer to mine locally.
Looking forward to part 2 as well. Also curious, is there a way to do it so both servers are on all the time and If main server turns off or shutdown it automatically goes to backup server then once the main server is back up it goes back to the main server?
I could have built back from parity but as the data was corrupted it would have rebuilt the corrupted data on a new drive. So repairing the xfs file system was the best option for me
Awesome content! Definitely curious as to how you have your unRaid backups running. Is it with a script utilizing rsync? Last video on backups was using duplicati. I have had enough of duplicati with the amount of issues I have ran into…
Awesome video, was looking for a solution like this. Is it possible to automatically start a backup from the backup server to send data to Backblaze B2 cloud storage once the copy from source is done?
3:40 Where this gui comes from? (prime_power) 7:14 In order for the two serves to be synced you need them online. Wouldn t that create a conflict having a service run at the same ip:port ?
Hi there, I don’t know if you have a video on it already but how do you add your main and backup server to the header on unraid so you can easily switch?
Is there a recent video on how to backup an unraid server to another NAS incrementally Incl pools? So that you in essence can restore it all… and w.o. Terminal? Like eg tima machine for unraid?
What about using rclone (or rsync with multiple streams)? Having an offsite backup server (for example on different continent as the most possible bulletproof backup solution) could introduce significant ping between the servers, where with only one transfer stream would drastically impact the speed of syncing huge amount of small files (overhead for waiting for response / confirmation for each file). By running rclone with, let's say 10 concurrent streams, really saves the headache in this scenario. I'd love to know whether there is a smarter way to approach this problem, but a weekly rclone script running on a windows VM so far does the job for me.
How are you handling the IP conflict? when both servers are on with the same ip? i understand once the media is copied but the conflict will happen in the morning and at night.
Hi Ivan. The ip of the servers are different. Just the 'mirror' containers IP is the same. The script only starts the containainers when the other server hosting the 'mirror' container has shut down. Thanks for watching :)
@@SpaceinvaderOne Have you looked at keepalived? Would be an easy way to have a single IP serve those services with automatic failover. Should scale beyond 2 backup servers if desired as well. It runs VRRP under the hood and can quickly be setup in dockers within a few minutes.
I also just lost data when my unraid USB died and I restored the os from a backup it had made prior to installing the latest drive. I then started the array thinking it would parity check but it cleared the newest drive. I thought it would rebuild the drive from parity but no.
Hi fyrearm on blast. The data became corrupted so this corruption of the filessytem got reflected in the parity. So rebuilding the data from parity on a new disk would have given me the corrupted data on a new disk. So for my situation an xfs repair was best to do. If the whole drive had failed yes i could have rebuilt from parity. Its kind of similar if you deleted a whole lot of files from your server you couldnt rebuild the deleted files from the parity. Hope that make sense. thanks for watching :)
@@SpaceinvaderOne totally makes sense! I followed your instructions for everything I'm doing. I get the "how's" but I really need a better knowledge base of the "whys". I really appreciate all you do for the community!
@@SpaceinvaderOne Thanks Ed! I saw in your last video the reason why things have been slow. My condolences to you and your family. Hope you guys are doing well!
Only groupies and simpletons worry about movies, media and all that superfluos commercialization and consumerism. Useful information, knowledge, history and your own memories, sure, but worrying about Hollywood, et all?
why disable dislike? How do you know if people like your tutorial? edit: I just saw dislike returned on this video. Dislike can be enabled by a Chrome plug-in. The plug-in showed dislike was disabled by uploader when I initially saw the video. It's back now.
Great video as always, but so missing part 2. I have worked out to share the SSH keys so can get RSYNC to copy but the script on the backup just fails with "rsync: connection unexpectedly closed (0 bytes received so far) [Receiver] rsync error: unexplained error (code 255) at io.c(231) [Receiver=3.2.7] /tmp/user.scripts/tmpScripts/Backup Betty/script: line 38: /mnt/user/appdata/backupserver/config.cfg: No such file or directory If anyone wants to give me a hand I would appreciate the insight.
Still waiting for Part 2 now about 1 1/2 years later. Still is something I want to do but wonder if it will work with Version 6.12.3 and if not is there an updated version?
Man...I'm not sure HOW you do it, but your videos are ALWAYS timely, and EXACTLY what I'm working on. Can't wait for the next part.
Same! Was building an offsite backup the last 2 weeks. But with mixed scripts and tutorials. Now I’m more confident it’s bullet proof
It's somewhat spooky.... maybe he _primes us subconsciously?_ *It's Awesome =)*
No kidding! I just purchased my license for a 2nd server and was wondering about keeping my old one as a backup.
I can confirm the same
Same here!
Hi Ed, thanks as always for the incredible content!
Curious if part 2 ever got published. Also, really interested in what this setup would look like if we wanted to do an offsite backup server. 🙏🙏
Did you ever complete this series? A really interesting and important topic.
Superb Ed. This is exactly what I want to do with my Unraid servers. Looking forward to seeing the series.
Thanks Mark next part will be up in a few days :)
@@SpaceinvaderOne ok not to be in the way but this never happened...... i really like your video's....
Yeah, I would love to see next part of this video
I got this working, but had to do a simple workaround on the backup server. WOL would wake the backup server, but I couldn't get the backup script to run. The workaround has two steps: 1) set the backup server to auto-start the array; 2) in User Scripts set the backup script to execute "At Start of Array". This works well, as the backup server starts, backs up the data. then shuts down.
But I'm (im)patiently waiting for Part 2 of the video. I'd really like to have my (low wattage) backup server take over!
I would love to see the completion of the nextcloud series with installation of the onlyoffice document server and elasticsearch
This!
Yes Nextcloud series is continuing soon. I split it up a bit so not to have lots of one type of video in a row. But yes soon :) Thanks or watching
Love your videos. Where is Part 2!!! ?
Will a part 2 be coming? I’m ready :)!
Awesome video! Is part 2 coming soon?
still anxiously waiting for part 2 of this, as I have an invoicing system on my main server and would love to be able to back it up overnight.
Really exciting stuff, looking forward to the next part! Thanks a lot for your awesome work!
Spaceinvader your videos are a invaluable tool for the unraid community. Thank you for your continued efforts. I'm looking forward to the next part of this video series.
Would you please provide a link to part 2? I've browsed through your posted videos and don't seem to be able to find it.
I'm looking for it also. Can't seem to find it.
Hi Spaceinvader One, I love your channel and all your tutorials, they are very helpful and simple to follow. Working on building my first Nas build thanks to your awesome videos👍
Hi Atom -88. Thanks glad you like the channel. Best of luck building your NAS i am sure it will be great. Thanks for watching :)
Dear Sir, is the next part come out yet. I have watched all the videos on your channel. It is real hard work you have put in. God bless.
Ready for Part 2
Where are you Spaceinvader?! i have my second unraid server ready to make a backup... part 2? 🙂
Hey Ed! Just following up on this. Creating a fail over sever is something that I'm really interested in since there's a lot of important files on my server. Just wondering if you're ever planning on doing a Part 2 to this video?
After my most recent server crash I think it’s time to look into a backup
Also would like to se pt 2 of this series.
Hey Spaceinvader, great subject, but is part two coming soon
I can't find part 2, was it ever done? Really would like a walkthru on the scripts.
do you have a video showing how to setup an unraid server at a different location for backup or just syncing to the main server? I want to have a complete clone of my unraid server in a different location and when one thing is downloaded or updated to the main server it gets updated on the other machine too.
This is awesome! I've been thinking about setting up something similar but couldn't figure out how to automate anything more than the data sync. One question though...what happens if there are active streams being served by Emby when the failover script starts? Can clients continue playback seamlessly (if they have enough video buffered) while the server failover is taking place until the failover is complete? Does the client video buffer then refill from the backup server?
Blake’s 7 the darkest sci-fi
Geez I just had a big scare. Went to bed last night and unraid was working just fine. In the morning my phone had some notifications that some nextcloud syncs were failing. I tried to pull up unraid but I couldn't access anything at all. I ended up pulling the USB, moving the config file to my PC, formatting and reinstalling unraid, and then just over wrote the config file with the backup. Put it back in my server and all is well. I'm not even sure that was the problem but it's all working now. 🤷
Man ,sorry to here that. Glad your server is back up and running now :)
I literally just sent hardware to my friends house as an off site backup solution! Curious how you do it here.
Nice video Ed! Thanks for sharing it with us!💖👍😎JP
Thanks for watching!
@@SpaceinvaderOne Your very welcome Ed! Have a wonderful week😎
What video of the continuation to this project??
Do you have a video for a very specific edge case? Mine is: I have unraid at my house, my parents want to have a unraid at their house. I want to set both up. Mine will be the primary at my house and their is primary at that house. I don't want to overide any data on theirs if they sync videos or photos to it. I want mine to get a copy and update whenever they do something on that unraid instance but still have mine sync back to theirs when I do something. Should I just look at getting a third instance and then have that as the primary that syncs to both? The downside would be that I can not transfer to mine locally.
Looking forward to part 2 as well. Also curious, is there a way to do it so both servers are on all the time and If main server turns off or shutdown it automatically goes to backup server then once the main server is back up it goes back to the main server?
Was there a reason you couldn't replace the failed drive and rebuild from parity?
I could have built back from parity but as the data was corrupted it would have rebuilt the corrupted data on a new drive. So repairing the xfs file system was the best option for me
is there a part 2?
When will part 2 be out?
Awesome content! Definitely curious as to how you have your unRaid backups running. Is it with a script utilizing rsync? Last video on backups was using duplicati. I have had enough of duplicati with the amount of issues I have ran into…
Hi Scrumpi yes the scripts are using rsync. Thanks for watching.
Awesome video, was looking for a solution like this. Is it possible to automatically start a backup from the backup server to send data to Backblaze B2 cloud storage once the copy from source is done?
3:40 Where this gui comes from? (prime_power)
7:14 In order for the two serves to be synced you need them online. Wouldn t that create a conflict having a service run at the same ip:port ?
I'm guessing the dockers aren't running unless the backup server can't see the main server.
Hi there, I don’t know if you have a video on it already but how do you add your main and backup server to the header on unraid so you can easily switch?
I can't find the second video. Has it been made yet?
Is there a recent video on how to backup an unraid server to another NAS incrementally Incl pools? So that you in essence can restore it all… and w.o. Terminal? Like eg tima machine for unraid?
Hello, any update on part 2?
What about using rclone (or rsync with multiple streams)? Having an offsite backup server (for example on different continent as the most possible bulletproof backup solution) could introduce significant ping between the servers, where with only one transfer stream would drastically impact the speed of syncing huge amount of small files (overhead for waiting for response / confirmation for each file).
By running rclone with, let's say 10 concurrent streams, really saves the headache in this scenario. I'd love to know whether there is a smarter way to approach this problem, but a weekly rclone script running on a windows VM so far does the job for me.
What is that neat power showing thing?
Hi Zack. Ttats a sonoff powr2 (smart switch) but flashed with tasmoto firmware tasmota.github.io/docs/ Thanks for watching.
how do you set one server to shutdown another?
Any timeline on Pt2?
Hi do you know if you will be making an invoice ninja unraid installation tutorial?
Do, did your parity drive fail to replace the defective disk?
Where is part 2?
part 2?
I can't find the docker app discover in the unraid app store. Am I spelling it right?
diskover
Is that a power plugin you are using? At the 3:40 mark
Thats a smart plug flashed with tasmota firmware
What happens if both servers are running and you get client traffic?
Hi Dylan. The script makes sure the containers are not running at the same time
Very nice Video;-)
How are you handling the IP conflict? when both servers are on with the same ip? i understand once the media is copied but the conflict will happen in the morning and at night.
Hi Ivan. The ip of the servers are different. Just the 'mirror' containers IP is the same. The script only starts the containainers when the other server hosting the 'mirror' container has shut down. Thanks for watching :)
@@SpaceinvaderOne Have you looked at keepalived? Would be an easy way to have a single IP serve those services with automatic failover. Should scale beyond 2 backup servers if desired as well. It runs VRRP under the hood and can quickly be setup in dockers within a few minutes.
Why would you have lost any data from the xfs corruption? I thought the other discs in the array would have had the data? Am I missing something?
I also just lost data when my unraid USB died and I restored the os from a backup it had made prior to installing the latest drive. I then started the array thinking it would parity check but it cleared the newest drive. I thought it would rebuild the drive from parity but no.
Hi fyrearm on blast. The data became corrupted so this corruption of the filessytem got reflected in the parity. So rebuilding the data from parity on a new disk would have given me the corrupted data on a new disk. So for my situation an xfs repair was best to do. If the whole drive had failed yes i could have rebuilt from parity. Its kind of similar if you deleted a whole lot of files from your server you couldnt rebuild the deleted files from the parity. Hope that make sense. thanks for watching :)
@@SpaceinvaderOne totally makes sense! I followed your instructions for everything I'm doing. I get the "how's" but I really need a better knowledge base of the "whys". I really appreciate all you do for the community!
Damn, I wish I didn’t have 400+tb of media so I could affordably do this lol.
lWow thats makes my little server seem pathetic lol I cant imagine 400tb of media thats amazing :) Thanks for watching
@@SpaceinvaderOne and thank you for all your content! You have helped me a lot over the years!
Is there a Part 2 to this video?
very soon :)
@@SpaceinvaderOne Thanks Ed! I saw in your last video the reason why things have been slow. My condolences to you and your family. Hope you guys are doing well!
So where is Part 2 LOL!
Did I miss part 2?
Part 2
Only groupies and simpletons worry about movies, media and all that superfluos commercialization and consumerism.
Useful information, knowledge, history and your own memories, sure, but worrying about Hollywood, et all?
why disable dislike? How do you know if people like your tutorial?
edit: I just saw dislike returned on this video.
Dislike can be enabled by a Chrome plug-in. The plug-in showed dislike was disabled by uploader when I initially saw the video. It's back now.
He didn't chose to disable dislikes. UA-cam turned off dislikes across the whole platform.
Holy cow, you must live in the stone age bro, that's a youtube decision.
UA-cam in their infinite wisdom decided to turn off the dislike counter. Creators can still see the counter, we cant
Great video as always, but so missing part 2. I have worked out to share the SSH keys so can get RSYNC to copy but the script on the backup just fails with
"rsync: connection unexpectedly closed (0 bytes received so far) [Receiver]
rsync error: unexplained error (code 255) at io.c(231) [Receiver=3.2.7]
/tmp/user.scripts/tmpScripts/Backup Betty/script: line 38: /mnt/user/appdata/backupserver/config.cfg: No such file or directory
If anyone wants to give me a hand I would appreciate the insight.
Part 2?