I have 2 NAS's that store my media files. They were mostly in sync having done so with another app previously. I decided to use Syncthing to take over the job. Even though there were only about 40-50 files out of sync out of a collection size of about 5,000+ total files, it still took at least 24 hours to complete. No big complaint because it didn't affect my other work but others should be aware of the time it takes.
@@paulminott150 Not sure how to answer that. I just started with the main NAS and added the backup NAS as a remote device. Then on the main NAS, added the folder and which device to share it with. On the backup NAS, I just accept the invitation. I also make sure that all of my devices are using the same Ignore list. One oddity is that my Synology uses the path for the folders to be shared as " /volume1/xxx/ " which is the name of my volume. But, on my QNAP, Syncthing uses " /share/xxx " to start the folder path in spite of the fact that the volume is named DataVol1. If that makes sense.
I've been tinkering with Synchthing for a bit, but never really understood it. Watching this made me realize I'm making it more difficult than it needs to be. Thanks!
@@tyreebecker8465 hey so btw it actually works, it's even easier than this video makes it look lmao, i am already syncing photos from my phone and started a POC of joplin synced from a central server... so easy i am shocked!
I use Tailscale but have not setup Syncthing to use it. I have a Synology NAS as the hub and 5 PC's syncing to the NAS. When setting the "addresses" from their default "dynamic", do you leave any devices as "dynamic" or do you use the Tailscale IP addresses for all of them ?
I set this up last week for a business suffering from the onedrive's shared folder problems ( appearing as a URL link ), its awesome, easy to set up and worked very well.
SyncThing's the glue which holds my office & personal networks together. At my office I use it to have servers push their backups to a master backup server. Workstations also perform their own backups and push it to the server as well. This way, nothing is exposed. It's all push. The server is running TrueNAS ZFS with snapshots, so bad backups can't overwrite the good ones.
You've done a couple videos on syncthing, and I've been using it since your very first one! I use it at home and work, across a bunch of different devices and OS'es... it's absolutely fantastic!
As part of my home lab and self hosting journey i was looking to add file synchronization from my phone and other devices. This tutorial fits the bill perfectly. Thank you
I love syncthing! I use it to handle my backups for UNRAID and to sync my windows workstations critical “workspace” that need local/fast storage over a 10gig link back to UNRAID1 which has a 10gig link to UNRAID2(for near realtime replication of new files sent to UNRAID1) which has a dedicated 1gig link to UNRAID3(cold spare). The primary server that is always on (UNRAID1) also sends the data over to a windows host running storage spaces with a bunch of external drives in a striped pool with backblaze workstation/pc backup. The windows PC doubles as the CCTV server so its not just sitting idle most of the time. UNRAID2 is also a backup plex server incase UNRAID1 is down.
Thanks Tom. I remember you talking about Syncthing on your podcast. I do "binge listen" on your podcast when I do the 15 hour marathon drive from L.A. to Bend, Or. Now I need to learn how to do a VPN connection with Syncthing on my 3 property servers in Colorado, Oregon, and California.
Use syncthing to dump content (one way sync) from several pc's to a nas (truenas) for archiving. Nas generates daily snapshots. Once a week these snapshots are replicated to another nas.
I've been using a program call Synctrazor which appears to be cut from the same cloth, and it's worked perfectly for the handful of documents I keep synced between my desktop and laptop, but Syncthing seems like it would be a good upgrade, since it can also be installed on an android tablet. That would be a nice time saver for the single file I have to transfer to my wife's tablet every so often. Thanks for the tutorial.
I recently added SyncThing to my home network to sync between my Linux desktop and my Macbook Pro. I also have Samba networking and I use Synergy from Symless to control both machines from the same keyboard and mouse.
Syncthing is a really great tool for replication! The biggest problem with these syncing tools is that people tend to use them for backup. I always try to point it out, this is NOT backup! Even Syncthing themself points this out in their docs.
I'm a photographer and I use Lightroom classic on two different computers. I've been looking for a way to be able to sync my catalog files between them, since they cannot be run from a network share. I was about to pay for AOMEI software, this looks like it will work just fine!
With dropbox you get 3 free devices where you can install dropbox directly. when that is not enough it is perfect to use syncthing to just sync from one computer with dropbox active to the rest, easy way to have an online backup of everything but still a local copy on all devices. Also, ever had to move tons of photos from a family memebers computer when you setting up a new computer for them? syncthing is awsome in those cases, just move the photos so quick.
My latest FUN use for this has been to sync my emulator saves/states between my Deck and PC(s). Even doing this with PS3, Switch etc. I wrote a guide where these are set for the deck on Emudecks wiki. I then have them hardlink into separate easy to find folders for my use case as well with versioning, no wiki for that though.
Thanks for the nice clear tutorial Tom. I know I'm being pedantic, but Jay will understand why this bugs me. Can you please look up "explicit vs implicit". When you enter a specific IP address, that's explicitly defining it. 😉
I’ve used both. I’d say the biggest differences in terms of function (for my use case) is that Resilio Sync handles selective sync much better and has an official iOS client. You can sort of do selective sync with SyncThing by manipulating the ignore list, but it’s way easier to do this on a per-file or per-folder basis on Resilio Sync. My needs have changed so I now use SyncThing only.
It’s really easy to set up but very slow, after tuning it I consistently get 30mb/s. I used it to sync my primary media NAS to my backup NAS and to update the backup NAS once a month. When I turn it on once a month it has to scan the source before syncing and it seriously affects system performance. You can’t watch Plex if it’s running a scan on the same server (36 core Xeon V4 Supermicro server with 256GB RAM and a 10G network) and it will consume 40-50% CPU until it’s done, which is often days as I have 120TB of media.
Sorry if it was said in the video and I missed it, but is there also a way to automatically trigger syncs or schedule them to start syncing like every Saturday or last Saturday of a week? I have a second server which I only power on when I need to sync data/the HDDs are spun down and I dont want to run them all the time. I would be ok with it having a manual way to start a sync but if it has a way to scedule it, it would be perfect.
one way might be to start/stop syncthing on that machine on a schedule basis. as it starts syncing as soon as it`s running and found the other machine(s)
Hi Tom! I was patiently waiting to hear something about the Send & Recieve options on what if you set it up differently both side then Send & Recieve. Why would I choose other variations? Like when it's worth to set it as one side send other side recieve, or other setups.
Does it support on-demand syncing for „clients“? I want to run the „server“ on a NAS but not all devices should have to sync all data. I understand we call everything a device here, but is that possible (on Mac clients)?
I have four Linux Mint computers on a home network. Each computer has the three+ user logons; the three share syncthing. I wish for any of the three users to use any computer. Syncthing set up three computers with device identities for each user; one computer set the same device identity for all users. Which is correct? 12 device identities for 3 repeat logins or four devices? How should I get this straightened out.
I use ST on several devices ( desktop, NAS's, laptops ). When it works, it works well. When it doesn't work, it's a pain. The most recurring issue that I have experience and seen in online forums is out of sync files and folders and this is quite a widespread problem. Even when everything is in sync, ST will often say that it's not. And, fixing a real or non-existent problem is often not very intuitive. It's a community project and the coders seem to think that we users are all familiar with accessing and using the command line interface to issue commands to fix a buggered up database index. Could they add a command to the GUI ? Undoubtedly, but they don't. I do really appreciate their efforts but it would be nice to add these little things for the not quite as technically astute users.
Any idea why my syncthing sync only gives me a bunch of .tmp files and "out of sync" notice on the receiving end? Since it seems to already have started why cant it finish the process?
Does it require an HTTPS IP/URL on the hosts to work? If not, I could run it through my Zerotier network and that would solve a HUGE problem for me. Can't port forward on my network, unfortunately...
@@LAWRENCESYSTEMS Oooooooo...I am INTRIGUED!! lol I started to set up a Nextcloud install a while back when I found out I can't port forward on my network...so, anything that requires HTTPS won't work. Not that I know of, anyway. Ran into the problem again recently while trying to set up Vaultwarden...it needs HTTPS...sucks.
Can you use it as a remote filesystem? For example, have a library of files on one server, and a second server that can access the files on the first without having to have them all copied over? Thinking about plex with library offsite and encrypted..
The type of file access you're looking for can be provided by WebDAV, although I'm not sure how well that protocol will perform with streaming media. I know WebDAV in conjunction with Syncthing is pretty nifty for synchronizing notes across mobile devices where you don't want to have full-blown Syncthing runnnig.
It sounds to me like you're wanting to do something similar to accessing your NAS remotely. I connect via VPN to my homeland and then can access the NAS.
I've seen the same thing happen _(where comments are instantly removed if they have a link to _*_anything_*_ outside of UA-cam)_ on many youtube channels. I've had it happen on totally innocuous comments which answered a question that was asked in the video. It was definitely not the video-creator who removed the comment.
I've been using Syncthing to synchronize my use of Joplin between my Android phone and laptop since one of your previous videos. Unfortunately ever since Android introduced scoped storage the two applications aren't allowed to view each other's folders. My solution so far is to run a horribly outdated version of Joplin, not subject to the scoped storage rules. Do you know of a better way to deal with this?
I'd like to use the untrusted device feature to store my personal documents on my brother-in-law's server (and vice versa) for backup purposes. However, I'd like to figure out how we can seed the data so that we aren't blowing through our Xfinity data caps. Any thoughts on this?
Perhaps sync with a portable device, e.g. laptop with Syncthing while at home. Then take the laptop to his house, connect to his WiFi and sync with his server..
Under Aegis Backups enable automatic backup and then tell it to store in a location you can access with Syncthing. For example I store mine under /Backup/Aegis on my Pixel 7.
There's a really big issue with syncthing corrupting its database randomly, an issue that they haven't fix it yet. I've stopped using it because of this.
I’ve been installing syncthing in various scenarios for the last 6-7 years and I gotta admit, your instructions are confusing particularly around ssh port forwarding. Syncthing has a TLS encrypted transport layer. You DON’T need to use vpn’s (idk what a mesh vpn is). Normies will not understand this video.
I used syncthing to migrate 30TB from 3 different windows servers to unraid using syncthing for docker. Its an absolute life saver.
So slow though.
@@ryanmalone2681 agreed but at least I was able to keep my old server online and active making the cutover time much shorter.
I have 2 NAS's that store my media files. They were mostly in sync having done so with another app previously. I decided to use Syncthing to take over the job. Even though there were only about 40-50 files out of sync out of a collection size of about 5,000+ total files, it still took at least 24 hours to complete. No big complaint because it didn't affect my other work but others should be aware of the time it takes.
@@DavidM2002 How did you do that? This is exactly what I want to do. I tried but didnt seem to work.
@@paulminott150 Not sure how to answer that. I just started with the main NAS and added the backup NAS as a remote device. Then on the main NAS, added the folder and which device to share it with. On the backup NAS, I just accept the invitation. I also make sure that all of my devices are using the same Ignore list. One oddity is that my Synology uses the path for the folders to be shared as " /volume1/xxx/ " which is the name of my volume. But, on my QNAP, Syncthing uses " /share/xxx " to start the folder path in spite of the fact that the volume is named DataVol1. If that makes sense.
I've been tinkering with Synchthing for a bit, but never really understood it. Watching this made me realize I'm making it more difficult than it needs to be. Thanks!
Last night I decided to become a SyncThing guy and today the Gods of content provided me this 🙏
Same boat, just found out about this today and saw the video. The Gods have shown me their favor
@@tyreebecker8465 hey so btw it actually works, it's even easier than this video makes it look lmao, i am already syncing photos from my phone and started a POC of joplin synced from a central server... so easy i am shocked!
SyncThing works really well over TailScale and ZeroTier too!
Yes it does!
I use Tailscale but have not setup Syncthing to use it. I have a Synology NAS as the hub and 5 PC's syncing to the NAS. When setting the "addresses" from their default "dynamic", do you leave any devices as "dynamic" or do you use the Tailscale IP addresses for all of them ?
@@DavidM2002 You would set each of your 5 PC's to have the address of the Synology, but leave Syncthing on the Synology as dynamic.
@@LAWRENCESYSTEMS Thankyou.
I set this up last week for a business suffering from the onedrive's shared folder problems ( appearing as a URL link ), its awesome, easy to set up and worked very well.
SyncThing's the glue which holds my office & personal networks together.
At my office I use it to have servers push their backups to a master backup server. Workstations also perform their own backups and push it to the server as well. This way, nothing is exposed. It's all push. The server is running TrueNAS ZFS with snapshots, so bad backups can't overwrite the good ones.
I used this for 10 game servers. Was handy. For player data, server configs and files.
You've done a couple videos on syncthing, and I've been using it since your very first one! I use it at home and work, across a bunch of different devices and OS'es... it's absolutely fantastic!
As part of my home lab and self hosting journey i was looking to add file synchronization from my phone and other devices. This tutorial fits the bill perfectly. Thank you
This is a really good introduction to Syncthing! Thanks Tom. I'm looking forward to the TrueNAS tutorial 👍
Syncing all my Backups OffSite with Syncthing since 2017. Love it!
I love syncthing! I use it to handle my backups for UNRAID and to sync my windows workstations critical “workspace” that need local/fast storage over a 10gig link back to UNRAID1 which has a 10gig link to UNRAID2(for near realtime replication of new files sent to UNRAID1) which has a dedicated 1gig link to UNRAID3(cold spare). The primary server that is always on (UNRAID1) also sends the data over to a windows host running storage spaces with a bunch of external drives in a striped pool with backblaze workstation/pc backup. The windows PC doubles as the CCTV server so its not just sitting idle most of the time. UNRAID2 is also a backup plex server incase UNRAID1 is down.
Thanks Tom. I remember you talking about Syncthing on your podcast. I do "binge listen" on your podcast when I do the 15 hour marathon drive from L.A. to Bend, Or. Now I need to learn how to do a VPN connection with Syncthing on my 3 property servers in Colorado, Oregon, and California.
Use syncthing to dump content (one way sync) from several pc's to a nas (truenas) for archiving. Nas generates daily snapshots. Once a week these snapshots are replicated to another nas.
Looking forward to the TrueNas tutorial for syncthing!
@meRyanP
Yeah. And maybe a Nextcloud sync solutionon TrueNAS. I was contemplating using S3 MinIO for shared storage, built-in replication.
Great video, thanks. For Truenas scale dragonfish and electric eel (when it's out there)
Thanks for the updated video on Syncthing I’ve since setup the ssh config trick for my remote system configuration and tunnelling.
I've been using a program call Synctrazor which appears to be cut from the same cloth, and it's worked perfectly for the handful of documents I keep synced between my desktop and laptop, but Syncthing seems like it would be a good upgrade, since it can also be installed on an android tablet. That would be a nice time saver for the single file I have to transfer to my wife's tablet every so often.
Thanks for the tutorial.
I recently added SyncThing to my home network to sync between my Linux desktop and my Macbook Pro.
I also have Samba networking and I use Synergy from Symless to control both machines from the same keyboard and mouse.
Very useful video on a very useful file utility!
I wasn't aware of the feature of an untrusted syncthing server.
Syncthing is a really great tool for replication! The biggest problem with these syncing tools is that people tend to use them for backup. I always try to point it out, this is NOT backup! Even Syncthing themself points this out in their docs.
Great video! I think Syncthing is just what I need to do some targeted backups!
Thanks for sharing this! I will use my vacation to set this up. Very useful!
Awesome video thanks! Setting this up to move away from other cloud services!
I'm a photographer and I use Lightroom classic on two different computers. I've been looking for a way to be able to sync my catalog files between them, since they cannot be run from a network share. I was about to pay for AOMEI software, this looks like it will work just fine!
very good tutorial and application. I just install it on my desktop and TrueNas to backup my data
Excellent video loved your vids a few years ago this was great refresh and update thank you
With dropbox you get 3 free devices where you can install dropbox directly. when that is not enough it is perfect to use syncthing to just sync from one computer with dropbox active to the rest, easy way to have an online backup of everything but still a local copy on all devices.
Also, ever had to move tons of photos from a family memebers computer when you setting up a new computer for them? syncthing is awsome in those cases, just move the photos so quick.
On Windows, SyncthingTray is really good. More features
My latest FUN use for this has been to sync my emulator saves/states between my Deck and PC(s). Even doing this with PS3, Switch etc. I wrote a guide where these are set for the deck on Emudecks wiki. I then have them hardlink into separate easy to find folders for my use case as well with versioning, no wiki for that though.
Thanks for the nice clear tutorial Tom. I know I'm being pedantic, but Jay will understand why this bugs me. Can you please look up "explicit vs implicit". When you enter a specific IP address, that's explicitly defining it. 😉
can this run on windows without being logged in, as a service
That's cool! I'm goinna have to take a closer look!
Tom's my IT hero.
I've been hanging out for this video 🎉
10:32 Folder synchronization
How do you feel Syncthing compares to Reslio Sync?
I’ve used both. I’d say the biggest differences in terms of function (for my use case) is that Resilio Sync handles selective sync much better and has an official iOS client. You can sort of do selective sync with SyncThing by manipulating the ignore list, but it’s way easier to do this on a per-file or per-folder basis on Resilio Sync.
My needs have changed so I now use SyncThing only.
Reslio is a closed source solution that I have not tested.
It’s really easy to set up but very slow, after tuning it I consistently get 30mb/s. I used it to sync my primary media NAS to my backup NAS and to update the backup NAS once a month. When I turn it on once a month it has to scan the source before syncing and it seriously affects system performance. You can’t watch Plex if it’s running a scan on the same server (36 core Xeon V4 Supermicro server with 256GB RAM and a 10G network) and it will consume 40-50% CPU until it’s done, which is often days as I have 120TB of media.
Sorry if it was said in the video and I missed it, but is there also a way to automatically trigger syncs or schedule them to start syncing like every Saturday or last Saturday of a week?
I have a second server which I only power on when I need to sync data/the HDDs are spun down and I dont want to run them all the time.
I would be ok with it having a manual way to start a sync but if it has a way to scedule it, it would be perfect.
one way might be to start/stop syncthing on that machine on a schedule basis. as it starts syncing as soon as it`s running and found the other machine(s)
Hi Tom! I was patiently waiting to hear something about the Send & Recieve options on what if you set it up differently both side then Send & Recieve. Why would I choose other variations? Like when it's worth to set it as one side send other side recieve, or other setups.
I don't use their "Send Only" function. I find revisions to work fine and I have backups of my data.
Does it support on-demand syncing for „clients“?
I want to run the „server“ on a NAS but not all devices should have to sync all data.
I understand we call everything a device here, but is that possible (on Mac clients)?
Excellent .. Thank You for sharing .. Cheers :)
Nice Tutorial. Thanks
I have four Linux Mint computers on a home network. Each computer has the three+ user logons; the three share syncthing. I wish for any of the three users to use any computer. Syncthing set up three computers with device identities for each user; one computer set the same device identity for all users. Which is correct? 12 device identities for 3 repeat logins or four devices? How should I get this straightened out.
Will this work with Synology too?
I am not sure if Synology still has support or not, but it should work using Synology Docker.
The only thing I wish it could do is sync at certain times of the day. So every morning at 1am it would sync. Other than that it’s great
I use ST on several devices ( desktop, NAS's, laptops ). When it works, it works well. When it doesn't work, it's a pain. The most recurring issue that I have experience and seen in online forums is out of sync files and folders and this is quite a widespread problem. Even when everything is in sync, ST will often say that it's not. And, fixing a real or non-existent problem is often not very intuitive. It's a community project and the coders seem to think that we users are all familiar with accessing and using the command line interface to issue commands to fix a buggered up database index. Could they add a command to the GUI ? Undoubtedly, but they don't. I do really appreciate their efforts but it would be nice to add these little things for the not quite as technically astute users.
Throughput limitation around 200 Mbps even over LAN. It’s useful but could be better in that department.
4:34 that already answers my use: untrusted encrypted servers
Any idea why my syncthing sync only gives me a bunch of .tmp files and "out of sync" notice on the receiving end? Since it seems to already have started why cant it finish the process?
Does it require an HTTPS IP/URL on the hosts to work? If not, I could run it through my Zerotier network and that would solve a HUGE problem for me. Can't port forward on my network, unfortunately...
It will work fine through ZeroTier
@@LAWRENCESYSTEMS Oooooooo...I am INTRIGUED!! lol
I started to set up a Nextcloud install a while back when I found out I can't port forward on my network...so, anything that requires HTTPS won't work. Not that I know of, anyway. Ran into the problem again recently while trying to set up Vaultwarden...it needs HTTPS...sucks.
Can you use it as a remote filesystem? For example, have a library of files on one server, and a second server that can access the files on the first without having to have them all copied over? Thinking about plex with library offsite and encrypted..
There might be a way to make that work.
The type of file access you're looking for can be provided by WebDAV, although I'm not sure how well that protocol will perform with streaming media. I know WebDAV in conjunction with Syncthing is pretty nifty for synchronizing notes across mobile devices where you don't want to have full-blown Syncthing runnnig.
Look at rclone
It sounds to me like you're wanting to do something similar to accessing your NAS remotely. I connect via VPN to my homeland and then can access the NAS.
THX bro.
Hey Tom, when will they include time scheduling sync tasks as an option?
I don't know
Now I gotta change the code to my luggage.
thank you.
What is the tool used to make the visualizations starting from about 1:40 please.
lawrence.video/drawio
@@LAWRENCESYSTEMS
Oh wow. I never expected anyone to actually reply, let alone you.
Thank you so much man.
Why my comment has been removed after I attached the link to github issue which as for me is critical one?......
Because UA-cam (not me) removes links.
@@LAWRENCESYSTEMS meh, ok ok.
I've seen the same thing happen _(where comments are instantly removed if they have a link to _*_anything_*_ outside of UA-cam)_ on many youtube channels. I've had it happen on totally innocuous comments which answered a question that was asked in the video. It was definitely not the video-creator who removed the comment.
I've been using Syncthing to synchronize my use of Joplin between my Android phone and laptop since one of your previous videos. Unfortunately ever since Android introduced scoped storage the two applications aren't allowed to view each other's folders. My solution so far is to run a horribly outdated version of Joplin, not subject to the scoped storage rules. Do you know of a better way to deal with this?
I've not used Joplin, but with Aegis I set it up to automatically backup to a shared access area, e.g. /Backup
I'd like to use the untrusted device feature to store my personal documents on my brother-in-law's server (and vice versa) for backup purposes. However, I'd like to figure out how we can seed the data so that we aren't blowing through our Xfinity data caps. Any thoughts on this?
Perhaps sync with a portable device, e.g. laptop with Syncthing while at home. Then take the laptop to his house, connect to his WiFi and sync with his server..
I think, you forgot to explain " Out of Sync Items" I don't understand it very well.
I use this on Anfroid to sync my KeePass database
Would this be an enterprise replacement for MoveIT?
No
3:25, 3:51
Tom, could you please make video how you backup aegis authenticator on smartphone?
If I'm right you are using aegis authenticator on Google Pixel
Just use their backup and copy it somewhere safe.
Under Aegis Backups enable automatic backup and then tell it to store in a location you can access with Syncthing. For example I store mine under /Backup/Aegis on my Pixel 7.
There's a really big issue with syncthing corrupting its database randomly, an issue that they haven't fix it yet. I've stopped using it because of this.
Not an issue I have encountered in my over 8 years of use, you should contact their support.
5:45
2:06
Realizing that "...Made Simple" is a relative term
haha how not to have to use their nut mice to know theyre there if you need them lol
couldnt have put it better myself :)
I’ve been installing syncthing in various scenarios for the last 6-7 years and I gotta admit, your instructions are confusing particularly around ssh port forwarding. Syncthing has a TLS encrypted transport layer. You DON’T need to use vpn’s (idk what a mesh vpn is). Normies will not understand this video.
Syncthing sucks on Windows in my experience.
First. Lets gooooo.
Again ?