Why We Use Syncthing, The Open Source Private File Syncing Tool instead of NextCloud
Вставка
- Опубліковано 5 жов 2019
- Amazon Affiliate Store
➡️ www.amazon.com/shop/lawrences...
Gear we used on Kit (affiliate Links)
➡️ kit.co/lawrencesystems
Try ITProTV free of charge and get 30% off!
➡️ go.itpro.tv/lts
Use OfferCode LTSERVICES to get 5% off your order at
➡️ lawrence.video/techsupplydirect
Tesla Referral Program Offer
🚘 www.tesla.com/referral/thomas...
Lawrence Systems Shirts and Swag
👕 teespring.com/stores/lawrence...
Digital Ocean Offer Code
➡️ m.do.co/c/85de8d181725
HostiFi UniFi Cloud Hosting Service
➡️ hostifi.net/?via=lawrencesystems
Protect you privacy with a VPN from Private Internet Access
➡️ www.privateinternetaccess.com...
Google Fi Service Referral Code
📱g.co/fi/r/TA02XR
More Of Our Affiliates that help us out and can get you discounts!
➡️ www.lawrencesystems.com/partn...
Twitter
🐦 / tomlawrencetech
Patreon
🔗 / lawrencesystems
Our Forums
🔗 forums.lawrencesystems.com/
GitHub
🔗 github.com/lawrencesystems/
Discord
🔗 / discord
Our Web Site
🔗 www.lawrencesystems.com/
Setup and Review of SyncThing, The Open Source File synchronization tool
• Setup and Review of Sy... - Наука та технологія
Sir, you are doing great work... Hats off.
Thanks, open source private tools on Linux are what people's needed.
This is definitely a good one. Immediately put it in all our devices.
Thank you for sharing. It would be nice to have a more detailed video!
I tried to set up syncthing a couple years ago. My folders wouldn't update the original files, only the new files added to the folder. After weeks of trying to different suggestions, reading everything and watching videos to troubleshoot, I gave up and removed it. I probably have the old screenshots around.
I would love if you did a new setup/step by step adding folders, syncing to offsite folder, etc.
I tried syncthing but the cpu usage was crazy for the project I was using it for. So I switched to rsync. That being said if you are using it as something like a Dropbox replacement I think it’s great.
thanks for saying so. He said 'very light' and now I have a better idea
could it be that i found a replacement for google drive? more than anything i would like to know if syncthing includes software to do a search on my files so i could actually locate them? thanx in advance for your reply
Hi,
I started now using SyncThing to backup a folder (and sub-folders) from my Android device (send only) to my Synology NAS (receive only).
Everything works fine but i can figure it out (note: noob here ☺️) how can i access the SyncThing GUI on the browser remotely (the sync process works fine. Also, i reserved my NAS ip address on my ISP router).
Can you tell me what changes i have to make on the GUI settings and also if i can use my Synology DDNS?
Thanks
I need some help. I am trying to get files moved from ruTorrent to a Synology NAS server using Syncthing. I am lost, and I can't find any tutorials or help. Can anyone give me any direction of how to easily move files once completed to a Synology NAS?
Thank you in advance!
I think that NextCloud and Syncthing serve totally different purposes. Syncthing does just what it implies syncs ie replicates. With NextCloud your data stays put but is accessible everywhere you want it over the web, ie a cloud solution. I do not think they are comparable. Maybe some use NextCloud for syncing, but I wouldn't do that.
I think almost everyone who has Nextcloud also runs sync clients. It's a huge benefit of the system, I can sync my phone and my PC and my home file server automatically. I also get access to the data via a web browser etc but syncing is a huge part of what Nextcloud is all about. They don't serve different purposes at all, but one of them is a central node to which everything connects to handle syncing (Nextcloud) and the other is a fully distributed network of units syncing only with each other (Syncthing). Different takes on the same task. Granted, Nextcloud also gets you stuff like the Collabora office suite, and Deck for Kanban style task management, and a music player you can stream from with a browser, contacts, calendar etc etc.
@@lorcro2000 I guess I never thought of that. I have nextcloud tied to my freenas and I use nextcloud web site to access my data when i'm away. I didn't dig into any of the nextcloud sync
apps installed on pc or android. Thanks!
Your video synching example raises an interesting question: for large media work (audio, photography) I'm using iCloud to sync between devices; I really like that on my MacBook, which has limited storage, I can select "Remove Download" on local files when I'm done with an editing project and that erases the files from my laptop's storage but keeps them in iCloud (and other devices) so I can pull them down again if I need to. Is there an equivalent to that in Syncthing (or NextCloud) and is it easy to use from Finder/Explorer or does it require running CLI commands? Thanks!
Probably the easiest is one of the GUI wrappers for rsync. I'm not sure why the hate for cli tools, it's not that hard to type, rsync -a source destination. And add --remove-source-files if you want it to be more of a move.
It was super easy to sync up all of my devices- all 5 in 20 minutes or less- without watching or reading how. I am going to use it. But, I have some security concerns: 1) keeping our files for 30 days? where? I have concerns about that. 2) why wouldn't the Syncthing apps on either phone allow me to use the QR scanners I already had installed in my phone? i even shared one scanned pic to the app, but my phones' app still demanded I download a QR scanner. I chose F-Droid on both phones and oddly, enough, instead of being given the usual choice of 3 to 5 QR scanners (I installed the others 2 weeks ago, so remember), one was selected FOR me without my even really seeing the F-Droid site . VERY odd. Of course, that scanner insisted on having full permissions to all of my files. The name on the app was CHinese and that means nothing. But, I think you guys should test it out using Google Play store instead. The QR scanner logo/icon has a red thing across the middle of a SKU code...not the usual QR code icon.
I’ll go to the SyncThing site for my answer but you might want to mention whether this is a real-time only syncing solution where both ends have to be up and running or whether it has a store-n-forward syncing ability. I would assume not since that creates some complexity for the sake of features at the expense of security but is important for not always on devices that require use of a snapshot ability.
You need to have at least two units running at the same time. For instance, your home server could act as a "hub" that you always had on. Change something on one computer, that syncs. Turn on the other computer, that grabs the new stuff from the home server, and so on. That's actually another potential benefit of Nextcloud; you can set that up in a VPS and have that run in the cloud 24/7. Or by all means get an account at a Nextcloud-specific provider, I just went with the VPS route. Granted - you could also just put a Syncthing node in a VPS too. The storage costs might add up though, not sure if Syncthing can use an S3 backend for storing stuff. It should be possible to cobble together though, this is Linux after all...
I decided to use Syncthing because of it's compatibility between devices. I wanted a simple solution to manage backups of all my devices in a single place, and Syncthing gave me that.
previously, I used Crontab + Rsync on Linux (to back up my servers) and Cobian Backup (copying into an SMB share) on Windows. yes, I know Cobian is abandoned but it worked great and was very flexible. but I needed a more centralized solution, hence the migration to Syncthing. now I can even backup my Android phones!
Synchronization is not a backup. Backups can be yearly, monthly, weekly, daily, outstanding...
Thank you
To reduce the attack surface you can put NextCloud behind a VPN. I do the same and even firewalled it to block outgoing connections from the device running NextCloud (whitelisted a few mirrors for the os updates and that's it)
AYE!!! I thought I was the only one that used SYNCTHING!!! AWESOME!
I tried using it with large files (several GB) and it failed miserably, syncing VM data also fails. Any thoughts?
The largest I ever transferred was a 40GB .vdi image with a windows 10 on it across 4 computers and had no problems.
This app has relly cool idea but its not as goos as its seems . In local network it dosnt sync sometime and if you connect to vpn it stop to sync till you reset network node
For iPhone I guess möbius sync is what to use for sync thing
I used Syncthing for a while. One thing that turned me off is using it on mobile platforms. The problem is that if you want to access any single file in your library, you have to enable sync for the whole library on your phone. That means using a large chunk of your phone storage. With Nextcloud, you don't need to sync the whole library but download files on demand. Still a great tool though.
Is this still trude today, as of 2021?
The idea of syncthing is multiple backups and not relying on a main server all the time. You don't truly have a backup if your files are only stored in the cloud on demand. In your case, I'd make a specific folder to share with your mobile devices to save space.
@@fidelty2427, as I wrote elsewhere: "Synchronization is not a backup. Backups can be yearly, monthly, weekly, daily, outstanding..."
@@TheRVSN just set it to send only my guy
What about a program for sharing files to a group and allowing them to download files they need and keep folders updated when a core group updates them while utilizing torrent style syncing. Mainly for sharing tech manuals and drawings and stuff that do not have any secrecy for it.
Syncthing can work for group file sharing
Dont you need #!/bin/bash on the top line of your shell script?
Guess not! :)
Sudo, ssh, cd, ping, ls. Sounds about right to me! LOL
Does anyone know if syncthing on Android supports background sync of a single file? I use KeePass with nextcloud currently and load it over webdav. It doesn't look like ST does webdav so I would want background sync to keep my DB in the background
Syncthing is a great tool, especially for dropbox-like backups in one direction (picture backups from phone to pc etc.). But I absolutely can NOT recommend it for this use case, as syncthing has NO proper version-control. I tested it in combination with keepassx and also enabled the "Staggered File Versioning" in syncthing with the option "never delete" (which I' am glad I did) and the result is a total version-chaos , which takes a while to clean up again. When the key-database is opened for longer times on one device without saving and edited on the second device in the meantime, I even observed minor data losses.
There are obviously people who successfully implemented it, but it involves syncing your various databases (on each device) with a master copy kept on a cloud service such as Dropbox or Nextcloud. (The master copy is only for syncing, and shouldn't be edited directly)
I recomend urbackup too, very good image and backup tool.
Hey, thanks for this tip. I love syncthing and have also been looking for its compliment - an open source de-dup delta copy cross platform backup pgm.
Not so great, off late urbackup has remove support for OS X.
For me the biggest deterrent without having tested its reliability is that renaming a folder on one side copies all the files back to the other. Does anyone know if there is any resolution to this issue or if something will change in the future?
The Syncthing FAQ has an entry covering just that, maybe it solves your problem.
I was just listening to how @SGgrc uses syncthing. Going to have to give it a try.
Steve sure did a good job researching all the options!
Why do I need it will it help me sync my Nextcloud? I use a company called Hostiso in Minnesota for my Nextcloud. But it seems to be syncing?
Man this is a lot to take in trying to figure out the cheapest way to get photos backed up from iPhone onto local server and then I want a secure way to view them from outside the network but using an app that is similar to google photos
So should I run a Freenas server that runs sync thing on that or next cloud or windows vm that’s running sync thing or something else lots of avenues I can go down now
Also curious about the same thing
@@chivimbe synology moments app closest I have found but have not bought one yet because I want a 5 drive for raid 5 but the wife says too much so I’m probably going to go the two drive with mirror. There is also xpenology which is a ripped version of the synology dsm software you can use in vm or bare metal
@@gjkrisa I’m eyeing the synology ds1520+, but it is expensive
@@chivimbe same
Wait you have been using it that long?
Could you do a review of resilio sync? How does it compare to syncthing?
Resillio It is a non-free closed solution built on top of the proprietary BitTorrent protocol. Syncthing is fully open source built on open standards.
I landed on resilio sync after doing research. I paid a small price for the lifetime licence, and it's now syncing my computers, banking up to my nas and sharing files to friends. Plus it has a really nice feature: you can give someone or some computer an "encrypted sharing key": the files are encrypted on your PC before being synced to the other one! It works as a backup/node, but noone on that computer can access any of the files!
I really liked the free version of Resilio Sync over SyncThing because of native view of files and folders on the remote device. This with selective sync option really shines over SyncThing.
I really liked that I can see the files over my other device which are read only. However when I click them, they instantly become available on my phone, so lets say I want to see that movie, I can make it available on my phone, watch it and delete it again locally while still keeping it on backup device.
soooo... with this thinkbook..... are you running windows or linux? lol thanks for the content sir!
I think he is running Linux (Pop OS) on his laptop, based on another video. Syncthing runs on Linux and Windows equally fine.
The problem with Syncthing is using it in a server-client scenario. I know this is not the intention, but the developer of freeNAS would make you think so as it's one of their offered plugins. If you're using it for multiple users, the freeNAS admin can see everyone else's synced data. It's fine for one-person use, but hey, then you don't really need a freeNAS "server" go-between. Tom has done a video of using Syncthing on freeNAS. I just find it kind of useless with that setup. There may be something I'm missing. Someone please enlighten me, if this is the case. I'd really like to get it setup so my home users can rest assured that I can't see their data.
You can always encrypt the files individually on the client side, but that can be a real pain.
You don't need to manually encrypt your files individually, Syncthing has a (beta/testing) built-in alternative that you can use: on a folder's sharing options, for each device you sync to you can also set a password if that device is untrusted and should only pass the data around instead of having access to it. The data is encrypted with a combination of the password and the folder ID.
I just tested with 3 devices, A shares a folder with B with password "test", B then shares it with C, which inputs the same password. The result is that B cannot read any data because it is encrypted, but both A and C freely share plain text, despite them having no knowledge of each other (i.e. A and C were never linked to begin with). I think this might be close to the solution you wanted, B being your server.
You can read more on Untrusted (Encrypted) Devices on the docs, but note that it has a big red warning about it still being considered beta/testing.
we used syncthing at work but then it stopped syncing so we moved to SharePoint.
Share point has its own cost... Licensing and what not !! Setting share point properly is a pain in ass. Share point does not offer support for something else.
Hence share point is no-go area for 99.9 % people.
That's quite the leap. SharePoint excels storing files and their metadata, but as a former SharePoint developer I can say it does a lot of things for you, but anything it doesn't do is generally a much bigger pain to develop than it would be outside SharePoint.
Best of luck with your sharepoint... We are not interested in any MS product...
it doesn't have an iphone app !! any other alternative?
perhaps resilio sync is for you. Is freemium but not open source
shame about the lack of an option for iOS - you had almost convinced me to leave Nextcloud
Proposal: Leave iOS.
@@delta-a17 we CAN'T, we sold our souls.
Still use it?
yup
New video on Syncthing, when?
Why?
@@LAWRENCESYSTEMS Update it's on progress and new features, what has changed etc since you first set it up. I thought I heard you mention in the video that it's been a while since you did an install and setup video.
I think all the changes are really minor, so maybe
@@LAWRENCESYSTEMS While I've got you here, may I ask a question?
Can I have multiple different accounts on one syncthing server? Or do I need a different server/vm for each syncthing account? I'm trying to replace nextcloud and my whole family uses it.
@@heckyes There are no 'accounts' just folders
Steve Gibson is a fan of Syncthing for syncing and he integrates Sync.com for TNO (Trust No One) encryption.
Check you Steve's podcast: twit.tv/shows/security-now/episodes/734?autostart=false
Check out Sync.com: www.sync.com/?_sync_refer=ca3cda590
I am not sure you get the difference between a cloud solution and a sync solution. If you care about security you can host your cloud using owncloud for example...making comparison between cloud and sync solution is like comparing apples with tomatoes, they are just different things. I am a fan of Syncthing but this is not a cloud solution.
Why not establishing VPN between workstations and using rsync between linux only, or rsync even with WSL between Windows machines or Win + linux etc ...
Syncthing is much simpler?
For example, I'm using my mobile phone as a server for the documents and pictures I am shooting with it. If is always synced with my home and office computers.
That would be both more complicated and more resource intensive.
@@LAWRENCESYSTEMS maintenance of VPN's is very hard, vpn is good at first insight about security, but you have a threat surface too, more people giving maintenance to your environment and some bugs etc about this vpn's softwares or glitches, its not the "best thing" for small and medium business, maybe good for large business and high compliance scenarios.
In my experience, rsync is better suited for one-direction backups, where there are designated send-only and receive-only folders; for synchronization one needs to take into consideration further factors, all of which syncthing takes care of.
I do the same thing for my company, but OneDrive
So, you don't do the same thing at all, you use cloud storage. 😉
@@lorcro2000 explain?
@@phabeondominguez5971 synching is a peer-to-peer file sync solution, the computers on your network connect to themselves to always keep the selected folders synchronized.
The cloud is storage on someone else's computer, mainly Google or Microsoft.
Attack surface.
Worries about security, yet using Google Chrome browser.
8:27 - that should be in git / gitlab / github and not syncthing
For one person to share with himself? Syncthing is more than fine for keeping your personal scripts available.
@D M You can never overestimate the usefulness of proper version control.
For example I tried the experiment of synchronizing Keepass-databases between two devices with syncthing. I activated "Staggered File Versioning" in syncthing with the option "never delete" in syncthing, which prevented major data losses, but nevertheless its a total mess. There are however people who used syncthing and keepass successfully with a system including a master copy on a cloud-server, that wont be touched directly.
lol
Sorry but too much waffle. Please just get down to brasstacks!!
Make a Ubuntu install video 👍
on potato?
Yep, giving him an order will certainly compel him to do so LOL. SMH. 🙈
Install video: follow any written guide on the internet.
Theres already a lot of those on UA-cam and it's too basic for this channel. This channel is mostly File Storage systems, VMs, networking, servers, and cloud solutions. Basic OS installs are not part of this channel.
Step 1. Download Ubuntu. Step 2. Put it on a USB stick, there are instructions. Step 3. Plug it into a PC and press "install".
goes on youtube. searches for syncthing review. huuurhrhhr wat is dis guy talkin bout mi no understend fed services , itvpro, tom lawrence fans, incidence response. arrhrhrh moving into the forest BRAIN NO COMPUTE SER
shaaatt aarrrrp . with due respect, ofcarse