Elasticsearch Snapshot Lifecycle Management (SLM): Overview, Best Practices, Snapshot Policy & More

Elasticsearch Snapshot Lifecycle Management (SLM) allows you to set up snapshot lifecycle policies to automate the timing, frequency, and retention of snapshots. In this talk we will cover the basics of registering a repository, setting up a snapshot policy, and taking the test snapshots. If you are aware of the necessity of taking frequent snapshots for high availability/disaster recovery and you’ve been looking for a way to automate the whole process - then SLM is the right tool for you!
Presenter: Miloš Mandić, Elastic Stack Educational Engineer & Software Engineer.
Sept 9th, 2020, Elastic Meetup.
Questions? Check out discuss.elasti...
Connect with the Elastic community through Slack: ela.st/slack
#elasticsearch #slm #elasticsearchtutorial #snapshot

[@PreveenRaj]

This is awesome. For someone looking to write cron jobs to backup elasticsearch data. This is a life saver. Thanks :)

[@AlexandruDragoescu]

When using a cluster with more than one node is not enough to create local folders for shared fs repo. you need smb/nfs mounted drive because each node will check the "repo" and if there is no communication between nodes via the repo, then it will not work. if each node can not see data put by other nodes, then the repo will not be available.

[@tranvanut]

Hello, about 16'20" I see your version Stack Management 7.9.1. I would like to know that if you using elasticsearch entreprise or open version. Because my Stack Management 7.10.2 has only Kibana in the list at the left. I have no Ingest, Data, Stack, AlertS and Insights like you. Thanhks very much for your answer.

[@ChandraSekhar-jm7em]

same with me. did you find anything related to it?

[@milosmandic533]

Hi Tran and Chandra! Thanks for your questions. In the video above I used Basic license (which is free). Bear in mind that the subscription tiers have slightly changed since and even more features are included as a part of Basic license. Please check this link for more details: www.elastic.co/subscriptions
Let me know if you have any additional questions.

[@maheshkumar-gu4jq]

At 31:25 I can see the policy you have manually created….when I tried the same way to create a policy to capture only specific indices …it’s automatically creating an additional policy “cloud snapshot policy ” which is capturing all the indices (200+ TB)and Its not allowing me to edit it….it’s says “it’s a managed policy ” and I can’t delete it….please assist me

[@therus000]

thanx so much
what if i got repo on other server. what the best way to write the repo.path with ip of server or with name ?

[@pkhler4438]

If elasticsearch takes incremental snapshot and in the example if the new data is not coming to that index. What data will be there in second and snapshots after that. for example. If I am taking snapshot daily but data is retained for 7 days in the cluster. snapshot will have only one days new indices?

[@OfficialElasticCommunity]

Hi Pratik! The best place for this question is discuss.elastic.co

[@bilalabudan9645]

Hi bro, is that possible to do cold backup our snapshot to extenal hard drive?
like do copy our snapshot to external hard drive.
is that possible?

[@Elastic]

Hi Bilal! That's a great question for discuss.elastic.co or our public slack workspace (ela.st/slack). Both of those spaces are monitored by technical folks, unlike this comment section :)

[@jvaiguade]

Hi, I'm using basic license over Ubuntu 20.04 (local mode). When I try to open Snapshot and Restore I get this error: [exception] Security must be explicitly enabled when using a [basic] license. Enable security by setting [xpack.security.enabled] to [true] in the elasticsearch.yml file and restart the node. When I enable Security I can't run Kebana. Could anybody help me with this issue? Many thanks

[@OfficialElasticCommunity]

Hi Joan, thanks for this feedback! I'd recommend opening an issue on discuss.elastic.co.

[@DontTakeCrack]

"cron schedule for retaining snapshots is ..." what is this?

[@OfficialElasticCommunity]

Hi there! These comments aren't monitored by technical staff, but I did find this: discuss.elastic.co/t/cant-really-change-cron-schedule-for-retaining-snapshots/263985
In general, discuss is the best place to ask technical questions about Elasticsearch.

[@kamalnaderlu9022]

How I can take snapshot in specific time for example 1 year ago and earlier?

[@OfficialElasticCommunity]

Hi Kamal! That's a great question to pose at discuss.elastic.co, or you can join our slack workspace and ask there: ela.st/slack