The Meltwater Elasticsearch Architecture

Göteborg meetup, November 2022 | Meltwater provides a search and analytics platform as a service to our 25k customers around the world. The underlying technology is powered by a large Elasticsearch cluster. In that cluster we store 400 billion documents and get 6000 more every second (on average).
In this presentation we will show you our use case, what hardware we use, our high level architecture, and how we are able to serve this large amount of documents that are in turn being queried by 4M daily queries which are also very large and complex, especially in their use of wildcards.
We will also talk a little about load balancing and what system metrics we monitor and scale on. Karl Neyvaldt, Principal Software Engineer and Team Lead (@Meltwater Search Platform Team) & Emre Basar, Principal Software Engineer (@Meltwater Search Platform Team)

[@AlexeyBass]

Thanks for sharing that folks!