What is in a Lucene index? Adrien Grand, Software Engineer, Elasticsearch
Вставка
- Опубліковано 6 вер 2024
- Presented by Adrien Grand, Software Engineer, Elasticsearch
Although people usually come to Lucene and related solutions in order to make data searchable, they often realize that it can do much more for them. Indeed, its ability to handle high loads of complex queries make Lucene a perfect fit for analytics applications and, for some use-cases, even a credible replacement for a primary data-store. It is important to understand the design decisions behind Lucene in order to better understand the problems it can solve and the problems it cannot solve. This talk will explain the design decisions behind Lucene, give insights into how Lucene stores data on disk and how it differs from traditional databases. Finally, there will be highlights of recent and future changes in Lucene index file formats.
Best Lucene internals explanation I have seen/read. No other books/video contain anything mentioned here. I wish I watched it earlier.
Thanks
cool presentation. it is amazing how little approachable info is there on this topic, even 9 years later...
Subtitles would be helpful.
Best video you would ever see. You may waste your time searching web as I did you can directly watch this.
He is a genius... Though it was a little hard to follow. I'm able to connect what goes in our solr indexes. This guy is too valuable a resource he should invest a little effort in his pronunciation
So the insertions are like SS tables. Make new sorted and then when the problem gets too big merge n sorted list
Merci pour la belle présentation Adrien.
Really hard to follow without a subtitle
Brilliant lecture! The bloke really knows his stuff!!
Very good presentation! thanks!
Is the point about using doc values when not every field is needed in memory still valid, due to compression which is now enabled by default, for example in Solr? You have to decompress whole document before reading the fields. Adrien is talking about it at 28:00.
Good One..
Is this video still relevant?
good
Too strong accent to follow this for an hour. Now i'm doing the Jedi thing instead: Read the source Luke.
Great info but hard to follow. Next time, slow down and enunciate for non-French speaking viewers. For instance, at 24:26...unique value for what? Jumps?
he wants to say "faceting = computing counts per unique value of a TERM"
well, yes, a cool content, but accent is a torture :)
very useful, but the accent... how much more french can you get
hey @noel, fancy meeting you here
my head hurts trying to listen to this... please add subtitles anyone..
Accent and pronounciation is hard to follow, good content though
Please find an English native speaker to redo this video. Your French accent is often manifested as swallowing important parts of words. I could not follow the discussion and left the video.
Faut vraiment que tu bosses ton Anglais....