What is in a Lucene index? Adrien Grand, Software Engineer, Elasticsearch

I can super highly recommend talks by Adrien Grand on Lucene and Elasticsearch. They are super instructive yet easy to follow. ▶ this video [link]

in “Elasticsearch from the Bottom Up (2013)” · View on HN

This is excellent. I was recently reviewing Lucene concepts and found this video really good: ▶ this video Also this site has a series of Lucene articles that are pretty nice. The one on Term Vectors in particular: [link] Based on some quick research it seems like Lucene is already using a sorted skip data structure for the posting list, so I wonder why they had to do a custom implementation? Perhaps it has to do with their custom Document ID scheme and how they want to preserve order in the Posting List being different from the default behavior. It also sounds like searchers are searching on indexes as they're being written, and there is some custom coordination around visibility, which might require diverging from Lucene default behavior. Either way, pretty impressive!

in “Reducing search indexing latency to one second” · View on HN

This is extremely high level. A nice view of how lucene internals work by core committer Adrien Grand: [link] ▶ this video

in “Challenges in Implementing a Full-Text-Search Engine” · View on HN