What’s new in 8.17

edit

Here are the highlights of what’s new and improved in Elasticsearch 8.17! For detailed information about this release, see the Release notes and Migration guide.

Other versions:

8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8 | 8.7 | 8.6 | 8.5 | 8.4 | 8.3 | 8.2 | 8.1 | 8.0

logsdb index mode is now generally available

edit

The logsdb index mode has been GA-ed. This feature allows Elasticsearch to store logs more efficiently.

logsdb index mode allows to reduce storage usage up to ~3 times compared to storing logs in Elasticsearch using the default index mode. Refer to the documentation for further information.

Elastic Rerank

edit

In 8.17, we are introducing Elastic Rerank, Elastic’s new model for semantic reranking. Reranking can be used as the second stage on top of your existing search approach, whether this is lexical search, ELSER, or dense embeddings, resulting in significant semantic relevance gains mainly via recall improvements. This is very important for RAG applications, where you want to send the most relevant information to an LLM in order to generate the possible responses.

Elastic Rerank is a cross-encoder architecture and it is in technical preview in 8.17.

Diagram showing how document text is modeled for a cross encoder

To understand reranking and how you can use it to improve your search, read What is semantic reranking and how to use it, a blog by the creators of Elastic Rerank.

For more information on the Elastic Rerank model architecture and how it compares for relevance and cost against other reranking models, see Introducing Elastic Rerank by the same authors.

Pre-configured default ELSER endpoint

edit

With this release, we are introducing a pre-configured default ELSER endpoint. This removes the need for any inference configuration in order to use ELSER. There is no more need for an inference endpoint setup or for downloading the model and configuring threads and allocations through the trained models UI. Simply create a semantic text mapping with your indices and start using it. The default inference endpoint will download, deploy and start using ELSER for inference with adaptive allocations out of the box.

Full-text search for ES|QL

edit

The technical preview of the new MATCH and QSTR (query string) functions in ES|QL makes log searches easier and more intuitive. MATCH delivers full-text search functionality in ES|QL using a Lucene match query, while QTSR aids in more advanced filtering of log data by enabling Lucene query string queries.

Full-text search for ES|QL enables easier and more performant searching in Discover, especially when dealing with multiple terms or conditional logic. Learn more in the ES|QL full-text search documentation.