All Articles
Building advanced visualizations with Kibana and Vega
How To

Building advanced visualizations with Kibana and Vega

Have you struggled to build the Kibana visualizations you need using Lens and TSDB? Learn how to create complex visualizations using Kibana and Vega.

Carly Richmond

Aggregate data faster with new the random_sampler aggregation
Generative AI

Aggregate data faster with new the random_sampler aggregation

Aggregate billions of documents in milliseconds instead of minutes with Elastic. Learn more about how the new random_sampler aggregation gives you statistically robust results at a lower cost.

Benjamin Trent

Thomas Veasey

How to analyze data using Python, Elasticsearch and Kibana
How To

How to analyze data using Python, Elasticsearch and Kibana

Explore data analysis with Elasticsearch, Python & Kibana. Learn about data loading, querying and creating Kibana dashboards with an example.

Jessica Garson

Automatically updating your Elasticsearch index using Node.js and an Azure Function App
How To

Automatically updating your Elasticsearch index using Node.js and an Azure Function App

Learn how to update your Elasticsearch index automatically using Node.js and an Azure Function App. Follow these steps to ensure your index stays current.

Jessica Garson

Elastic Cloud adds Elasticsearch Vector Database optimized profile to Microsoft Azure
Vector DatabaseGenerative AI

Elastic Cloud adds Elasticsearch Vector Database optimized profile to Microsoft Azure

Elasticsearch added a new vector search optimized profile to Elastic Cloud on Microsoft Azure. Get started and learn how to use it here.

Serena Chou

Jeff Vestal

Yuvraj Gupta

ChatGPT and Elasticsearch: Creating custom GPTs with Elastic data
Generative AI

ChatGPT and Elasticsearch: Creating custom GPTs with Elastic data

Get started with custom GPTs using ChatGPT and Elasticsearch. Learn how to create custom GPTs that interact seamlessly with your Elasticsearch data.

Sandra Gonzales

ChatGPT and Elasticsearch: OpenAI meets private data
Generative AI

ChatGPT and Elasticsearch: OpenAI meets private data

Integrate Elasticsearch's search relevance with ChatGPT's question-answering capability to enhance your domain-specific knowledge base.

Jeff Vestal

ChatGPT and Elasticsearch: A plugin to use ChatGPT with your Elastic data
Generative AI

ChatGPT and Elasticsearch: A plugin to use ChatGPT with your Elastic data

Learn how to implement a plugin and enable ChatGPT users to extend ChatGPT with any content indexed in Elasticsearch, using the Elastic documentation.

Baha Azarmi

Chunking large documents via ingest pipelines plus nested vectors equals easy passage search
Vector DatabaseHow To

Chunking large documents via ingest pipelines plus nested vectors equals easy passage search

Learn how to chunk large documents using ingest pipelines and nested vectors in Elasticsearch for easy passage search in vector search.

Michael Heldebrant

Using Cohere embeddings with Elastic-built search experiences
IntegrationsHow ToVector Database

Using Cohere embeddings with Elastic-built search experiences

Elasticsearch now supports Cohere embeddings! This blog explains how to use Cohere embeddings with Elastic-built search experiences.

Serena Chou

Jonathan Buttner

Dave Kyle

Elasticsearch open Inference API adds support for Cohere’s Rerank 3 model
IntegrationsHow ToVector DatabaseGenerative AI

Elasticsearch open Inference API adds support for Cohere’s Rerank 3 model

“Learn about Cohere reranking, how to use Cohere's Rerank 3 model with the Elasticsearch open inference API and Elastic's roadmap for semantic reranking.”

Serena Chou

Max Hniebergall

Elasticsearch open inference API adds support for Anthropic’s Claude
IntegrationsHow ToGenerative AI

Elasticsearch open inference API adds support for Anthropic’s Claude

Interact with Anthropic's Claude 3.5 Sonnet and other models to generate content and perform question & answering.

Jonathan Buttner

Using Elasticsearch as a vector database for Azure OpenAI On Your Data
IntegrationsHow ToVector Database

Using Elasticsearch as a vector database for Azure OpenAI On Your Data

Learn how to set up and ingest data into Elasticsearch for use as a vector database with Azure OpenAI On Your Data, allowing you to chat with your private data.

Paul Oremland

Elasticsearch open inference API adds support for Azure OpenAI chat completions
IntegrationsHow ToGenerative AI

Elasticsearch open inference API adds support for Azure OpenAI chat completions

Azure OpenAI chat completions is available via the Elasticsearch inference API. Learn how to use this feature to answer questions.

Tim Grein

Elasticsearch open inference API adds support for OpenAI chat completions
IntegrationsHow ToGenerative AI

Elasticsearch open inference API adds support for OpenAI chat completions

Learn how OpenAI chat completions and Elasticsearch can be used to summarize, translate or perform question & answering on any text.

Tim Grein

How to use Elasticsearch to prompt ChatGPT with natural language
Generative AI

How to use Elasticsearch to prompt ChatGPT with natural language

This blog post presents an experimental project for querying Elasticsearch in natural language using ChatGPT.

Enrico Zimuel

Designing for large scale vector search with Elasticsearch
Vector Database

Designing for large scale vector search with Elasticsearch

Explore the cost, performance and benchmarking for running large-scale vector search in Elasticsearch, with a focus on high-fidelity dense vector search.

Jim Ferenczi

Improving information retrieval in the Elastic Stack: Improved inference performance with ELSER v2
ML Research

Improving information retrieval in the Elastic Stack: Improved inference performance with ELSER v2

Learn about the improvements we've made to the inference performance of ELSER v2, achieving a 60% to 120% speed increase over ELSER v1.

Thomas Veasey

Quentin Herreros

Valeriy Khakhutskyy

Improving information retrieval in the Elastic Stack: Optimizing retrieval with ELSER v2
ML Research

Improving information retrieval in the Elastic Stack: Optimizing retrieval with ELSER v2

Learn how we are reducing the retrieval costs of the Learned Sparse EncodeR (ELSER) v2.

Thomas Veasey

Quentin Herreros

Valeriy Khakhutskyy

From ES|QL to Pandas dataframes in Python
How ToIntegrations

From ES|QL to Pandas dataframes in Python

Learn how to export ES|QL queries as Pandas dataframes in Python through practical examples.

Quentin Pradet

Geospatial search with ES|QL
How To

Geospatial search with ES|QL

Geospatial search in Elasticsearch Query Language (ES|QL). Elasticsearch has powerful geospatial search features, which are now coming to ES|QL for dramatically improved ease of use and OGC familiarity

Craig Taverner

From ES|QL to PHP objects
ES|QLHow ToIntegrations

From ES|QL to PHP objects

Learn how to execute and manage ES|QL queries in PHP. Follow this guide to map ES|QL results to a PHP object or custom class.

Enrico Zimuel

From ES|QL to native Pandas dataframes in Python
How ToIntegrations

From ES|QL to native Pandas dataframes in Python

Learn how to export ES|QL queries as native Pandas dataframes in Python through practical examples.

Quentin Pradet

ES|QL queries to Java objects
ES|QLHow ToIntegrations

ES|QL queries to Java objects

Learn how to perform ES|QL queries with the Java client. Follow this guide for step-by-step instructions, including examples.

Laura Trotta

RAG evaluation metrics: A journey through metrics
ML Research

RAG evaluation metrics: A journey through metrics

Explore RAG evaluation metrics like BLEU score, ROUGE score, PPL, BARTScore, and more. Discover how Elastic is evaluating RAG with UniEval.

Quentin Herreros

Thomas Veasey

Thanos Papaoikonomou

How to choose between exact and approximate kNN search in Elasticsearch
How ToVector Database

How to choose between exact and approximate kNN search in Elasticsearch

Learn more about exact and approximate kNN search in Elasticsearch, and when to use each one.

Carlos Delgado

Implementing image search: vector search via image processing in Elasticsaerch
Vector Database

Implementing image search: vector search via image processing in Elasticsaerch

Learn how to implement image search with an example. This blog covers how to use vector search through image processing in Elasticsearch.

Alex Salgado

Elastic Cloud adds Elasticsearch Vector Database optimized instance to Google Cloud
Vector DatabaseGenerative AI

Elastic Cloud adds Elasticsearch Vector Database optimized instance to Google Cloud

Elasticsearch's vector search optimized profile for GCP is available. Learn more about it and how to use it in this blog.

Serena Chou

Jeff Vestal

Yuvraj Gupta

Generative AI using Elastic and Amazon SageMaker JumpStart
Generative AIIntegrations

Generative AI using Elastic and Amazon SageMaker JumpStart

Learn how to build a generative artificial intelligence (GAI) solution with Amazon SageMaker JumpStart, Elastic, and Hugging Face open source LLMs using the sample implementation provided in this post and a data set relevant to your business.

Uday Theepireddy

Ayan Ray

How to deploy NLP: Text embeddings and vector search
Vector Database

How to deploy NLP: Text embeddings and vector search

Using text embeddings and vector similarity search, this blog explains how to run deep learning models for NLP & showcases Elasticsearch's vector search capability.

Mayya Sharipova

Improving information retrieval in the Elastic Stack: Benchmarking passage retrieval
Generative AI

Improving information retrieval in the Elastic Stack: Benchmarking passage retrieval

In this blog post, we'll examine benchmark solutions to compare retrieval methods. We use a collection of data sets to benchmark BM25 against two dense models and illustrate the potential gain using fine-tuning strategies with one of those models.

Grégoire Corbière

Quentin Herreros

Thomas Veasey

Improving information retrieval in the Elastic Stack: Hybrid retrieval
Generative AI

Improving information retrieval in the Elastic Stack: Hybrid retrieval

In this blog we introduce hybrid retrieval and explore two concrete implementations in Elasticsearch. We explore improving Elastic Learned Sparse Encoder’s performance by combining it with BM25 using Reciprocal Rank Fusion and Weighted Sum of Scores.

Quentin Herreros

Thomas Veasey

Improving information retrieval in the Elastic Stack: Steps to improve search relevance
Generative AI

Improving information retrieval in the Elastic Stack: Steps to improve search relevance

In this first blog post, we will list and explain the differences between the primary building blocks available in the Elastic Stack to do information retrieval.

Grégoire Corbière

Quentin Herreros

Thomas Veasey

Scalar quantization optimized for vector databases
ML Research

Scalar quantization optimized for vector databases

Optimizing scalar quantization for the vector database use case allows us to achieve significantly better performance for the same retrieval quality at high compression ratios.

Thomas Veasey

Benjamin Trent

Introducing the sparse vector query: Searching sparse vectors with inference or precomputed query vectors
Vector Database

Introducing the sparse vector query: Searching sparse vectors with inference or precomputed query vectors

Learn about the Elasticsearch sparse vector query, how it works, and how to effectively use it.

Kathleen DeRusso

Keeping your Elasticsearch index current with Python and Google Cloud Platform Functions
How To

Keeping your Elasticsearch index current with Python and Google Cloud Platform Functions

Keep your Elasticsearch index updated with Python & Google Cloud Functions. Follow these steps to automatically update an index when new data is present.

Jessica Garson

Introducing kNN Query: An expert way to do kNN search
Vector DatabaseHow To

Introducing kNN Query: An expert way to do kNN search

Explore how the kNN query in Elasticsearch can be used and how it differs from top-level kNN search, including examples.

Mayya Sharipova

Benjamin Trent

Less merging and faster ingestion in Elasticsearch 8.11
Lucene

Less merging and faster ingestion in Elasticsearch 8.11

Discover how Elasticsearch 8.11 improved its indexing buffer, resulting in less segment merging and faster ingestion.

Adrien Grand

Exploring vector databases: how to get the best of lexical and AI-powered search with Elastic’s vector database
Vector Database

Exploring vector databases: how to get the best of lexical and AI-powered search with Elastic’s vector database

Learn about the concepts related to vector databases, how they work and how to get the best out of lexical & AI search with Elastic’s vector database.

Bernhard Suhm

Lexical and semantic search with Elasticsearch
Vector Database

Lexical and semantic search with Elasticsearch

In this blog, we'll explore various approaches to retrieving information using Elasticsearch, focusing on lexical and semantic search.

Priscilla Parodi

How to set up LocalAI for GPU-powered text embeddings in air-gapped environments
Generative AIHow ToIntegrations

How to set up LocalAI for GPU-powered text embeddings in air-gapped environments

With LocalAI, you can compute text embeddings in air-gapped systems. GPU support is available. Here's how to set up LocalAI to compute embeddings for your data.

Valeriy Khakhutskyy

Apache Lucene 9.9, the fastest Lucene release ever
Lucene

Apache Lucene 9.9, the fastest Lucene release ever

Lucene 9.9 brings major speedups to query evaluation. Here are the performance improvements observed in nightly benchmarks & optimization resources.

Adrien Grand

Bringing maximum-inner-product into Lucene
Lucene

Bringing maximum-inner-product into Lucene

Explore how we brought maximum-inner-product into Lucene and the investigations undertaken to ensure its support.

Benjamin Trent

Improving information retrieval in the Elastic Stack: Introducing Elastic Learned Sparse Encoder, our new retrieval model
ML Research

Improving information retrieval in the Elastic Stack: Introducing Elastic Learned Sparse Encoder, our new retrieval model

Learn about the Elastic Learned Sparse Encoder (ELSER), its retrieval performance, architecture, and training process.

Thomas Veasey

Quentin Herreros

Accessing machine learning models in Elastic
Integrations

Accessing machine learning models in Elastic

Explore the machine learning (ML) models supported in Elastic, the Eland library for loading models and how to apply transformers & NLP in Elastic.

Bernhard Suhm

Josh Devins

Introducing Elastic Learned Sparse Encoder: Elastic’s AI model for semantic search
ML Research

Introducing Elastic Learned Sparse Encoder: Elastic’s AI model for semantic search

Learn about the Elastic Learned Sparse Encoder (ELSER), an AI model for high relevance semantic search across domains.

Aris Papadopoulos

Gilad Gal

Millionaire Odds vs. Hit by a Bus: An ES|QL Analysis
ES|QL

Millionaire Odds vs. Hit by a Bus: An ES|QL Analysis

Use Elasticsearch Query Language (ES|QL) to run statistical analysis on demographic data index in Elasticsearch

Baha Azarmi

Mistral AI embedding models now available via Elasticsearch Open Inference API
IntegrationsHow ToGenerative AIVector Database

Mistral AI embedding models now available via Elasticsearch Open Inference API

Learn more about how to use Mistral embeddings with Elastic built search experiences!

Mark Hoy

MAXSCORE & block-max MAXSCORE: More skipping with block-max MAXSCORE
Lucene

MAXSCORE & block-max MAXSCORE: More skipping with block-max MAXSCORE

Learn about MAXSCORE, block-max MAXSCORE & WAND. Improve the MAXSCORE algorithm to evaluate disjunctive queries more like a conjunctive query.

Adrien Grand

Speeding Up Multi-graph Vector Search
Lucene

Speeding Up Multi-graph Vector Search

Explore multi-graph vector search in Lucene and discover how sharing information between segment searches enhances search speed.

Mayya Sharipova

Thomas Veasey

Retrieval of originating information in multi-vector documents
Vector Database

Retrieval of originating information in multi-vector documents

Learn about multi-vector documents in Elasticsearch, their use cases, and how to link original context to a multi-vector document.

Gilad Gal

Multilingual vector search with the E5 embedding model
Vector Database

Multilingual vector search with the E5 embedding model

Here's how multilingual vector search works and how to use Elasticsearch with the multilingual E5 embedding model, including examples.

Josh Devins

Elasticsearch .NET client evolution: From NEST to Elastic.Clients.Elasticsearch
How ToIntegrations

Elasticsearch .NET client evolution: From NEST to Elastic.Clients.Elasticsearch

Learn about the evolution of the Elasticsearch .NET client and the transition from NEST to Elastic.Clients.Elasticsearch.

Florian Bernd

Elasticsearch piped query language, ES|QL, now generally available
ES|QLHow To

Elasticsearch piped query language, ES|QL, now generally available

Elasticsearch Query Language (ES|QL) is now GA. Explore ES|QL's capabilities, learn about ES|QL in Kibana and discover future advancements.

Costin Leau

George Kobar

AI plagiarism: Plagiarism detection with Elasticsearch
Vector DatabaseHow To

AI plagiarism: Plagiarism detection with Elasticsearch

Here's how to check for AI plagiarism using Elasticsearch, focusing on use cases with NLP models and Vector Search.

Priscilla Parodi

Elasticsearch query rules are now generally available
Search Relevance

Elasticsearch query rules are now generally available

Introducing the general availability of query rules

Kathleen DeRusso

Search relevance tuning: Balancing keyword and semantic search
Vector DatabaseHow To

Search relevance tuning: Balancing keyword and semantic search

This blog offers practical strategies for tuning search relevance that can be complementary to semantic search.

Kathleen DeRusso

Save space with byte-sized vectors
Generative AI

Save space with byte-sized vectors

Elasticsearch is introducing a new type of vector that has 8-bit integer dimensions. This is 4x smaller than the current vector with 32-bit float dimensions, which can result in substantial space savings.

Jack Conradson

Benjamin Trent

Semantic search as service at a search center of excellence
Vector DatabaseHow To

Semantic search as service at a search center of excellence

Learn how to implement and scale semantic search as a service for a search Center of Excellence (COE) using ELSER.

Sherry Ger

Stephen Brown

Data safety in a stateless world
Elastic Cloud Serverless

Data safety in a stateless world

We discuss the data durability guarantees in stateless including how we fence new writes and deletes with a safety check which prevents stale nodes from acknowledging new writes or deletes

Henning Andersen

Stateless — your new state of find with Elasticsearch
ML Research

Stateless — your new state of find with Elasticsearch

Learn about Elasticsearch stateless and explore the stateless architecture, which brings performance improvements and reduces costs.

Leaf Lin

Tim Brooks

Quin Hoxie

Improving text expansion performance using token pruning
Vector DatabaseHow To

Improving text expansion performance using token pruning

Learn about token pruning and how it boosts the performance of text expansion queries by making them more efficient without sacrificing recall.

Kathleen DeRusso

Vector search in Elasticsearch: The rationale behind the design
Vector DatabaseML Research

Vector search in Elasticsearch: The rationale behind the design

In this blog, you'll learn how vector search has been integrated into Elasticsearch and the trade-offs that we made.

Adrien Grand

Looking back: A timeline of vector search innovations
Vector DatabaseSearch Relevance

Looking back: A timeline of vector search innovations

Looking back at Elastic's vector search innovations in Elasticsearch and Lucene

Kathleen DeRusso

Benjamin Trent

What happened in Lucene land in 2023?
Lucene

What happened in Lucene land in 2023?

2023 has been another big year for Apache Lucene, this blog reviews major milestones of 2023

Adrien Grand

Generative AI architectures with transformers explained from the ground up
ML ResearchGenerative AI

Generative AI architectures with transformers explained from the ground up

Here's how generative AI works from the ground up, including embeddings, transformer-encoder architecture, training/fine-tuning models & more.

Aris Papadopoulos

Using hybrid search for gopher hunting with Elasticsearch and Go
How ToVector Database

Using hybrid search for gopher hunting with Elasticsearch and Go

Learn how to achieve hybrid search by combining keyword and vector search using Elasticsearch and the Elasticsearch Go client.

Carly Richmond

Laurent Saint-Félix

Perform text queries with the Elasticsearch Go client
How To

Perform text queries with the Elasticsearch Go client

Learn how to perform traditional text queries in Elasticsearch using the Elasticsearch Go client through a practical example.

Carly Richmond

Laurent Saint-Félix

Perform vector search in Elasticsearch with the Elasticsearch Go client
How ToVector Database

Perform vector search in Elasticsearch with the Elasticsearch Go client

Learn how to perform vector search in Elasticsearch using the Elasticsearch Go client through a practical example.

Carly Richmond

Laurent Saint-Félix