In this section you will install, configure and run the Search Labs 

Before you begin, you should set up an Elasticsearch instance that you can use with this project. The easiest and most convenient path is to create a Elastic Cloud account, which includes a free trial period. But you can also opt to run Elasticsearch locally if that works better for you. See the 

 section for installation instructions covering these two options.

The next step is for you to download the source code for the chatbot application. The following sub-sections describe a few ways you can do this. You can find the method that works best for you.

The Chatbot example is included in the Search Labs source code repository. You can clone this repository with the following command:

On macOS or Linux, you can download a tarball of the Search Labs source code repository, and then extract this application from it. The command to do this is:

If you are more comfortable working with zip files, you can download the Search Labs repository 

Once you have the zip file, use your favorite unzip tool to extract the 

elasticsearch-labs-main/example-apps/chatbot-rag-app

Project Setup

Running the Chatbot RAG Example

Chatbots built with RAG can overcome some of the limitations that general-purpose conversational models such as ChatGPT have. In particular, they are able to discuss and answer questions about:

Information that is private to your organization.

Events that were not part of the training dataset, or that took place after the LLM finished training.

As an additional benefit, RAG helps to "ground" LLMs with facts, making them less likely to make up a response or "hallucinate".

The secret to achieve this is to use a two-step process to obtain an answer from the LLM:

, one or more data sources are searched for the user's query,. The relevant documents that are found in this search are retrieved. Using an 

 index for this is a great option for this, enabling you to choose between keyword, dense and sparse vector search methods, or even a hybrid combination of them.

, the user's prompt is expanded to include the documents retrieved in the first phase, with added instructions to the LLM to find the answer to the user's question in the retrieved information. The expanded prompt, including the added context for the question, is what is sent to the LLM in place of the original query.

This tutorial is structured in two main parts.

In the first part, you will learn how to run the 

 example, a complete application featuring a Python back end and a React front end.

Once you have the example application up and running, the second part of this tutorial explains the different components of the RAG implementation, to allow you to adapt the example code to your own needs.

Welcome

To follow this tutorial you will need to install the following components:

An installation of Elasticsearch, based on our hosted 

 service (which includes a free trial period), or a self-hosted service that you run on your own computer. See the 

 section above for installation instructions.

An API Key for OpenAI. You can actually use any other LLM that you favor, as long as it is supported by the 

 interpreter. Make sure it is a recent version, such as Python 3.8 or newer.

This tutorial focuses on RAG topics. To be able to modify the example application you will need basic knowledge of the following technologies:

Requirements

Python Back End

React Front End

Getting Started

Ingest

Chatbot Endpoint

Retrieval Phase

LLM Prompt

Generation Phase

Chat History

Chat History and Follow-Up Questions

This section of the tutorial discusses the most interesting aspects of the chatbot implementation, to help you understand it and customize it.

Implementation

Chatbot Implementation

You have reached the end of the Chatbot Tutorial. Congratulations!

We hope you now are familiar with the basic components of a chatbot project and the ideas behind 

You are encouraged to take our example application, experiment with it, and make it your own.

Running the Chatbot RAG Example

Run Elasticsearch

Clone the Search Labs Repository

Download a Tarball

Download a Zip File

Ready to build state of the art search experiences?