---
title: Elastic Inference Service supported models
description: Identify the models that are supported by Elastic Inference Service (EIS).
url: https://www.elastic.co/docs/explore-analyze/elastic-inference/eis-supported-models
products:
  - Elastic Cloud Enterprise
  - Elastic Cloud on Kubernetes
  - Elastic Stack
applies_to:
  - Elastic Cloud Serverless: Generally available
  - Elastic Stack: Generally available
---

# Elastic Inference Service supported models
The following tables list the models supported by Elastic Inference Service by model type.
The corresponding Kibana connectors and inference endpoints for these models are created automatically. To customize the configuration, you can create [your own connectors](https://www.elastic.co/docs/reference/kibana/connectors-kibana#creating-new-connector) or [inference endpoints](https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-inference-put).
<note>
  The **Inference Regions** column shows the regions where inference requests are processed and where data is sent.
</note>


### LLM chat models

**Scroll horizontally to view more information.**

| Author    | Name                  | ID                           | Model Card                                                                                                                | Provider Terms                                                                                                                                                                                                          | Input Modalities  | Output Modalities | EOL Date   | Data Retention Period (Days) | Data Used To Train Models? | Inference Regions | Release Status      | Stack Version |
|-----------|-----------------------|------------------------------|---------------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|-------------------|-------------------|------------|------------------------------|----------------------------|-------------------|---------------------|---------------|
| Anthropic | Claude Haiku 4.5      | anthropic-claude-4.5-haiku   | [Claude Haiku 4.5 System Card](https://www-cdn.anthropic.com/7aad69bf12627d42234e01ee7c36305dc2f6a970.pdf)                | [Google Terms](https://cloud.google.com/terms)<br>[AWS Terms](https://aws.amazon.com/service-terms/)                                                                                                                    | Text, Image, File | Text              |            | 0                            | No                         | US                | Generally Available | 9.3           |
| Anthropic | Claude Opus 4.5       | anthropic-claude-4.5-opus    | [Claude Opus 4.5 System Card](https://www-cdn.anthropic.com/bf10f64990cfda0ba858290be7b8cc6317685f47.pdf)                 | [Google Terms](https://cloud.google.com/terms)<br>[AWS Terms](https://aws.amazon.com/service-terms/)                                                                                                                    | Text, Image, File | Text              | 2026-11-24 | 0                            | No                         | US                | Legacy (EOL Soon)   | 9.3           |
| Anthropic | Claude Opus 4.6       | anthropic-claude-4.6-opus    | [Claude Opus 4.6 System Card](https://www-cdn.anthropic.com/14e4fb01875d2a69f646fa5e574dea2b1c0ff7b5.pdf)                 | [Google Terms](https://cloud.google.com/terms)<br>[AWS Terms](https://aws.amazon.com/service-terms/)                                                                                                                    | Text, Image, File | Text              | 2027-02-05 | 0                            | No                         | US                | Generally Available | 9.3           |
| Anthropic | Claude Opus 4.7       | anthropic-claude-4.7-opus    | [Anthropic Claude Opus 4.7](https://cdn.sanity.io/files/4zrzovbb/website/037f06850df7fbe871e206dad004c3db5fd50340.pdf)    | [Google Terms](https://cloud.google.com/terms)<br>[AWS Terms](https://aws.amazon.com/service-terms/)                                                                                                                    | Text, Image, File | Text              |            | 0                            | No                         | US                | Generally Available | 9.4           |
| Anthropic | Claude Sonnet 4.5     | anthropic-claude-4.5-sonnet  | [Anthropic Claude 4.5 Sonnet](https://assets.anthropic.com/m/12f214efcc2f457a/original/Claude-Sonnet-4-5-System-Card.pdf) | [AWS terms](https://aws.amazon.com/service-terms/)                                                                                                                                                                      | Text, Image, File | Text              | 2026-09-29 | 0                            | No                         | US                | Legacy (EOL Soon)   | 9.2           |
| Anthropic | Claude Sonnet 4.6     | anthropic-claude-4.6-sonnet  | [Claude Sonnet 4.6 System Card](https://www-cdn.anthropic.com/bbd8ef16d70b7a1665f14f306ee88b53f686aa75.pdf)               | [Google Terms](https://cloud.google.com/terms)<br>[AWS Terms](https://aws.amazon.com/service-terms/)                                                                                                                    | Text, Image, File | Text              |            | 0                            | No                         | US, SG            | Generally Available | 9.3           |
| Google    | Gemini 2.5 Flash      | google-gemini-2.5-flash      | [Google Gemini 2.5 Flash](https://modelcards.withgoogle.com/assets/documents/gemini-2-flash.pdf)                          | [Google terms](https://cloud.google.com/terms)                                                                                                                                                                          | Text, Image, File | Text              | 2026-06-17 | 0                            | No                         | US                | Legacy (EOL Soon)   | 9.3           |
| Google    | Gemini 2.5 Flash Lite | google-gemini-2.5-flash-lite | [Gemini 2.5 Flash Lite](https://docs.cloud.google.com/vertex-ai/generative-ai/docs/models/gemini/2-5-flash-lite)          | [Google terms](https://cloud.google.com/terms)                                                                                                                                                                          | Text, Image, File | Text              |            | 0                            | No                         | US                | Generally Available | 9.4           |
| Google    | Gemini 2.5 Pro        | google-gemini-2.5-pro        | [Google Gemini 2.5 Pro](https://modelcards.withgoogle.com/assets/documents/gemini-2.5-pro.pdf)                            | [Google terms](https://cloud.google.com/terms)                                                                                                                                                                          | Text, Image, File | Text              | 2026-06-17 | 0                            | No                         | US                | Legacy (EOL Soon)   | 9.3           |
| Google    | Gemini 3 Flash        | google-gemini-3-flash        | [Gemini 3 Flash](https://storage.googleapis.com/deepmind-media/Model-Cards/Gemini-3-Flash-Model-Card.pdf)                 | [Google terms](https://cloud.google.com/terms)                                                                                                                                                                          | Text, Image, File | Text              |            | 0                            | No                         | US                | Tech Preview        | 9.4           |
| Google    | Gemini 3.1 Pro        | google-gemini-3.1-pro        | [Gemini 3.1 Pro](https://deepmind.google/models/model-cards/gemini-3-1-pro/)                                              | [Google terms](https://cloud.google.com/terms)                                                                                                                                                                          | Text, Image, File | Text              |            | 0                            | No                         | US                | Tech Preview        | 9.4           |
| OpenAI    | GPT-4.1               | openai-gpt-4.1               | [OpenAI GPT 4.1](https://platform.openai.com/docs/models/gpt-4.1)                                                         | [Microsoft Terms](https://azure.microsoft.com/en-gb/support/legal/)                                                                                                                                                     | Text, Image, File | Text              | 2026-07-01 | 0                            | No                         | US                | Legacy (EOL Soon)   | 9.3           |
| OpenAI    | GPT-4.1 Mini          | openai-gpt-4.1-mini          | [OpenAI GPT 4.1 Mini](https://platform.openai.com/docs/models/gpt-4.1-mini)                                               | [Microsoft Terms](https://azure.microsoft.com/en-gb/support/legal/)                                                                                                                                                     | Text, Image, File | Text              | 2026-07-01 | 0                            | No                         | US                | Legacy (EOL Soon)   | 9.3           |
| OpenAI    | GPT-5.2               | openai-gpt-5.2               | [OpenAI GPT 5.2](https://platform.openai.com/docs/models/gpt-5.2)                                                         | [Microsoft Terms](https://azure.microsoft.com/en-gb/support/legal/)                                                                                                                                                     | Text, Image, File | Text              | 2027-05-12 | 0                            | No                         | US                | Generally Available | 9.3           |
| OpenAI    | GPT-5.4               | openai-gpt-5.4               | [OpenAI GPT 5.4](https://openai.com/index/gpt-5-4-thinking-system-card/)                                                  | [Microsoft Terms](https://azure.microsoft.com/en-gb/support/legal/)                                                                                                                                                     | Text, Image, File | Text              |            | 0                            | No                         | US                | Generally Available | 9.4           |
| OpenAI    | GPT-5.4 Mini          | openai-gpt-5.4-mini          | [OpenAI GPT 5.4 Mini](https://developers.openai.com/api/docs/models/gpt-5.4-mini)                                         | [Microsoft Terms](https://azure.microsoft.com/en-gb/support/legal/)                                                                                                                                                     | Text, Image, File | Text              |            | 0                            | No                         | US                | Generally Available | 9.4           |
| OpenAI    | GPT-5.4 Nano          | openai-gpt-5.4-nano          | [OpenAI GPT 5.4 Nano](https://developers.openai.com/api/docs/models/gpt-5.4-nano)                                         | [Microsoft Terms](https://azure.microsoft.com/en-gb/support/legal/)                                                                                                                                                     | Text, Image, File | Text              |            | 0                            | No                         | US                | Generally Available | 9.4           |
| OpenAI    | GPT-OSS 120B          | openai-gpt-oss-120b          | [OpenAI GPT-OSS-120B](http://gpt-oss-120b/)                                                                               | [Google Terms](https://cloud.google.com/terms)<br>[Together AI Terms](https://www.together.ai/terms-of-service)<br>[DeepInfra Terms](https://deepinfra.com/terms)<br>[AWS Terms](https://aws.amazon.com/service-terms/) | Text              | Text              |            | 0                            | No                         | US                | Generally Available | 9.3           |
| OpenAI    | GPT-OSS 20B           | openai-gpt-oss-20b           | [OpenAI GPT-OSS-20B](https://platform.openai.com/docs/models/gpt-oss-20b)                                                 | Together terms <br>DeepInfra terms<br>Groq terms                                                                                                                                                                        | Text              | Text              |            | 0                            | No                         | US                | Generally Available | 9.4           |


### Embedding models

**Scroll horizontally to view more information.**

| Author    | Name                     | ID                              | Model Card                                                                                   | Provider Terms                                                      | Input Modalities                | Output Modalities | EOL Date | Data Retention Period (Days) | Data Used To Train Models? | Inference Regions | Release Status      | Stack Version |
|-----------|--------------------------|---------------------------------|----------------------------------------------------------------------------------------------|---------------------------------------------------------------------|---------------------------------|-------------------|----------|------------------------------|----------------------------|-------------------|---------------------|---------------|
| Jina      | CLIP v2                  | jina-clip-v2                    | [jina-clip-v2](https://jina.ai/models/jina-clip-v2/)                                         | [Elastic Terms](https://www.elastic.co/legal/terms-of-use)          | Text, Image                     | Embedding         |          | 0                            | No                         | US, SG, EU        | Generally Available | 9.3           |
| Elastic   | ELSER v2                 | elser_model_2                   | [ELSER docs](https://www.elastic.co/docs/explore-analyze/machine-learning/nlp/ml-nlp-elser)  | [Elastic Terms](https://www.elastic.co/legal/terms-of-use)          | Text                            | Embedding         |          | 0                            | No                         | US, SG, EU        | Generally Available | 9.1           |
| Jina      | Embeddings v3            | jina-embeddings-v3              | [jina-embeddings-v3](https://jina.ai/models/jina-embeddings-v3/)                             | [Elastic Terms](https://www.elastic.co/legal/terms-of-use)          | Text                            | Embedding         |          | 0                            | No                         | US, SG, EU        | Generally Available | 9.3           |
| Jina      | Embeddings v5 Omni Nano  | jina-embeddings-v5-omni-nano    | [jina-embeddings-v5-omni-nano](https://jina.ai/models/jina-embeddings-v5-omni-nano/)         | [Elastic Terms](https://www.elastic.co/legal/terms-of-use)          | Text, Image, Video, Audio, File | Embedding         |          | 0                            | No                         | US, SG, EU        | Generally Available | 9.4           |
| Jina      | Embeddings v5 Omni Small | jina-embeddings-v5-omni-small   | [jina-embeddings-v5-omni-small](https://jina.ai/models/jina-embeddings-v5-omni-small/)       | [Elastic Terms](https://www.elastic.co/legal/terms-of-use)          | Text, Image, Video, Audio, File | Embedding         |          | 0                            | No                         | US, SG, EU        | Generally Available | 9.4           |
| Jina      | Embeddings v5 Text Nano  | jina-embeddings-v5-text-nano    | [jina-embeddings-v5-text-nano](https://huggingface.co/jinaai/jina-embeddings-v5-text-nano)   | [Elastic Terms](https://www.elastic.co/legal/terms-of-use)          | Text                            | Embedding         |          | 0                            | No                         | US, SG, EU        | Generally Available | 9.3           |
| Jina      | Embeddings v5 Text Small | jina-embeddings-v5-text-small   | [jina-embeddings-v5-text-small](https://huggingface.co/jinaai/jina-embeddings-v5-text-small) | [Elastic Terms](https://www.elastic.co/legal/terms-of-use)          | Text                            | Embedding         |          | 0                            | No                         | US, SG, EU        | Generally Available | 9.3           |
| Google    | Gemini Embedding 1       | google-gemini-embedding-001     | [Gemini Embedding 001](https://deepmind.google/research/publications/157741/)                | [Google terms](https://cloud.google.com/terms)                      | Text                            | Embedding         |          | 55 days                      | No                         | US                | Generally Available | 9.3           |
| Microsoft | Multilingual E5 Large    | microsoft-multilingual-e5-large | [Multilingual E5 Large System Card](https://huggingface.co/intfloat/e5-large-v2)             | DeepInfra terms                                                     | Text                            | Embedding         |          | 0                            | No                         | US                | Generally Available | 9.3           |
| OpenAI    | Text Embedding 003 Large | openai-text-embedding-3-large   | [Text Embedding 003 Large](https://platform.openai.com/docs/models/text-embedding-3-large)   | [OpenAI terms](https://openai.com/en-GB/policies/row-terms-of-use/) | Text                            | Text              |          | Unknown                      | No                         | US                | Generally Available | 9.3           |
| OpenAI    | Text Embedding 003 Small | openai-text-embedding-3-small   | [Text Embedding 003 Small](https://platform.openai.com/docs/models/text-embedding-3-small)   | [OpenAI terms](https://openai.com/en-GB/policies/row-terms-of-use/) | Text                            | Text              |          | Unknown                      | No                         | US                | Generally Available | 9.3           |


### Rerankers

**Scroll horizontally to view more information.**

| Author | Name        | ID                                 | Model Card                                                                                       | Provider Terms                                             | Input Modalities | Output Modalities | EOL Date | Data Retention Period (Days) | Data Used To Train Models? | Inference Regions | Release Status      | Stack Version |
|--------|-------------|------------------------------------|--------------------------------------------------------------------------------------------------|------------------------------------------------------------|------------------|-------------------|----------|------------------------------|----------------------------|-------------------|---------------------|---------------|
| Jina   | Reranker v2 | jina-reranker-v2-base-multilingual | [jina-reranker-v2-base-multilingual](https://jina.ai/models/jina-reranker-v2-base-multilingual/) | [Elastic Terms](https://www.elastic.co/legal/terms-of-use) | Text             | Text              |          | 0                            | No                         | US, SG, EU        | Generally Available | 9.3           |
| Jina   | Reranker v3 | jina-reranker-v3                   | [jina-reranker-v3](https://jina.ai/models/jina-reranker-v3/)                                     | [Elastic Terms](https://www.elastic.co/legal/terms-of-use) | Text             | Text              |          | 0                            | No                         | US, SG, EU        | Generally Available | 9.3           |

<important>
  - The applicable terms of use, uptime, and performance for each of the AI models available with EIS are each described in the applicable AI model's Provider Terms and Model Card.
  - Prior to using the AI model with EIS, Customers are responsible for reviewing and agreeing to the chosen AI model's Provider Terms to understand the availability and data practices of the AI model's provider.
  - After the listed end-of-life (EOL) date, the model is no longer available for inference use and requests will fail. You need to actively transition to another model before the EOL date, there is no automated migration.
  - Elastic makes every effort to use third party providers who do not use inputs to train models, and do not retain any data (zero data retention). Browse the tables on this page to double-check the status of a specific model.
</important>


## Region and hosting

Elastic Inference Service is currently available in these regions:
**AWS:**
- `us-east-1` (Virginia)

**GCP:**
- `asia-southeast1` (Singapore)
- `europe-west1` (Belgium)
- `us-east4` (Virginia)

All inference requests sent through EIS are routed to the nearest region, regardless of where your Elasticsearch deployment or Serverless project is hosted.
Depending on the model being used, request processing may involve Elastic inference infrastructure and, in some cases, trusted third-party model providers. For example, ELSER and Jina requests are processed entirely within Elastic inference infrastructure. Other models, such as large language models or third-party embedding models, may involve additional processing by their respective model providers, which can operate in different cloud platforms or regions.

## Rate limits

The service enforces rate limits on an ongoing basis. Exceeding a limit results in HTTP 429 responses from the server until the sliding window moves on further and parts of the limit resets.

| Model                                                                                            | Request/minute | Tokens/minute (ingest) | Tokens/minute (search) | Notes                                                                                                   |
|--------------------------------------------------------------------------------------------------|----------------|------------------------|------------------------|---------------------------------------------------------------------------------------------------------|
| Elastic Managed LLMs <applies-to>Elastic Stack: Generally available since 9.3</applies-to>       | 2000           | -                      | -                      | No rate limit on tokens                                                                                 |
| ELSER <applies-to>Elastic Stack: Generally available since 9.0</applies-to>                      | 6,000          | 6,000,000              | 600,000                | Limits are applied to both requests per minute and tokens per minute, whichever limit is reached first. |
| Jina Embeddings v5 Nano <applies-to>Elastic Stack: Generally available since 9.3</applies-to>    | 6,000          | 6,000,000              | 600,000                | Limits are applied to both requests per minute and tokens per minute, whichever limit is reached first. |
| Jina Embeddings v5 Small <applies-to>Elastic Stack: Generally available since 9.3</applies-to>   | 6,000          | 6,000,000              | 600,000                | Limits are applied to both requests per minute and tokens per minute, whichever limit is reached first. |
| Jina Embeddings v3 <applies-to>Elastic Stack: Generally available since 9.3</applies-to>         | 6,000          | 6,000,000              | 600,000                | Limits are applied to both requests per minute and tokens per minute, whichever limit is reached first. |
| Jina Embeddings v5 (Small) <applies-to>Elastic Stack: Generally available since 9.3</applies-to> | 6,000          | 6,000,000              | 600,000                | Limits are applied to both requests per minute and tokens per minute, whichever limit is reached first. |
| Jina Embeddings v5 (Nano) <applies-to>Elastic Stack: Generally available since 9.3</applies-to>  | 6,000          | 6,000,000              | 600,000                | Limits are applied to both requests per minute and tokens per minute, whichever limit is reached first. |
| Jina Reranker v2 <applies-to>Elastic Stack: Generally available since 9.3</applies-to>           | 600            | -                      | 6,000,000              | Limits are applied to both requests per minute and tokens per minute, whichever limit is reached first. |
| Jina Reranker v3 <applies-to>Elastic Stack: Generally available since 9.3</applies-to>           | 600            | -                      | 6,000,000              | Limits are applied to both requests per minute and tokens per minute, whichever limit is reached first. |


## Pricing

All models on EIS incur a charge per million tokens. Certain LLM providers charge different prices depending on the prompt size. The pricing details are available on our [Pricing page](https://www.elastic.co/pricing/serverless-search).
This pricing model differs from the existing [Machine Learning Nodes](https://www.elastic.co/docs/explore-analyze/machine-learning/data-frame-analytics/ml-trained-models), which is billed through VCUs consumed.

### Token-based billing

EIS is billed per million tokens used:
- For **chat** models, input and output tokens are billed. Longer conversations with extensive context or detailed responses will consume more tokens.
- For **embeddings** models, only input tokens are billed.

Tokens are the fundamental units that language models process for both input and output. Tokenizers convert text into numerical data by segmenting it into subword units. A token can be a complete word, part of a word, or a punctuation mark, depending on the model's trained tokenizer and the frequency patterns in its training data.
For example, the sentence `It was the best of times, it was the worst of times.` contains 52 characters but would tokenize into approximately 14 tokens with a typical word-based approach, though the exact count varies by tokenizer.

### Monitor your token usage

To track your token consumption:
1. Navigate to [**Billing > Usage**](https://cloud.elastic.co/billing/usage) in the Elastic Cloud Console.
2. Look for line items where the **Billing dimension** is set to "Inference".