Inference connector and action

The inference connector uses the Elasticsearch client to send requests to an inference service. The connector uses the run connector API to send the request.

You can create connectors in Stack Management > Connectors. For example:

Inference connectors have the following configuration properties:

You can test connectors using the run connector API or while creating or editing the connector in Kibana. For example:

The inference actions have the following configuration properties. Properties depend on the selected task type.

The following example performs a completion task on the example question. Input:: The text on which you want to perform the inference task. For example:

+

{
  input: 'What is Elastic?'
}

The following example performs a text embedding task. Input:: The text on which you want to perform the inference task. For example:

+

{
  input: 'The sky above the port was the color of television tuned to a dead channel.',
  task_settings: {
    input_type: 'ingest'
  }
}

The following example performs a reranking task on the example input. Input:: The text on which you want to perform the inference task. Should be a string array. For example:

+

{
  input: ['luke', 'like', 'leia', 'chewy', 'r2d2', 'star', 'wars'],
  query: 'star wars main character'
}

The following example performs a sparse embedding task on the example sentence. Input:: The text on which you want to perform the inference task. For example:

+

{
  input: 'The sky above the port was the color of television tuned to a dead channel.'
}

Use the Action configuration settings to customize connector networking configurations, such as proxies, certificates, or TLS settings. You can apply these settings to all your connectors or use xpack.actions.customHostSettings to set per-host configurations.