This documentation contains work-in-progress information for future Elastic Stack and Cloud releases. Use the version selector to view supported release docs. It also contains some Elastic Cloud serverless information. Check out our serverless docs for more details.
« Elastic Agent to Logstash to Kafka to Kafka ES Sink to Elasticsearch: Kafka as middleware message queue Elastic air-gapped architectures »
Elastic Docs ›Elastic Ingest Reference Architectures [8.16]

Logstash to Elasticsearch

edit

Logstash to Elasticsearch

edit
Image showing Logstash collecting data and sending to Elasticsearch
Ingest model
Logstash to collect data from sources not currently supported by Elastic Agent and sending the data to Elasticsearch. Note that the data transformation still happens within the Elasticsearch ingest pipeline.
Use when
Elastic Agent doesn’t currently support your data source.
Examples
AWS Kinesis, databases, Kafka

Resources

edit

Before you implement this approach, check to see if an Elastic Agent integration exists and, if so, use it instead:

Info on Logstash and Logstash input and output plugins:

Info on Elasticsearch and ingest pipelines:

« Elastic Agent to Logstash to Kafka to Kafka ES Sink to Elasticsearch: Kafka as middleware message queue Elastic air-gapped architectures »