Avro codec plugin
editAvro codec plugin
edit- Plugin version: v3.2.4
- Released on: 2020-08-21
- Changelog
For other versions, see the Versioned plugin docs.
Getting Help
editFor questions about the plugin, open a topic in the Discuss forums. For bugs or feature requests, open an issue in Github. For the list of Elastic supported plugins, please consult the Elastic Support Matrix.
Description
editRead serialized Avro records as Logstash events
This plugin is used to serialize Logstash events as Avro datums, as well as deserializing Avro datums into Logstash events.
Encoding
editThis codec is for serializing individual Logstash events as Avro datums that are Avro binary blobs. It does not encode Logstash events into an Avro file.
Decoding
editThis codec is for deserializing individual Avro records. It is not for reading Avro files. Avro files have a unique format that must be handled upon input.
Partial deserialization
Avro format is known to support partial deserialization of arbitrary fields,
providing a schema containing a subset of the schema which was used to serialize
the data.
This codec doesn’t support partial deserialization of arbitrary fields.
Partial deserialization might work only when providing a schema which contains
the first N
fields of the schema used to serialize the data (and
in the same order).
Usage
editExample usage with Kafka input.
input { kafka { codec => avro { schema_uri => "/tmp/schema.avsc" } } } filter { ... } output { ... }
Avro Codec Configuration Options
editSetting | Input type | Required |
---|---|---|
Yes |
||
No |