This functionality is experimental and may be changed or removed completely in a future release. Elastic will take a best effort approach to fix any issues, but experimental features are not subject to the support SLA of official GA features.

› › ›

Decode CSV fields

edit

Decode CSV fields

edit

This functionality is in technical preview and may be changed or removed in a future release. Elastic will work to fix any issues, but features in technical preview are not subject to the support SLA of official GA features.

The decode_csv_fields processor decodes fields containing records in comma-separated format (CSV). It will output the values as an array of strings. This processor is available for Filebeat and Journalbeat.

processors:
 - decode_csv_fields:
     fields:
        message: decoded.csv
     separator: ,
     ignore_missing: false
     overwrite_keys: true
     trim_leading_whitespace: false
     fail_on_error: true

The decode_csv_fields has the following settings:

fields: This is a mapping from the source field containing the CSV data to the destination field to which the decoded array will be written.
separator: (Optional) Character to be used as a column separator. The default is the comma character. For using a TAB character you must set it to "\t".
ignore_missing: (Optional) Whether to ignore events which lack the source field. The default is false, which will fail processing of an event if a field is missing.
overwrite_keys: Whether the target field is overwritten if it already exists. The default is false, which will fail processing of an event when target already exists.
trim_leading_space: Whether extra space after the separator is trimmed from values. This works even if the separator is also a space. The default is false.
fail_on_error: (Optional) If set to true, in case of an error the changes to the event are reverted, and the original event is returned. If set to false, processing continues also if an error happens. Default is true.

« Add tags Decode JSON fields »