CSV processor
editCSV processor
editExtracts fields from CSV line out of a single text field within a document. Any empty field in CSV will be skipped.
Table 10. CSV Options
Name | Required | Default | Description |
---|---|---|---|
|
yes |
- |
The field to extract data from |
|
yes |
- |
The array of fields to assign extracted values to |
|
no |
, |
Separator used in CSV, has to be single character string |
|
no |
" |
Quote used in CSV, has to be single character string |
|
no |
|
If |
|
no |
|
Trim whitespaces in unquoted fields |
|
no |
- |
Value used to fill empty fields, empty fields will be skipped if this is not provided.
Empty field is one with no value (2 consecutive separators) or empty quotes ( |
|
no |
- |
Description of the processor. Useful for describing the purpose of the processor or its configuration. |
|
no |
- |
Conditionally execute the processor. See Conditionally run a processor. |
|
no |
|
Ignore failures for the processor. See Handling pipeline failures. |
|
no |
- |
Handle failures for the processor. See Handling pipeline failures. |
|
no |
- |
Identifier for the processor. Useful for debugging and metrics. |
{ "csv": { "field": "my_field", "target_fields": ["field1", "field2"] } }
If the trim
option is enabled then any whitespace in the beginning and in the end of each unquoted field will be trimmed.
For example with configuration above, a value of A, B
will result in field field2
having value {nbsp}B
(with space at the beginning). If trim
is enabled A, B
will result in field field2
having value B
(no whitespace). Quoted fields will be left untouched.