WARNING: Version 1.7 of Elasticsearch has passed its EOL date.

This documentation is no longer being maintained and may be removed. If you are running this version, we strongly advise you to upgrade. For the latest information, see the current release documentation.

« Custom Analyzer Standard Tokenizer »
Elastic Docs ›Elasticsearch Guide [1.7] ›Analysis

Tokenizers

edit

Tokenizers

edit

Tokenizers are used to break a string down into a stream of terms or tokens. A simple tokenizer might split the string up into terms wherever it encounters whitespace or punctuation.

Elasticsearch has a number of built in tokenizers which can be used to build custom analyzers.

« Custom Analyzer Standard Tokenizer »