IMPORTANT: No additional bug fixes or documentation updates will be released for this version. For the latest information, see the current release documentation.
« ASCII Folding Token Filter Length Token Filter »
Elastic Docs ›Elasticsearch Guide [5.3] ›Analysis ›Token Filters

Flatten Graph Token Filter

edit

Flatten Graph Token Filter

edit

This functionality is in technical preview and may be changed or removed in a future release. Elastic will work to fix any issues, but features in technical preview are not subject to the support SLA of official GA features.

The flatten_graph token filter accepts an arbitrary graph token stream, such as that produced by Synonym Graph Token Filter, and flattens it into a single linear chain of tokens suitable for indexing.

This is a lossy process, as separate side paths are squashed on top of one another, but it is necessary if you use a graph token stream during indexing because a Lucene index cannot currently represent a graph. For this reason, it’s best to apply graph analyzers only at search time because that preserves the full graph structure and gives correct matches for proximity queries.

For more information on this topic and its various complexities, please read the Lucene’s TokenStreams are actually graphs blog post.

« ASCII Folding Token Filter Length Token Filter »