IMPORTANT: No additional bug fixes or documentation updates
will be released for this version. For the latest information, see the
current release documentation.
Standard Token Filter
editStandard Token Filter
editA token filter of type standard
that normalizes tokens extracted with
the
Standard
Tokenizer.
The standard
token filter currently does nothing. It remains as a placeholder
in case some filtering function needs to be added in a future version.