Smart Chinese analysis plugin
editSmart Chinese analysis plugin
editThe Smart Chinese Analysis plugin integrates Lucene’s Smart Chinese analysis module into elasticsearch.
It provides an analyzer for Chinese or mixed Chinese-English text. This analyzer uses probabilistic knowledge to find the optimal word segmentation for Simplified Chinese text. The text is first broken into sentences, then each sentence is segmented into words.
Installation
editThis plugin can be installed using the plugin manager:
sudo bin/elasticsearch-plugin install analysis-smartcn
The plugin must be installed on every node in the cluster, and each node must be restarted after installation.
You can download this plugin for offline
install from https://artifacts.elastic.co/downloads/elasticsearch-plugins/analysis-smartcn/analysis-smartcn-8.15.5.zip. To verify
the .zip
file, use the
SHA hash or
ASC key.
Removal
editThe plugin can be removed with the following command:
sudo bin/elasticsearch-plugin remove analysis-smartcn
The node must be stopped before removing the plugin.
smartcn
tokenizer and token filter
editThe plugin provides the smartcn
analyzer, smartcn_tokenizer
tokenizer, and
smartcn_stop
token filter which are not configurable.
The smartcn_word
token filter and smartcn_sentence
have been deprecated.