New

The executive guide to generative AI

Read more

Thai Tokenizer

edit

A tokenizer of type thai that segments Thai text into words. This tokenizer uses the built-in Thai segmentation algorithm included with Java to divide up Thai text. Text in other languages in general will be treated the same as standard.

Was this helpful?
Feedback