Enum JapaneseTokenizerType
Token type reflecting the original source of this token
Namespace: Lucene.Net.Analysis.Ja
Assembly: Lucene.Net.Analysis.Kuromoji.dll
Syntax
public enum JapaneseTokenizerType : int
Fields
Name | Description |
---|---|
KNOWN | Known words from the system dictionary. |
UNKNOWN | Unknown words (heuristically segmented). |
USER | Known words from the user dictionary. |