Show / Hide Table of Contents

    Enum JapaneseTokenizerType

    Token type reflecting the original source of this token

    Namespace: Lucene.Net.Analysis.Ja
    Assembly: Lucene.Net.Analysis.Kuromoji.dll
    Syntax
    public enum JapaneseTokenizerType : int

    Fields

    Name Description
    KNOWN

    Known words from the system dictionary.

    UNKNOWN

    Unknown words (heuristically segmented).

    USER

    Known words from the user dictionary.

    • Improve this Doc
    • View Source
    Back to top Copyright © 2020 Licensed to the Apache Software Foundation (ASF)