Show / Hide Table of Contents

    Class ThaiTokenizer

    Tokenizer that use to tokenize Thai text.

    Inheritance
    System.Object
    AttributeSource
    TokenStream
    Tokenizer
    SegmentingTokenizerBase
    ThaiTokenizer
    Implements
    IDisposable
    Inherited Members
    SegmentingTokenizerBase.BUFFERMAX
    SegmentingTokenizerBase.m_buffer
    SegmentingTokenizerBase.m_offset
    SegmentingTokenizerBase.IncrementToken()
    SegmentingTokenizerBase.Reset()
    SegmentingTokenizerBase.End()
    SegmentingTokenizerBase.IsSafeEnd(Char)
    Tokenizer.m_input
    Tokenizer.Dispose(Boolean)
    Tokenizer.CorrectOffset(Int32)
    Tokenizer.SetReader(TextReader)
    TokenStream.Dispose()
    AttributeSource.GetAttributeFactory()
    AttributeSource.GetAttributeClassesEnumerator()
    AttributeSource.GetAttributeImplsEnumerator()
    AttributeSource.AddAttributeImpl(Attribute)
    AttributeSource.AddAttribute<T>()
    AttributeSource.HasAttributes
    AttributeSource.HasAttribute<T>()
    AttributeSource.GetAttribute<T>()
    AttributeSource.ClearAttributes()
    AttributeSource.CaptureState()
    AttributeSource.RestoreState(AttributeSource.State)
    AttributeSource.GetHashCode()
    AttributeSource.Equals(Object)
    AttributeSource.ReflectAsString(Boolean)
    AttributeSource.ReflectWith(IAttributeReflector)
    AttributeSource.CloneAttributes()
    AttributeSource.CopyTo(AttributeSource)
    AttributeSource.ToString()
    Namespace: Lucene.Net.Analysis.Th
    Assembly: Lucene.Net.ICU.dll
    Syntax
    public class ThaiTokenizer : SegmentingTokenizerBase, IDisposable

    Constructors

    | Improve this Doc View Source

    ThaiTokenizer(AttributeSource.AttributeFactory, TextReader)

    Creates a new ThaiTokenizer, supplying the AttributeSource.AttributeFactory

    Declaration
    public ThaiTokenizer(AttributeSource.AttributeFactory factory, TextReader reader)
    Parameters
    Type Name Description
    AttributeSource.AttributeFactory factory
    TextReader reader
    | Improve this Doc View Source

    ThaiTokenizer(TextReader)

    Creates a new ThaiTokenizer

    Declaration
    public ThaiTokenizer(TextReader reader)
    Parameters
    Type Name Description
    TextReader reader

    Methods

    | Improve this Doc View Source

    IncrementWord()

    Declaration
    protected override bool IncrementWord()
    Returns
    Type Description
    System.Boolean
    Overrides
    SegmentingTokenizerBase.IncrementWord()
    | Improve this Doc View Source

    SetNextSentence(Int32, Int32)

    Declaration
    protected override void SetNextSentence(int sentenceStart, int sentenceEnd)
    Parameters
    Type Name Description
    System.Int32 sentenceStart
    System.Int32 sentenceEnd
    Overrides
    SegmentingTokenizerBase.SetNextSentence(Int32, Int32)

    Implements

    IDisposable
    • Improve this Doc
    • View Source
    Back to top Copyright © 2020 Licensed to the Apache Software Foundation (ASF)