Class ThaiTokenizer

Tokenizer that use ICU4N.Text.BreakIterator to tokenize Thai text.

Inheritance
System.Object
AttributeSource
TokenStream
Tokenizer
SegmentingTokenizerBase
ThaiTokenizer
Implements
System.IDisposable
Inherited Members
System.Object.Equals(System.Object, System.Object)
System.Object.GetType()
System.Object.MemberwiseClone()
System.Object.ReferenceEquals(System.Object, System.Object)
Namespace: Lucene.Net.Analysis.Th
Assembly: Lucene.Net.ICU.dll
Syntax
public class ThaiTokenizer : SegmentingTokenizerBase, IDisposable

Constructors

| Improve this Doc View Source

ThaiTokenizer(AttributeSource.AttributeFactory, TextReader)

Creates a new ThaiTokenizer, supplying the AttributeSource.AttributeFactory

Declaration
public ThaiTokenizer(AttributeSource.AttributeFactory factory, TextReader reader)
Parameters
Type Name Description
AttributeSource.AttributeFactory factory
System.IO.TextReader reader
| Improve this Doc View Source

ThaiTokenizer(TextReader)

Creates a new ThaiTokenizer

Declaration
public ThaiTokenizer(TextReader reader)
Parameters
Type Name Description
System.IO.TextReader reader

Methods

| Improve this Doc View Source

IncrementWord()

Declaration
protected override bool IncrementWord()
Returns
Type Description
System.Boolean
Overrides
| Improve this Doc View Source

SetNextSentence(Int32, Int32)

Declaration
protected override void SetNextSentence(int sentenceStart, int sentenceEnd)
Parameters
Type Name Description
System.Int32 sentenceStart
System.Int32 sentenceEnd
Overrides

Implements

System.IDisposable