Class IndicTokenizer

Simple Tokenizer for text in Indian Languages.

Inheritance
System.Object
AttributeSource
TokenStream
Tokenizer
CharTokenizer
IndicTokenizer
Implements
System.IDisposable
Inherited Members
System.Object.Equals(System.Object, System.Object)
System.Object.GetType()
System.Object.MemberwiseClone()
System.Object.ReferenceEquals(System.Object, System.Object)
Namespace: Lucene.Net.Analysis.In
Assembly: Lucene.Net.Analysis.Common.dll
Syntax
[Obsolete("(3.6) Use StandardTokenizer instead.")]
public sealed class IndicTokenizer : CharTokenizer, IDisposable

Constructors

| Improve this Doc View Source

IndicTokenizer(LuceneVersion, AttributeSource.AttributeFactory, TextReader)

Declaration
public IndicTokenizer(LuceneVersion matchVersion, AttributeSource.AttributeFactory factory, TextReader input)
Parameters
Type Name Description
LuceneVersion matchVersion
AttributeSource.AttributeFactory factory
System.IO.TextReader input
| Improve this Doc View Source

IndicTokenizer(LuceneVersion, TextReader)

Declaration
public IndicTokenizer(LuceneVersion matchVersion, TextReader input)
Parameters
Type Name Description
LuceneVersion matchVersion
System.IO.TextReader input

Methods

| Improve this Doc View Source

IsTokenChar(Int32)

Declaration
protected override bool IsTokenChar(int c)
Parameters
Type Name Description
System.Int32 c
Returns
Type Description
System.Boolean
Overrides

Implements

System.IDisposable