Show / Hide Table of Contents

    Class IndicTokenizer

    Simple Tokenizer for text in Indian Languages.

    Inheritance
    System.Object
    AttributeSource
    TokenStream
    Tokenizer
    CharTokenizer
    IndicTokenizer
    Implements
    IDisposable
    Inherited Members
    CharTokenizer.Normalize(Int32)
    CharTokenizer.IncrementToken()
    CharTokenizer.End()
    CharTokenizer.Reset()
    Tokenizer.m_input
    Tokenizer.Dispose(Boolean)
    Tokenizer.CorrectOffset(Int32)
    Tokenizer.SetReader(TextReader)
    TokenStream.Dispose()
    AttributeSource.GetAttributeFactory()
    AttributeSource.GetAttributeClassesEnumerator()
    AttributeSource.GetAttributeImplsEnumerator()
    AttributeSource.AddAttributeImpl(Attribute)
    AttributeSource.AddAttribute<T>()
    AttributeSource.HasAttributes
    AttributeSource.HasAttribute<T>()
    AttributeSource.GetAttribute<T>()
    AttributeSource.ClearAttributes()
    AttributeSource.CaptureState()
    AttributeSource.RestoreState(AttributeSource.State)
    AttributeSource.GetHashCode()
    AttributeSource.Equals(Object)
    AttributeSource.ReflectAsString(Boolean)
    AttributeSource.ReflectWith(IAttributeReflector)
    AttributeSource.CloneAttributes()
    AttributeSource.CopyTo(AttributeSource)
    AttributeSource.ToString()
    Namespace: Lucene.Net.Analysis.In
    Assembly: Lucene.Net.Analysis.Common.dll
    Syntax
    public sealed class IndicTokenizer : CharTokenizer, IDisposable

    Constructors

    | Improve this Doc View Source

    IndicTokenizer(LuceneVersion, AttributeSource.AttributeFactory, TextReader)

    Declaration
    public IndicTokenizer(LuceneVersion matchVersion, AttributeSource.AttributeFactory factory, TextReader input)
    Parameters
    Type Name Description
    LuceneVersion matchVersion
    AttributeSource.AttributeFactory factory
    TextReader input
    | Improve this Doc View Source

    IndicTokenizer(LuceneVersion, TextReader)

    Declaration
    public IndicTokenizer(LuceneVersion matchVersion, TextReader input)
    Parameters
    Type Name Description
    LuceneVersion matchVersion
    TextReader input

    Methods

    | Improve this Doc View Source

    IsTokenChar(Int32)

    Declaration
    protected override bool IsTokenChar(int c)
    Parameters
    Type Name Description
    System.Int32 c
    Returns
    Type Description
    System.Boolean
    Overrides
    CharTokenizer.IsTokenChar(Int32)

    Implements

    IDisposable
    • Improve this Doc
    • View Source
    Back to top Copyright © 2020 Licensed to the Apache Software Foundation (ASF)