Fork me on GitHub
  • API

    Show / Hide Table of Contents

    Class IndicTokenizer

    Simple Tokenizer for text in Indian Languages.

    Inheritance
    System.Object
    Lucene.Net.Util.AttributeSource
    Lucene.Net.Analysis.TokenStream
    Lucene.Net.Analysis.Tokenizer
    CharTokenizer
    IndicTokenizer
    Implements
    System.IDisposable
    Inherited Members
    CharTokenizer.Normalize(Int32)
    CharTokenizer.IncrementToken()
    CharTokenizer.End()
    CharTokenizer.Reset()
    Lucene.Net.Analysis.Tokenizer.m_input
    Tokenizer.Dispose(Boolean)
    Tokenizer.CorrectOffset(Int32)
    Tokenizer.SetReader(TextReader)
    Lucene.Net.Analysis.TokenStream.Dispose()
    Lucene.Net.Util.AttributeSource.GetAttributeFactory()
    Lucene.Net.Util.AttributeSource.GetAttributeClassesEnumerator()
    Lucene.Net.Util.AttributeSource.GetAttributeImplsEnumerator()
    Lucene.Net.Util.AttributeSource.AddAttributeImpl(Lucene.Net.Util.Attribute)
    Lucene.Net.Util.AttributeSource.AddAttribute<T>()
    Lucene.Net.Util.AttributeSource.HasAttributes
    Lucene.Net.Util.AttributeSource.HasAttribute<T>()
    Lucene.Net.Util.AttributeSource.GetAttribute<T>()
    Lucene.Net.Util.AttributeSource.ClearAttributes()
    Lucene.Net.Util.AttributeSource.CaptureState()
    Lucene.Net.Util.AttributeSource.RestoreState(Lucene.Net.Util.AttributeSource.State)
    Lucene.Net.Util.AttributeSource.GetHashCode()
    AttributeSource.Equals(Object)
    AttributeSource.ReflectAsString(Boolean)
    Lucene.Net.Util.AttributeSource.ReflectWith(Lucene.Net.Util.IAttributeReflector)
    Lucene.Net.Util.AttributeSource.CloneAttributes()
    Lucene.Net.Util.AttributeSource.CopyTo(Lucene.Net.Util.AttributeSource)
    Lucene.Net.Util.AttributeSource.ToString()
    System.Object.Equals(System.Object, System.Object)
    System.Object.GetType()
    System.Object.MemberwiseClone()
    System.Object.ReferenceEquals(System.Object, System.Object)
    Namespace: Lucene.Net.Analysis.In
    Assembly: Lucene.Net.Analysis.Common.dll
    Syntax
    [Obsolete("(3.6) Use StandardTokenizer instead.")]
    public sealed class IndicTokenizer : CharTokenizer, IDisposable

    Constructors

    | Improve this Doc View Source

    IndicTokenizer(LuceneVersion, AttributeSource.AttributeFactory, TextReader)

    Declaration
    public IndicTokenizer(LuceneVersion matchVersion, AttributeSource.AttributeFactory factory, TextReader input)
    Parameters
    Type Name Description
    Lucene.Net.Util.LuceneVersion matchVersion
    Lucene.Net.Util.AttributeSource.AttributeFactory factory
    System.IO.TextReader input
    | Improve this Doc View Source

    IndicTokenizer(LuceneVersion, TextReader)

    Declaration
    public IndicTokenizer(LuceneVersion matchVersion, TextReader input)
    Parameters
    Type Name Description
    Lucene.Net.Util.LuceneVersion matchVersion
    System.IO.TextReader input

    Methods

    | Improve this Doc View Source

    IsTokenChar(Int32)

    Declaration
    protected override bool IsTokenChar(int c)
    Parameters
    Type Name Description
    System.Int32 c
    Returns
    Type Description
    System.Boolean
    Overrides
    CharTokenizer.IsTokenChar(Int32)

    Implements

    System.IDisposable
    • Improve this Doc
    • View Source
    Back to top Copyright © 2020 The Apache Software Foundation, Licensed under the Apache License, Version 2.0
    Apache Lucene.Net, Lucene.Net, Apache, the Apache feather logo, and the Apache Lucene.Net project logo are trademarks of The Apache Software Foundation.
    All other marks mentioned may be trademarks or registered trademarks of their respective owners.