Fork me on GitHub
  • API

    Show / Hide Table of Contents

    Class Lucene43EdgeNGramTokenizer

    Old version of EdgeNGramTokenizer which doesn't handle correctly supplementary characters.

    Inheritance
    System.Object
    Lucene.Net.Util.AttributeSource
    Lucene.Net.Analysis.TokenStream
    Lucene.Net.Analysis.Tokenizer
    Lucene43EdgeNGramTokenizer
    Implements
    System.IDisposable
    Inherited Members
    Lucene.Net.Analysis.Tokenizer.m_input
    Tokenizer.Dispose(Boolean)
    Tokenizer.CorrectOffset(Int32)
    Tokenizer.SetReader(TextReader)
    Lucene.Net.Analysis.TokenStream.Dispose()
    Lucene.Net.Util.AttributeSource.GetAttributeFactory()
    Lucene.Net.Util.AttributeSource.GetAttributeClassesEnumerator()
    Lucene.Net.Util.AttributeSource.GetAttributeImplsEnumerator()
    Lucene.Net.Util.AttributeSource.AddAttributeImpl(Lucene.Net.Util.Attribute)
    Lucene.Net.Util.AttributeSource.AddAttribute<T>()
    Lucene.Net.Util.AttributeSource.HasAttributes
    Lucene.Net.Util.AttributeSource.HasAttribute<T>()
    Lucene.Net.Util.AttributeSource.GetAttribute<T>()
    Lucene.Net.Util.AttributeSource.ClearAttributes()
    Lucene.Net.Util.AttributeSource.CaptureState()
    Lucene.Net.Util.AttributeSource.RestoreState(Lucene.Net.Util.AttributeSource.State)
    Lucene.Net.Util.AttributeSource.GetHashCode()
    AttributeSource.Equals(Object)
    AttributeSource.ReflectAsString(Boolean)
    Lucene.Net.Util.AttributeSource.ReflectWith(Lucene.Net.Util.IAttributeReflector)
    Lucene.Net.Util.AttributeSource.CloneAttributes()
    Lucene.Net.Util.AttributeSource.CopyTo(Lucene.Net.Util.AttributeSource)
    Lucene.Net.Util.AttributeSource.ToString()
    System.Object.Equals(System.Object, System.Object)
    System.Object.GetType()
    System.Object.MemberwiseClone()
    System.Object.ReferenceEquals(System.Object, System.Object)
    Namespace: Lucene.Net.Analysis.NGram
    Assembly: Lucene.Net.Analysis.Common.dll
    Syntax
    [Obsolete]
    public sealed class Lucene43EdgeNGramTokenizer : Tokenizer, IDisposable

    Constructors

    | Improve this Doc View Source

    Lucene43EdgeNGramTokenizer(LuceneVersion, AttributeSource.AttributeFactory, TextReader, Lucene43EdgeNGramTokenizer.Side, Int32, Int32)

    Creates Lucene43EdgeNGramTokenizer that can generate n-grams in the sizes of the given range

    Declaration
    [Obsolete]
    public Lucene43EdgeNGramTokenizer(LuceneVersion version, AttributeSource.AttributeFactory factory, TextReader input, Lucene43EdgeNGramTokenizer.Side side, int minGram, int maxGram)
    Parameters
    Type Name Description
    Lucene.Net.Util.LuceneVersion version

    the Lucene match version - See Lucene.Net.Util.LuceneVersion

    Lucene.Net.Util.AttributeSource.AttributeFactory factory

    Lucene.Net.Util.AttributeSource.AttributeFactory to use

    System.IO.TextReader input

    System.IO.TextReader holding the input to be tokenized

    Lucene43EdgeNGramTokenizer.Side side

    the Lucene43EdgeNGramTokenizer.Side from which to chop off an n-gram

    System.Int32 minGram

    the smallest n-gram to generate

    System.Int32 maxGram

    the largest n-gram to generate

    | Improve this Doc View Source

    Lucene43EdgeNGramTokenizer(LuceneVersion, AttributeSource.AttributeFactory, TextReader, Int32, Int32)

    Creates Lucene43EdgeNGramTokenizer that can generate n-grams in the sizes of the given range

    Declaration
    public Lucene43EdgeNGramTokenizer(LuceneVersion version, AttributeSource.AttributeFactory factory, TextReader input, int minGram, int maxGram)
    Parameters
    Type Name Description
    Lucene.Net.Util.LuceneVersion version

    the Lucene match version - See Lucene.Net.Util.LuceneVersion

    Lucene.Net.Util.AttributeSource.AttributeFactory factory

    Lucene.Net.Util.AttributeSource.AttributeFactory to use

    System.IO.TextReader input

    System.IO.TextReader holding the input to be tokenized

    System.Int32 minGram

    the smallest n-gram to generate

    System.Int32 maxGram

    the largest n-gram to generate

    | Improve this Doc View Source

    Lucene43EdgeNGramTokenizer(LuceneVersion, AttributeSource.AttributeFactory, TextReader, String, Int32, Int32)

    Creates Lucene43EdgeNGramTokenizer that can generate n-grams in the sizes of the given range

    Declaration
    [Obsolete]
    public Lucene43EdgeNGramTokenizer(LuceneVersion version, AttributeSource.AttributeFactory factory, TextReader input, string sideLabel, int minGram, int maxGram)
    Parameters
    Type Name Description
    Lucene.Net.Util.LuceneVersion version

    the Lucene match version - See Lucene.Net.Util.LuceneVersion

    Lucene.Net.Util.AttributeSource.AttributeFactory factory

    Lucene.Net.Util.AttributeSource.AttributeFactory to use

    System.IO.TextReader input

    System.IO.TextReader holding the input to be tokenized

    System.String sideLabel

    the name of the Lucene43EdgeNGramTokenizer.Side from which to chop off an n-gram

    System.Int32 minGram

    the smallest n-gram to generate

    System.Int32 maxGram

    the largest n-gram to generate

    | Improve this Doc View Source

    Lucene43EdgeNGramTokenizer(LuceneVersion, TextReader, Lucene43EdgeNGramTokenizer.Side, Int32, Int32)

    Creates Lucene43EdgeNGramTokenizer that can generate n-grams in the sizes of the given range

    Declaration
    [Obsolete]
    public Lucene43EdgeNGramTokenizer(LuceneVersion version, TextReader input, Lucene43EdgeNGramTokenizer.Side side, int minGram, int maxGram)
    Parameters
    Type Name Description
    Lucene.Net.Util.LuceneVersion version

    the Lucene match version - See Lucene.Net.Util.LuceneVersion

    System.IO.TextReader input

    System.IO.TextReader holding the input to be tokenized

    Lucene43EdgeNGramTokenizer.Side side

    the Lucene43EdgeNGramTokenizer.Side from which to chop off an n-gram

    System.Int32 minGram

    the smallest n-gram to generate

    System.Int32 maxGram

    the largest n-gram to generate

    | Improve this Doc View Source

    Lucene43EdgeNGramTokenizer(LuceneVersion, TextReader, Int32, Int32)

    Creates Lucene43EdgeNGramTokenizer that can generate n-grams in the sizes of the given range

    Declaration
    public Lucene43EdgeNGramTokenizer(LuceneVersion version, TextReader input, int minGram, int maxGram)
    Parameters
    Type Name Description
    Lucene.Net.Util.LuceneVersion version

    the Lucene match version - See Lucene.Net.Util.LuceneVersion

    System.IO.TextReader input

    System.IO.TextReader holding the input to be tokenized

    System.Int32 minGram

    the smallest n-gram to generate

    System.Int32 maxGram

    the largest n-gram to generate

    | Improve this Doc View Source

    Lucene43EdgeNGramTokenizer(LuceneVersion, TextReader, String, Int32, Int32)

    Creates Lucene43EdgeNGramTokenizer that can generate n-grams in the sizes of the given range

    Declaration
    [Obsolete]
    public Lucene43EdgeNGramTokenizer(LuceneVersion version, TextReader input, string sideLabel, int minGram, int maxGram)
    Parameters
    Type Name Description
    Lucene.Net.Util.LuceneVersion version

    the Lucene match version - See Lucene.Net.Util.LuceneVersion

    System.IO.TextReader input

    System.IO.TextReader holding the input to be tokenized

    System.String sideLabel

    the name of the Lucene43EdgeNGramTokenizer.Side from which to chop off an n-gram

    System.Int32 minGram

    the smallest n-gram to generate

    System.Int32 maxGram

    the largest n-gram to generate

    Fields

    | Improve this Doc View Source

    DEFAULT_MAX_GRAM_SIZE

    Declaration
    public const int DEFAULT_MAX_GRAM_SIZE = 1
    Field Value
    Type Description
    System.Int32
    | Improve this Doc View Source

    DEFAULT_MIN_GRAM_SIZE

    Declaration
    public const int DEFAULT_MIN_GRAM_SIZE = 1
    Field Value
    Type Description
    System.Int32
    | Improve this Doc View Source

    DEFAULT_SIDE

    Declaration
    public const Lucene43EdgeNGramTokenizer.Side DEFAULT_SIDE = Lucene43EdgeNGramTokenizer.Side.FRONT
    Field Value
    Type Description
    Lucene43EdgeNGramTokenizer.Side

    Methods

    | Improve this Doc View Source

    End()

    Declaration
    public override void End()
    Overrides
    Lucene.Net.Analysis.TokenStream.End()
    | Improve this Doc View Source

    GetSide(String)

    Declaration
    public static Lucene43EdgeNGramTokenizer.Side GetSide(string sideName)
    Parameters
    Type Name Description
    System.String sideName
    Returns
    Type Description
    Lucene43EdgeNGramTokenizer.Side
    | Improve this Doc View Source

    IncrementToken()

    Returns the next token in the stream, or null at EOS.

    Declaration
    public override bool IncrementToken()
    Returns
    Type Description
    System.Boolean
    Overrides
    Lucene.Net.Analysis.TokenStream.IncrementToken()
    | Improve this Doc View Source

    Reset()

    Declaration
    public override void Reset()
    Overrides
    Lucene.Net.Analysis.Tokenizer.Reset()

    Implements

    System.IDisposable
    • Improve this Doc
    • View Source
    Back to top Copyright © 2020 The Apache Software Foundation, Licensed under the Apache License, Version 2.0
    Apache Lucene.Net, Lucene.Net, Apache, the Apache feather logo, and the Apache Lucene.Net project logo are trademarks of The Apache Software Foundation.
    All other marks mentioned may be trademarks or registered trademarks of their respective owners.