Class Lucene43EdgeNGramTokenizer

Old version of EdgeNGramTokenizer which doesn't handle correctly supplementary characters.

Inheritance

System.Object

AttributeSource

TokenStream

Tokenizer

Lucene43EdgeNGramTokenizer

Implements

System.IDisposable

Inherited Members

Tokenizer.m_input

Tokenizer.Dispose(Boolean)

Tokenizer.CorrectOffset(Int32)

Tokenizer.SetReader(TextReader)

TokenStream.Dispose()

AttributeSource.GetAttributeFactory()

AttributeSource.GetAttributeClassesEnumerator()

AttributeSource.GetAttributeImplsEnumerator()

AttributeSource.AddAttributeImpl(Attribute)

AttributeSource.AddAttribute<T>()

AttributeSource.HasAttributes

AttributeSource.HasAttribute<T>()

AttributeSource.GetAttribute<T>()

AttributeSource.ClearAttributes()

AttributeSource.CaptureState()

AttributeSource.RestoreState(AttributeSource.State)

AttributeSource.GetHashCode()

AttributeSource.Equals(Object)

AttributeSource.ReflectAsString(Boolean)

AttributeSource.ReflectWith(IAttributeReflector)

AttributeSource.CloneAttributes()

AttributeSource.CopyTo(AttributeSource)

AttributeSource.ToString()

System.Object.Equals(System.Object, System.Object)

System.Object.GetType()

System.Object.MemberwiseClone()

System.Object.ReferenceEquals(System.Object, System.Object)

Namespace: Lucene.Net.Analysis.NGram

Assembly: Lucene.Net.Analysis.Common.dll

Syntax

[Obsolete]
public sealed class Lucene43EdgeNGramTokenizer : Tokenizer, IDisposable

Constructors

| Improve this Doc View Source

Lucene43EdgeNGramTokenizer(LuceneVersion, AttributeSource.AttributeFactory, TextReader, Lucene43EdgeNGramTokenizer.Side, Int32, Int32)

Creates Lucene43EdgeNGramTokenizer that can generate n-grams in the sizes of the given range

Declaration

[Obsolete]
public Lucene43EdgeNGramTokenizer(LuceneVersion version, AttributeSource.AttributeFactory factory, TextReader input, Lucene43EdgeNGramTokenizer.Side side, int minGram, int maxGram)

Parameters

Type	Name	Description
LuceneVersion	version	the Lucene match version - See LuceneVersion
AttributeSource.AttributeFactory	factory	AttributeSource.AttributeFactory to use
System.IO.TextReader	input	System.IO.TextReader holding the input to be tokenized
Lucene43EdgeNGramTokenizer.Side	side	the Lucene43EdgeNGramTokenizer.Side from which to chop off an n-gram
System.Int32	minGram	the smallest n-gram to generate
System.Int32	maxGram	the largest n-gram to generate

| Improve this Doc View Source

Lucene43EdgeNGramTokenizer(LuceneVersion, AttributeSource.AttributeFactory, TextReader, Int32, Int32)

Creates Lucene43EdgeNGramTokenizer that can generate n-grams in the sizes of the given range

Declaration

public Lucene43EdgeNGramTokenizer(LuceneVersion version, AttributeSource.AttributeFactory factory, TextReader input, int minGram, int maxGram)

Parameters

Type	Name	Description
LuceneVersion	version	the Lucene match version - See LuceneVersion
AttributeSource.AttributeFactory	factory	AttributeSource.AttributeFactory to use
System.IO.TextReader	input	System.IO.TextReader holding the input to be tokenized
System.Int32	minGram	the smallest n-gram to generate
System.Int32	maxGram	the largest n-gram to generate

| Improve this Doc View Source

Lucene43EdgeNGramTokenizer(LuceneVersion, AttributeSource.AttributeFactory, TextReader, String, Int32, Int32)

Creates Lucene43EdgeNGramTokenizer that can generate n-grams in the sizes of the given range

Declaration

[Obsolete]
public Lucene43EdgeNGramTokenizer(LuceneVersion version, AttributeSource.AttributeFactory factory, TextReader input, string sideLabel, int minGram, int maxGram)

Parameters

Type	Name	Description
LuceneVersion	version	the Lucene match version - See LuceneVersion
AttributeSource.AttributeFactory	factory	AttributeSource.AttributeFactory to use
System.IO.TextReader	input	System.IO.TextReader holding the input to be tokenized
System.String	sideLabel	the name of the Lucene43EdgeNGramTokenizer.Side from which to chop off an n-gram
System.Int32	minGram	the smallest n-gram to generate
System.Int32	maxGram	the largest n-gram to generate

| Improve this Doc View Source

Lucene43EdgeNGramTokenizer(LuceneVersion, TextReader, Lucene43EdgeNGramTokenizer.Side, Int32, Int32)

Creates Lucene43EdgeNGramTokenizer that can generate n-grams in the sizes of the given range

Declaration

[Obsolete]
public Lucene43EdgeNGramTokenizer(LuceneVersion version, TextReader input, Lucene43EdgeNGramTokenizer.Side side, int minGram, int maxGram)

Parameters

Type	Name	Description
LuceneVersion	version	the Lucene match version - See LuceneVersion
System.IO.TextReader	input	System.IO.TextReader holding the input to be tokenized
Lucene43EdgeNGramTokenizer.Side	side	the Lucene43EdgeNGramTokenizer.Side from which to chop off an n-gram
System.Int32	minGram	the smallest n-gram to generate
System.Int32	maxGram	the largest n-gram to generate

| Improve this Doc View Source

Lucene43EdgeNGramTokenizer(LuceneVersion, TextReader, Int32, Int32)

Creates Lucene43EdgeNGramTokenizer that can generate n-grams in the sizes of the given range

Declaration

public Lucene43EdgeNGramTokenizer(LuceneVersion version, TextReader input, int minGram, int maxGram)

Parameters

Type	Name	Description
LuceneVersion	version	the Lucene match version - See LuceneVersion
System.IO.TextReader	input	System.IO.TextReader holding the input to be tokenized
System.Int32	minGram	the smallest n-gram to generate
System.Int32	maxGram	the largest n-gram to generate

| Improve this Doc View Source

Lucene43EdgeNGramTokenizer(LuceneVersion, TextReader, String, Int32, Int32)

Creates Lucene43EdgeNGramTokenizer that can generate n-grams in the sizes of the given range

Declaration

[Obsolete]
public Lucene43EdgeNGramTokenizer(LuceneVersion version, TextReader input, string sideLabel, int minGram, int maxGram)

Parameters

Type	Name	Description
LuceneVersion	version	the Lucene match version - See LuceneVersion
System.IO.TextReader	input	System.IO.TextReader holding the input to be tokenized
System.String	sideLabel	the name of the Lucene43EdgeNGramTokenizer.Side from which to chop off an n-gram
System.Int32	minGram	the smallest n-gram to generate
System.Int32	maxGram	the largest n-gram to generate

Fields

| Improve this Doc View Source

DEFAULT_MAX_GRAM_SIZE

Declaration

public const int DEFAULT_MAX_GRAM_SIZE = 1

Field Value

Type	Description
System.Int32

| Improve this Doc View Source

DEFAULT_MIN_GRAM_SIZE

Declaration

public const int DEFAULT_MIN_GRAM_SIZE = 1

Field Value

Type	Description
System.Int32

| Improve this Doc View Source

DEFAULT_SIDE

Declaration

public const Lucene43EdgeNGramTokenizer.Side DEFAULT_SIDE = Lucene43EdgeNGramTokenizer.Side.FRONT

Field Value

Type	Description
Lucene43EdgeNGramTokenizer.Side

Methods

| Improve this Doc View Source

End()

Declaration

public override void End()

Overrides

TokenStream.End()

| Improve this Doc View Source

GetSide(String)

Declaration

public static Lucene43EdgeNGramTokenizer.Side GetSide(string sideName)

Parameters

Type	Name	Description
System.String	sideName

Returns

Type	Description
Lucene43EdgeNGramTokenizer.Side

| Improve this Doc View Source

IncrementToken()

Returns the next token in the stream, or null at EOS.

Declaration

public override bool IncrementToken()

Returns

Type	Description
System.Boolean

Overrides

TokenStream.IncrementToken()

| Improve this Doc View Source

Reset()

Declaration

public override void Reset()

Overrides

Tokenizer.Reset()

Implements

System.IDisposable