Class Lucene43EdgeNGramTokenizer
Old version of EdgeNGramTokenizer which doesn't handle correctly supplementary characters.
Inheritance
Implements
Inherited Members
Namespace: Lucene.Net.Analysis.NGram
Assembly: Lucene.Net.Analysis.Common.dll
Syntax
[Obsolete]
public sealed class Lucene43EdgeNGramTokenizer : Tokenizer, IDisposable
Constructors
| Improve this Doc View SourceLucene43EdgeNGramTokenizer(LuceneVersion, AttributeSource.AttributeFactory, TextReader, Lucene43EdgeNGramTokenizer.Side, Int32, Int32)
Creates Lucene43EdgeNGramTokenizer that can generate n-grams in the sizes of the given range
Declaration
[Obsolete]
public Lucene43EdgeNGramTokenizer(LuceneVersion version, AttributeSource.AttributeFactory factory, TextReader input, Lucene43EdgeNGramTokenizer.Side side, int minGram, int maxGram)
Parameters
Type | Name | Description |
---|---|---|
Lucene.Net.Util.LuceneVersion | version | the Lucene match version - See Lucene.Net.Util.LuceneVersion |
Lucene.Net.Util.AttributeSource.AttributeFactory | factory | Lucene.Net.Util.AttributeSource.AttributeFactory to use |
System.IO.TextReader | input | System.IO.TextReader holding the input to be tokenized |
Lucene43EdgeNGramTokenizer.Side | side | the Lucene43EdgeNGramTokenizer.Side from which to chop off an n-gram |
System.Int32 | minGram | the smallest n-gram to generate |
System.Int32 | maxGram | the largest n-gram to generate |
Lucene43EdgeNGramTokenizer(LuceneVersion, AttributeSource.AttributeFactory, TextReader, Int32, Int32)
Creates Lucene43EdgeNGramTokenizer that can generate n-grams in the sizes of the given range
Declaration
public Lucene43EdgeNGramTokenizer(LuceneVersion version, AttributeSource.AttributeFactory factory, TextReader input, int minGram, int maxGram)
Parameters
Type | Name | Description |
---|---|---|
Lucene.Net.Util.LuceneVersion | version | the Lucene match version - See Lucene.Net.Util.LuceneVersion |
Lucene.Net.Util.AttributeSource.AttributeFactory | factory | Lucene.Net.Util.AttributeSource.AttributeFactory to use |
System.IO.TextReader | input | System.IO.TextReader holding the input to be tokenized |
System.Int32 | minGram | the smallest n-gram to generate |
System.Int32 | maxGram | the largest n-gram to generate |
Lucene43EdgeNGramTokenizer(LuceneVersion, AttributeSource.AttributeFactory, TextReader, String, Int32, Int32)
Creates Lucene43EdgeNGramTokenizer that can generate n-grams in the sizes of the given range
Declaration
[Obsolete]
public Lucene43EdgeNGramTokenizer(LuceneVersion version, AttributeSource.AttributeFactory factory, TextReader input, string sideLabel, int minGram, int maxGram)
Parameters
Type | Name | Description |
---|---|---|
Lucene.Net.Util.LuceneVersion | version | the Lucene match version - See Lucene.Net.Util.LuceneVersion |
Lucene.Net.Util.AttributeSource.AttributeFactory | factory | Lucene.Net.Util.AttributeSource.AttributeFactory to use |
System.IO.TextReader | input | System.IO.TextReader holding the input to be tokenized |
System.String | sideLabel | the name of the Lucene43EdgeNGramTokenizer.Side from which to chop off an n-gram |
System.Int32 | minGram | the smallest n-gram to generate |
System.Int32 | maxGram | the largest n-gram to generate |
Lucene43EdgeNGramTokenizer(LuceneVersion, TextReader, Lucene43EdgeNGramTokenizer.Side, Int32, Int32)
Creates Lucene43EdgeNGramTokenizer that can generate n-grams in the sizes of the given range
Declaration
[Obsolete]
public Lucene43EdgeNGramTokenizer(LuceneVersion version, TextReader input, Lucene43EdgeNGramTokenizer.Side side, int minGram, int maxGram)
Parameters
Type | Name | Description |
---|---|---|
Lucene.Net.Util.LuceneVersion | version | the Lucene match version - See Lucene.Net.Util.LuceneVersion |
System.IO.TextReader | input | System.IO.TextReader holding the input to be tokenized |
Lucene43EdgeNGramTokenizer.Side | side | the Lucene43EdgeNGramTokenizer.Side from which to chop off an n-gram |
System.Int32 | minGram | the smallest n-gram to generate |
System.Int32 | maxGram | the largest n-gram to generate |
Lucene43EdgeNGramTokenizer(LuceneVersion, TextReader, Int32, Int32)
Creates Lucene43EdgeNGramTokenizer that can generate n-grams in the sizes of the given range
Declaration
public Lucene43EdgeNGramTokenizer(LuceneVersion version, TextReader input, int minGram, int maxGram)
Parameters
Type | Name | Description |
---|---|---|
Lucene.Net.Util.LuceneVersion | version | the Lucene match version - See Lucene.Net.Util.LuceneVersion |
System.IO.TextReader | input | System.IO.TextReader holding the input to be tokenized |
System.Int32 | minGram | the smallest n-gram to generate |
System.Int32 | maxGram | the largest n-gram to generate |
Lucene43EdgeNGramTokenizer(LuceneVersion, TextReader, String, Int32, Int32)
Creates Lucene43EdgeNGramTokenizer that can generate n-grams in the sizes of the given range
Declaration
[Obsolete]
public Lucene43EdgeNGramTokenizer(LuceneVersion version, TextReader input, string sideLabel, int minGram, int maxGram)
Parameters
Type | Name | Description |
---|---|---|
Lucene.Net.Util.LuceneVersion | version | the Lucene match version - See Lucene.Net.Util.LuceneVersion |
System.IO.TextReader | input | System.IO.TextReader holding the input to be tokenized |
System.String | sideLabel | the name of the Lucene43EdgeNGramTokenizer.Side from which to chop off an n-gram |
System.Int32 | minGram | the smallest n-gram to generate |
System.Int32 | maxGram | the largest n-gram to generate |
Fields
| Improve this Doc View SourceDEFAULT_MAX_GRAM_SIZE
Declaration
public const int DEFAULT_MAX_GRAM_SIZE = 1
Field Value
Type | Description |
---|---|
System.Int32 |
DEFAULT_MIN_GRAM_SIZE
Declaration
public const int DEFAULT_MIN_GRAM_SIZE = 1
Field Value
Type | Description |
---|---|
System.Int32 |
DEFAULT_SIDE
Declaration
public const Lucene43EdgeNGramTokenizer.Side DEFAULT_SIDE = Lucene43EdgeNGramTokenizer.Side.FRONT
Field Value
Type | Description |
---|---|
Lucene43EdgeNGramTokenizer.Side |
Methods
| Improve this Doc View SourceEnd()
Declaration
public override void End()
Overrides
GetSide(String)
Declaration
public static Lucene43EdgeNGramTokenizer.Side GetSide(string sideName)
Parameters
Type | Name | Description |
---|---|---|
System.String | sideName |
Returns
Type | Description |
---|---|
Lucene43EdgeNGramTokenizer.Side |
IncrementToken()
Returns the next token in the stream, or null at EOS.
Declaration
public override bool IncrementToken()
Returns
Type | Description |
---|---|
System.Boolean |
Overrides
Reset()
Declaration
public override void Reset()