Class RussianLetterTokenizer
A RussianLetterTokenizer is a Tokenizer that extends LetterTokenizer by also allowing the basic Latin digits 0-9.
You must specify the required LuceneVersion compatibility when creating RussianLetterTokenizer:
- As of 3.1, CharTokenizer uses an int based API to normalize and detect token characters. See IsTokenChar(Int32) and Normalize(Int32) for details.
Inheritance
System.Object
RussianLetterTokenizer
Implements
IDisposable
Inherited Members
Namespace: Lucene.Net.Analysis.Ru
Assembly: Lucene.Net.Analysis.Common.dll
Syntax
public class RussianLetterTokenizer : CharTokenizer, IDisposableConstructors
| Improve this Doc View SourceRussianLetterTokenizer(LuceneVersion, AttributeSource.AttributeFactory, TextReader)
Construct a new RussianLetterTokenizer using a given AttributeSource.AttributeFactory.
Declaration
public RussianLetterTokenizer(LuceneVersion matchVersion, AttributeSource.AttributeFactory factory, TextReader in)Parameters
| Type | Name | Description |
|---|---|---|
| LuceneVersion | matchVersion | lucene compatibility version |
| AttributeSource.AttributeFactory | factory | the attribute factory to use for this Tokenizer |
| TextReader | in | the input to split up into tokens |
RussianLetterTokenizer(LuceneVersion, TextReader)
Construct a new RussianLetterTokenizer.
Declaration
public RussianLetterTokenizer(LuceneVersion matchVersion, TextReader in)Parameters
| Type | Name | Description |
|---|---|---|
| LuceneVersion | matchVersion | lucene compatibility version |
| TextReader | in | the input to split up into tokens |
Methods
| Improve this Doc View SourceIsTokenChar(Int32)
Collects only characters which satisfy
Declaration
protected override bool IsTokenChar(int c)Parameters
| Type | Name | Description |
|---|---|---|
| System.Int32 | c |
Returns
| Type | Description |
|---|---|
| System.Boolean |
Overrides
Implements
IDisposable