Returns true iff a character should be included in a token. This tokenizer generates as tokens adjacent sequences of characters which satisfy this predicate. Characters for which this is false are used to define token boundaries and are not included in tokens.

Namespace: Lucene.Net.Analysis
Assembly: Lucene.Net (in Lucene.Net.dll) Version: 2.9.4.1

Syntax

C#
protected internal abstract bool IsTokenChar(
	char c
)
Visual Basic
Protected Friend MustOverride Function IsTokenChar ( _
	c As Char _
) As Boolean
Visual C++
protected public:
virtual bool IsTokenChar(
	wchar_t c
) abstract

Parameters

c
Type: System..::..Char

[Missing <param name="c"/> documentation for "M:Lucene.Net.Analysis.CharTokenizer.IsTokenChar(System.Char)"]

Return Value

[Missing <returns> documentation for "M:Lucene.Net.Analysis.CharTokenizer.IsTokenChar(System.Char)"]

See Also