if a char is not a letter or digit, it is a word separator

Namespace: Lucene.Net.Analysis.Ext
Assembly: Lucene.Net.Contrib.Core (in Lucene.Net.Contrib.Core.dll) Version: 2.9.2.0 (2.9.2)

Syntax

C#
public class LetterOrDigitTokenizer : CharTokenizer
Visual Basic
Public Class LetterOrDigitTokenizer _
	Inherits CharTokenizer
Visual C++
public ref class LetterOrDigitTokenizer : public CharTokenizer

Inheritance Hierarchy

System..::..Object
  Lucene.Net.Util..::..AttributeSource
    Lucene.Net.Analysis..::..TokenStream
      Lucene.Net.Analysis..::..Tokenizer
        Lucene.Net.Analysis..::..CharTokenizer
          Lucene.Net.Analysis.Ext..::..LetterOrDigitTokenizer

See Also