Class WordTokenFilter

A TokenFilter that breaks sentences into words.

This is a Lucene.NET EXPERIMENTAL API, use at your own risk
Inheritance
System.Object
AttributeSource
TokenStream
TokenFilter
WordTokenFilter
Implements
System.IDisposable
Inherited Members
System.Object.Equals(System.Object, System.Object)
System.Object.GetType()
System.Object.MemberwiseClone()
System.Object.ReferenceEquals(System.Object, System.Object)
Namespace: Lucene.Net.Analysis.Cn.Smart
Assembly: Lucene.Net.Analysis.SmartCn.dll
Syntax
[Obsolete("Use HMMChineseTokenizer instead.")]
public sealed class WordTokenFilter : TokenFilter, IDisposable

Constructors

| Improve this Doc View Source

WordTokenFilter(TokenStream)

Construct a new WordTokenFilter.

Declaration
public WordTokenFilter(TokenStream input)
Parameters
Type Name Description
TokenStream input

TokenStream of sentences.

Methods

| Improve this Doc View Source

IncrementToken()

Declaration
public override bool IncrementToken()
Returns
Type Description
System.Boolean
Overrides
| Improve this Doc View Source

Reset()

Declaration
public override void Reset()
Overrides

Implements

System.IDisposable