Class ChineseFilter

A TokenFilter with a stop word table.

  • Numeric tokens are removed.
  • English tokens must be larger than 1 character.
  • One Chinese character as one Chinese word.
TO DO:
  1. Add Chinese stop words, such as \ue400
  2. Dictionary based Chinese word extraction
  3. Intelligent Chinese word extraction

Inheritance
System.Object
AttributeSource
TokenStream
TokenFilter
ChineseFilter
Implements
IDisposable
Inherited Members
Namespace: Lucene.Net.Analysis.Cn
Assembly: Lucene.Net.Analysis.Common.dll
Syntax
public sealed class ChineseFilter : TokenFilter, IDisposable

Constructors

| Improve this Doc View Source

ChineseFilter(TokenStream)

Declaration
public ChineseFilter(TokenStream in)
Parameters
Type Name Description
TokenStream in

Fields

| Improve this Doc View Source

STOP_WORDS

Declaration
public static readonly string[] STOP_WORDS
Field Value
Type Description
System.String[]

Methods

| Improve this Doc View Source

IncrementToken()

Declaration
public override bool IncrementToken()
Returns
Type Description
System.Boolean
Overrides

Implements

IDisposable