Class ChineseFilter

A TokenFilter with a stop word table.

  • Numeric tokens are removed.
  • English tokens must be larger than 1 character.
  • One Chinese character as one Chinese word.
TO DO:
  1. Add Chinese stop words, such as \ue400
  2. Dictionary based Chinese word extraction
  3. Intelligent Chinese word extraction

Inheritance
System.Object
AttributeSource
TokenStream
TokenFilter
ChineseFilter
Implements
System.IDisposable
Inherited Members
System.Object.Equals(System.Object, System.Object)
System.Object.GetType()
System.Object.MemberwiseClone()
System.Object.ReferenceEquals(System.Object, System.Object)
Namespace: Lucene.Net.Analysis.Cn
Assembly: Lucene.Net.Analysis.Common.dll
Syntax
[Obsolete("(3.1) Use StopFilter instead, which has the same functionality.")]
public sealed class ChineseFilter : TokenFilter, IDisposable

Constructors

| Improve this Doc View Source

ChineseFilter(TokenStream)

Declaration
public ChineseFilter(TokenStream in)
Parameters
Type Name Description
TokenStream in

Fields

| Improve this Doc View Source

STOP_WORDS

Declaration
public static readonly string[] STOP_WORDS
Field Value
Type Description
System.String[]

Methods

| Improve this Doc View Source

IncrementToken()

Declaration
public override bool IncrementToken()
Returns
Type Description
System.Boolean
Overrides

Implements

System.IDisposable