Class SegTokenFilter

Filters a SegToken by converting full-width latin to half-width, then lowercasing latin. Additionally, all punctuation is converted into COMMON_DELIMITER

This is a Lucene.NET EXPERIMENTAL API, use at your own risk

Inheritance

System.Object

SegTokenFilter

Inherited Members

System.Object.Equals(System.Object)

System.Object.Equals(System.Object, System.Object)

System.Object.GetHashCode()

System.Object.GetType()

System.Object.MemberwiseClone()

System.Object.ReferenceEquals(System.Object, System.Object)

System.Object.ToString()

Namespace: Lucene.Net.Analysis.Cn.Smart.Hhmm

Assembly: Lucene.Net.Analysis.SmartCn.dll

Syntax

public class SegTokenFilter

Methods

Filter(SegToken)

Filter an input SegToken

Full-width latin will be converted to half-width, then all latin will be lowercased. All punctuation is converted into COMMON_DELIMITER

Declaration

public virtual SegToken Filter(SegToken token)

Parameters

Type	Name	Description
SegToken	token	Input SegToken.

Returns

Type	Description
SegToken	Normalized SegToken.