Class SegTokenFilter

Filters a SegToken by converting full-width latin to half-width, then lowercasing latin. Additionally, all punctuation is converted into COMMON_DELIMITER

Note

This API is experimental and might change in incompatible ways in the next release.

Inheritance

object

SegTokenFilter

Inherited Members

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

object.ToString()

Namespace: Lucene.Net.Analysis.Cn.Smart.Hhmm

Assembly: Lucene.Net.Analysis.SmartCn.dll

Syntax

public class SegTokenFilter

Methods

Filter(SegToken)

Filter an input SegToken

Full-width latin will be converted to half-width, then all latin will be lowercased. All punctuation is converted into COMMON_DELIMITER

Declaration

public virtual SegToken Filter(SegToken token)

Parameters

Type	Name	Description
SegToken	token	Input SegToken.

Returns

Type	Description
SegToken	Normalized SegToken.