Class SegTokenFilter
Filters a SegToken by converting full-width latin to half-width, then lowercasing latin. Additionally, all punctuation is converted into COMMON_DELIMITER
This is a Lucene.NET EXPERIMENTAL API, use at your own risk
Inheritance
System.Object
SegTokenFilter
Namespace: Lucene.Net.Analysis.Cn.Smart.Hhmm
Assembly: Lucene.Net.Analysis.SmartCn.dll
Syntax
public class SegTokenFilter : objectMethods
| Improve this Doc View SourceFilter(SegToken)
Filter an input SegToken
Full-width latin will be converted to half-width, then all latin will be lowercased. All punctuation is converted into COMMON_DELIMITER
Declaration
public virtual SegToken Filter(SegToken token)Parameters
| Type | Name | Description |
|---|---|---|
| SegToken | token | Input SegToken. |
Returns
| Type | Description |
|---|---|
| SegToken | Normalized SegToken. |