Class CJKWidthFilter
A TokenFilter that normalizes CJK width differences:
- Folds fullwidth ASCII variants into the equivalent basic latin
- Folds halfwidth Katakana variants into the equivalent kana
NOTE: this filter can be viewed as a (practical) subset of NFKC/NFKD Unicode normalization. See the normalization support in the ICU package for full normalization.
Implements
IDisposable
Inherited Members
Namespace: Lucene.Net.Analysis.Cjk
Assembly: Lucene.Net.Analysis.Common.dll
Syntax
public sealed class CJKWidthFilter : TokenFilter, IDisposable
Constructors
| Improve this Doc View SourceCJKWidthFilter(TokenStream)
Declaration
public CJKWidthFilter(TokenStream input)
Parameters
Type | Name | Description |
---|---|---|
TokenStream | input |
Methods
| Improve this Doc View SourceIncrementToken()
Declaration
public override bool IncrementToken()
Returns
Type | Description |
---|---|
System.Boolean |
Overrides
Implements
IDisposable