Overload List
| Name | Description | |
|---|---|---|
| Tokenizer()()()() | Construct a tokenizer with null input. | |
| Tokenizer(TextReader) | Construct a token stream processing the given input. | |
| Tokenizer(AttributeSource) | Construct a token stream processing the given input using the given AttributeSource. | |
| Tokenizer(AttributeSource..::..AttributeFactory) | Construct a tokenizer with null input using the given AttributeFactory. | |
| Tokenizer(AttributeSource, TextReader) | Construct a token stream processing the given input using the given AttributeSource. | |
| Tokenizer(AttributeSource..::..AttributeFactory, TextReader) | Construct a token stream processing the given input using the given AttributeFactory. |