Creates a new instance of the {@link Lucene.Net.Analysis.Standard.StandardTokenizer}. Attaches the
CopyC#
input
 to the newly created JFlex scanner.

Namespace: Lucene.Net.Analysis.Standard
Assembly: Lucene.Net (in Lucene.Net.dll) Version: 2.9.4.1

Syntax

C#
[ObsoleteAttribute("Use StandardTokenizer(Version, Reader) instead")]
public StandardTokenizer(
	TextReader input,
	bool replaceInvalidAcronym
)
Visual Basic
<ObsoleteAttribute("Use StandardTokenizer(Version, Reader) instead")> _
Public Sub New ( _
	input As TextReader, _
	replaceInvalidAcronym As Boolean _
)
Visual C++
[ObsoleteAttribute(L"Use StandardTokenizer(Version, Reader) instead")]
public:
StandardTokenizer(
	TextReader^ input, 
	bool replaceInvalidAcronym
)

Parameters

input
Type: System.IO..::..TextReader
The input reader
replaceInvalidAcronym
Type: System..::..Boolean
Set to true to replace mischaracterized acronyms with HOST. See http://issues.apache.org/jira/browse/LUCENE-1068

See Also