Class Tokenizer

java.lang.Object
- org.apache.lucene.analysis.TokenStream
- - org.apache.lucene.analysis.Tokenizer

public abstract class Tokenizer

extends TokenStream

A Tokenizer is a TokenStream whose input is a Reader.

This is an abstract class.

Field Summary
`protected Reader`	`input` The text source for this Tokenizer.

Constructor Summary
`Tokenizer()` Construct a tokenizer with null input.
`Tokenizer(Reader input)` Construct a token stream processing the given input.

Method Summary
`void`	`close()` By default, closes the input Reader.

Methods inherited from class org.apache.lucene.analysis.TokenStream
`close`, `next`

protected Reader input

The text source for this Tokenizer.

protected Tokenizer()

Construct a tokenizer with null input.

protected Tokenizer(Reader input)

Construct a token stream processing the given input.

public void close()
            throws IOException

By default, closes the input Reader.
Overrides:
close in interface TokenStream

Overview Package Class Use Tree Index Deprecated About
Prev Class \| Next Class	Frames \| No Frames
Summary: Nested \| Field \| Method \| Constr	Detail: Nested \| Field \| Method \| Constr

Field Summary