org.apache.lucene.analysis
Class TokenStream
java.lang.Objectorg.apache.lucene.analysis.TokenStream
public abstract class TokenStream
extends java.lang.Object
A TokenStream enumerates the sequence of tokens, either from
fields of a document or from query text.
This is an abstract class. Concrete subclasses are:
Tokenizer, a TokenStream
whose input is a Reader; and
TokenFilter, a TokenStream
whose input is another TokenStream.
void | close()- Releases resources associated with this stream.
|
abstract Token | next()- Returns the next token in the stream, or null at EOS.
|
close
public void close()
throws IOExceptionReleases resources associated with this stream.
next
public abstract Token next()
throws IOExceptionReturns the next token in the stream, or null at EOS.
Copyright © 2000-2007 Apache Software Foundation. All Rights Reserved.