Overview | Package | Class | Use | Tree | Deprecated | Index | Help
PREV NEXT | FRAMES NO FRAMES

## Uses of Class
org.apache.lucene.analysis.Token

Packages that use Token
org.apache.lucene.analysis | API and code to convert text into indexable/searchable tokens.
org.apache.lucene.analysis.standard | A fast grammar-based tokenizer constructed with JFlex.

Uses of Token in org.apache.lucene.analysis

Methods in org.apache.lucene.analysis that return Token
`Token` | `Token.clone(char[] newTermBuffer, int newTermOffset, int newTermLength, int newStartOffset, int newEndOffset)` Makes a clone, but replaces the term buffer & start/end offset in the process.
`Token` | `TokenStream.next()` Deprecated. The returned Token is a "full private copy" (not re-used across calls to next()) but will be slower than calling `TokenStream.next(Token)` instead..
`Token` | `LowerCaseFilter.next(Token reusableToken)`
`Token` | `SinkTokenizer.next(Token reusableToken)` Returns the next token out of the list of cached tokens
`Token` | `CharTokenizer.next(Token reusableToken)`
`Token` | `CachingTokenFilter.next(Token reusableToken)`
`Token` | `LengthFilter.next(Token reusableToken)` Returns the next input Token whose term() is the right len
`Token` | `TeeTokenFilter.next(Token reusableToken)`
`Token` | `PorterStemFilter.next(Token reusableToken)`
`Token` | `ISOLatin1AccentFilter.next(Token reusableToken)`
`Token` | `TokenStream.next(Token reusableToken)` Returns the next token in the stream, or null at EOS.
`Token` | `StopFilter.next(Token reusableToken)` Returns the next input Token whose term() is not a stop word.
`Token` | `KeywordTokenizer.next(Token reusableToken)`
`Token` | `Token.reinit(char[] newTermBuffer, int newTermOffset, int newTermLength, int newStartOffset, int newEndOffset)` Shorthand for calling `clear()`, `setTermBuffer(char[], int, int)`, `setStartOffset(int)`, `setEndOffset(int)` `setType(java.lang.String)` on Token.DEFAULT_TYPE
`Token` | `Token.reinit(char[] newTermBuffer, int newTermOffset, int newTermLength, int newStartOffset, int newEndOffset, String newType)` Shorthand for calling `clear()`, `setTermBuffer(char[], int, int)`, `setStartOffset(int)`, `setEndOffset(int)`, `setType(java.lang.String)`
`Token` | `Token.reinit(String newTerm, int newStartOffset, int newEndOffset)` Shorthand for calling `clear()`, `setTermBuffer(String)`, `setStartOffset(int)`, `setEndOffset(int)` `setType(java.lang.String)` on Token.DEFAULT_TYPE
`Token` | `Token.reinit(String newTerm, int newTermOffset, int newTermLength, int newStartOffset, int newEndOffset)` Shorthand for calling `clear()`, `setTermBuffer(String, int, int)`, `setStartOffset(int)`, `setEndOffset(int)` `setType(java.lang.String)` on Token.DEFAULT_TYPE
`Token` | `Token.reinit(String newTerm, int newTermOffset, int newTermLength, int newStartOffset, int newEndOffset, String newType)` Shorthand for calling `clear()`, `setTermBuffer(String, int, int)`, `setStartOffset(int)`, `setEndOffset(int)` `setType(java.lang.String)`
`Token` | `Token.reinit(String newTerm, int newStartOffset, int newEndOffset, String newType)` Shorthand for calling `clear()`, `setTermBuffer(String)`, `setStartOffset(int)`, `setEndOffset(int)` `setType(java.lang.String)`

Methods in org.apache.lucene.analysis with parameters of type Token
`void` | `SinkTokenizer.add(Token t)` Override this method to cache only certain tokens, or new tokens based on the old tokens.
`Token` | `LowerCaseFilter.next(Token reusableToken)`
`Token` | `SinkTokenizer.next(Token reusableToken)` Returns the next token out of the list of cached tokens
`Token` | `CharTokenizer.next(Token reusableToken)`
`Token` | `CachingTokenFilter.next(Token reusableToken)`
`Token` | `LengthFilter.next(Token reusableToken)` Returns the next input Token whose term() is the right len
`Token` | `TeeTokenFilter.next(Token reusableToken)`
`Token` | `PorterStemFilter.next(Token reusableToken)`
`Token` | `ISOLatin1AccentFilter.next(Token reusableToken)`
`Token` | `TokenStream.next(Token reusableToken)` Returns the next token in the stream, or null at EOS.
`Token` | `StopFilter.next(Token reusableToken)` Returns the next input Token whose term() is not a stop word.
`Token` | `KeywordTokenizer.next(Token reusableToken)`
`void` | `Token.reinit(Token prototype)` Copy the prototype token's fields into this one.
`void` | `Token.reinit(Token prototype, char[] newTermBuffer, int offset, int length)` Copy the prototype token's fields into this one, with a different term.
`void` | `Token.reinit(Token prototype, String newTerm)` Copy the prototype token's fields into this one, with a different term.

Uses of Token in org.apache.lucene.analysis.standard

Methods in org.apache.lucene.analysis.standard that return Token
`Token` | `StandardTokenizer.next(Token reusableToken)`
`Token` | `StandardFilter.next(Token reusableToken)` Returns the next token in the stream, or null at EOS.

Methods in org.apache.lucene.analysis.standard with parameters of type Token
`Token` | `StandardTokenizer.next(Token reusableToken)`
`Token` | `StandardFilter.next(Token reusableToken)` Returns the next token in the stream, or null at EOS.

Overview | Package | Class | Use | Tree | Deprecated | Index | Help
PREV NEXT | FRAMES NO FRAMES

Copyright © 2000-2009 Apache Software Foundation. All Rights Reserved.