public final class CJKTokenizer extends Tokenizer
Constructor and Description |
---|
CJKTokenizer(java.io.Reader in)
Construct a token stream processing the given input.
|
public CJKTokenizer(java.io.Reader in)
in
- I/O readerpublic final Token next(Token reusableToken) throws java.io.IOException
next
in class TokenStream
reusableToken
- a reusable tokenjava.io.IOException
- - throw IOException when read error Copyright © 2000-2014 Apache Software Foundation. All Rights Reserved.