public class SimpleFragmenter extends Object implements Fragmenter
Fragmenter
implementation which breaks text up into same-size
fragments with no concerns over spotting sentence boundaries.Constructor and Description |
---|
SimpleFragmenter() |
SimpleFragmenter(int fragmentSize) |
Modifier and Type | Method and Description |
---|---|
int |
getFragmentSize() |
boolean |
isNewFragment(Token token)
Test to see if this token from the stream should be held in a new TextFragment
|
void |
setFragmentSize(int size) |
void |
start(String originalText)
Initializes the Fragmenter
|
public SimpleFragmenter()
public SimpleFragmenter(int fragmentSize)
fragmentSize
- size in number of characters of each fragmentpublic void start(String originalText)
Fragmenter
start
in interface Fragmenter
public boolean isNewFragment(Token token)
Fragmenter
isNewFragment
in interface Fragmenter
public int getFragmentSize()
public void setFragmentSize(int size)
size
- size in characters of each fragmentCopyright © 2000-2013 Apache Software Foundation. All Rights Reserved.