public class ChineseSentenceTokenizer extends Object implements SentenceTokenizer
| Constructor and Description |
|---|
ChineseSentenceTokenizer() |
| Modifier and Type | Method and Description |
|---|---|
void |
setSingleLineBreaksMarksParagraph(boolean lineBreakParagraphs)
Note: does have no effect for Chinese
|
boolean |
singleLineBreaksMarksPara()
Note: will always return
false |
List<String> |
tokenize(String text) |
public List<String> tokenize(String text)
tokenize in interface SentenceTokenizertokenize in interface Tokenizerpublic void setSingleLineBreaksMarksParagraph(boolean lineBreakParagraphs)
setSingleLineBreaksMarksParagraph in interface SentenceTokenizerpublic boolean singleLineBreaksMarksPara()
falsesingleLineBreaksMarksPara in interface SentenceTokenizer