org.apache.ctakes.gui.dictionary.util

Class TextTokenizer

java.lang.Object

org.apache.ctakes.gui.dictionary.util.TextTokenizer

public final class TextTokenizer
extends Object

Author: SPF Affiliation: CHIP-NLP Date: 1/16/14

Method Summary

Modifier and Type	Method and Description
static String	getTokenizedText(String text)
static String	getTokenizedText(String text, boolean separateDigits)
static List<String>	getTokens(String word)
static List<String>	getTokens(String word, boolean separateDigits)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

getTokens

public static List<String> getTokens(String word)

getTokens

public static List<String> getTokens(String word,
                                     boolean separateDigits)

getTokenizedText

public static String getTokenizedText(String text)

getTokenizedText

public static String getTokenizedText(String text,
                                      boolean separateDigits)