Package org.apache.ctakes.core.nlp.tokenizer

Class Summary

Class	Description
ContractionResult
ContractionsPTB
HyphenatedPTB
OffsetComparator	Sorts Token objects by their offset.
Token	Object that represents a generic token.
Tokenizer	A class used to break natural text into tokens.
TokenizerHelper
TokenizerPTB	A class used to break natural text into tokens following PTB rules.