org.apache.ctakes.core.nlp.tokenizer

Class HyphenatedPTB

java.lang.Object

org.apache.ctakes.core.nlp.tokenizer.HyphenatedPTB

public class HyphenatedPTB
extends Object

Author:

Mayo Clinic

Constructor Summary

Constructors

Constructor and Description
HyphenatedPTB()

Method Summary

Modifier and Type	Method and Description
static void	main(String[] args)
static int	tokenLengthCheckingForHyphenatedTerms(String lowerCasedString) There is the fixed list of hyphenated words to not be split (hyphenatedWordsLookup) And here are some made-up examples of words using affixes to keep together chronic-itis 1 suffix mega-huge 1 prefix e-game-fest 1 prefix and 1 suffix salon-o-torium 1 suffix that contains 2 hyphens urban-esque-wise 2 suffixes

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HyphenatedPTB

public HyphenatedPTB()

Method Detail

main

public static void main(String[] args)

tokenLengthCheckingForHyphenatedTerms

public static int tokenLengthCheckingForHyphenatedTerms(String lowerCasedString)

There is the fixed list of hyphenated words to not be split (hyphenatedWordsLookup) And here are some made-up examples of words using affixes to keep together chronic-itis 1 suffix mega-huge 1 prefix e-game-fest 1 prefix and 1 suffix salon-o-torium 1 suffix that contains 2 hyphens urban-esque-wise 2 suffixes

Parameters:

lowerCasedString - because of "-o-torium", input might contain more than 1 hyphen....

Returns:

len to keep together, as far as we know. see hyphen hyphen hyphen case below. throws exception if there's no hyphen; number of characters to keep. Does not mean to split at n+1 hyphen... need to recheck that one