org.apache.ctakes.core.ae

Class TokenizerAnnotatorPTB

java.lang.Object

org.apache.uima.analysis_component.AnalysisComponent_ImplBase

org.apache.uima.analysis_component.Annotator_ImplBase

org.apache.uima.analysis_component.JCasAnnotator_ImplBase

org.apache.uima.fit.component.JCasAnnotator_ImplBase

org.apache.ctakes.core.ae.TokenizerAnnotatorPTB

All Implemented Interfaces:

org.apache.uima.analysis_component.AnalysisComponent

@PipeBitInfo(name="PTB Tokenizer",
             description="Annotates Document Penn TreeBank Tokens.",
             dependencies={SECTION,SENTENCE},
             products=BASE_TOKEN)
public class TokenizerAnnotatorPTB
extends org.apache.uima.fit.component.JCasAnnotator_ImplBase

UIMA annotator that tokenizes based on Penn Treebank rules.

Author:

Mayo Clinic

Field Summary

Fields

Modifier and Type	Field and Description
static String	PARAM_SEGMENTS_TO_SKIP Value is "SegmentsToSkip".

Constructor Summary

Constructors

Constructor and Description
TokenizerAnnotatorPTB()

Method Summary

Modifier and Type	Method and Description
protected void	annotateRange(org.apache.uima.jcas.JCas jcas, int rangeBegin, int rangeEnd) Tokenizes a range of text, adding the tokens to the CAS Tokenizes one sentence at a time.
static org.apache.uima.analysis_engine.AnalysisEngineDescription	createAnnotatorDescription()
void	initialize(org.apache.uima.UimaContext aContext)
void	process(org.apache.uima.jcas.JCas jcas) Entry point for processing.

Methods inherited from class org.apache.uima.fit.component.JCasAnnotator_ImplBase

getLogger

Methods inherited from class org.apache.uima.analysis_component.JCasAnnotator_ImplBase

getRequiredCasInterface, process

Methods inherited from class org.apache.uima.analysis_component.Annotator_ImplBase

getCasInstancesRequired, hasNext, next

Methods inherited from class org.apache.uima.analysis_component.AnalysisComponent_ImplBase

batchProcessComplete, collectionProcessComplete, destroy, getContext, getResultSpecification, reconfigure, setResultSpecification

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

PARAM_SEGMENTS_TO_SKIP

public static final String PARAM_SEGMENTS_TO_SKIP

Value is "SegmentsToSkip". This parameter specifies which segments to skip. The parameter should be of type String, should be multi-valued and optional.

See Also:

Constant Field Values

Constructor Detail

TokenizerAnnotatorPTB

public TokenizerAnnotatorPTB()

Method Detail

initialize

public void initialize(org.apache.uima.UimaContext aContext)
                throws org.apache.uima.resource.ResourceInitializationException

Specified by:

initialize in interface org.apache.uima.analysis_component.AnalysisComponent

Overrides:

initialize in class org.apache.uima.fit.component.JCasAnnotator_ImplBase

Throws:

org.apache.uima.resource.ResourceInitializationException

process

public void process(org.apache.uima.jcas.JCas jcas)
             throws org.apache.uima.analysis_engine.AnalysisEngineProcessException

Entry point for processing.

Specified by:

process in class org.apache.uima.analysis_component.JCasAnnotator_ImplBase

Throws:

org.apache.uima.analysis_engine.AnalysisEngineProcessException

annotateRange

protected void annotateRange(org.apache.uima.jcas.JCas jcas,
                             int rangeBegin,
                             int rangeEnd)
                      throws org.apache.uima.analysis_engine.AnalysisEngineProcessException

Tokenizes a range of text, adding the tokens to the CAS Tokenizes one sentence at a time. Only tokenizes what is within Sentence annotation. There must have been Sentence annotations created beforehand in order for this method to tokenize anything.

Throws:

org.apache.uima.analysis_engine.AnalysisEngineProcessException

createAnnotatorDescription

public static org.apache.uima.analysis_engine.AnalysisEngineDescription createAnnotatorDescription()
                                                                                            throws org.apache.uima.resource.ResourceInitializationException

Throws:

org.apache.uima.resource.ResourceInitializationException