org.apache.ctakes.ytex.weka

Class WekaFormatterFactory.WekaFormatter

java.lang.Object

org.apache.ctakes.ytex.kernel.BaseSparseDataFormatter

org.apache.ctakes.ytex.weka.WekaFormatterFactory.WekaFormatter

All Implemented Interfaces:

SparseDataFormatter

Direct Known Subclasses:

WekaAttributeEvaluatorImpl.WekaAttributeEvaluatorFormatter

Enclosing class:

WekaFormatterFactory

public static class WekaFormatterFactory.WekaFormatter
extends BaseSparseDataFormatter

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	CLASS
static java.lang.String	INSTANCE_ID
(package private) InstanceData	instanceLabel
(package private) FastVector	wekaAttributes

Fields inherited from class org.apache.ctakes.ytex.kernel.BaseSparseDataFormatter

exportProperties, kernelUtil, labelToClassIndexMap, maxAttributeIndex, nominalAttributeMap, numericAttributeMap, outdir

Fields inherited from interface org.apache.ctakes.ytex.kernel.SparseDataFormatter

ATTR_INSTANCE_ID, SCOPE, SCOPE_FOLD, SCOPE_LABEL

Constructor Summary

Constructors

Constructor and Description
WekaFormatterFactory.WekaFormatter(KernelUtil kernelUtil)

Method Summary

Methods

Modifier and Type	Method and Description
private void	addNominalAttribute(java.lang.String attributeName, java.util.SortedSet<java.lang.String> attributeValues, boolean addDummy0) Add a nominal attribute to the list of attributes
private void	addWordsToInstances(Instances instances, SparseData bagOfWordsData, java.util.SortedMap<java.lang.Long,java.lang.String> instanceClasses) add sparse data to instances
void	clearFold() clear all data structures set up during initializeFold
void	clearLabel()
void	exportFold(SparseData sparseData, java.util.SortedMap<java.lang.Long,java.lang.String> sortedMap, boolean train, java.lang.String label, java.lang.Integer run, java.lang.Integer fold) export the fold train/test set.
protected void	initializeAttributes(SparseData bagOfWordsData, java.util.SortedSet<java.lang.String> classNames) initialize attributes
void	initializeExport(InstanceData instanceLabel, java.util.Properties properties, SparseData sparseData) get needed properties out of outdir.
void	initializeFold(SparseData sparseData, java.lang.String label, java.lang.Integer run, java.lang.Integer fold, java.util.SortedMap<java.lang.Boolean,java.util.SortedMap<java.lang.Long,java.lang.String>> foldInstanceLabelMap) initialize data structures for the fold that will be exported.
Instances	initializeInstances(SparseData sparseData, java.util.SortedMap<java.lang.Long,java.lang.String> instanceClasses, boolean train, java.lang.String label, java.lang.Integer run, java.lang.Integer fold) initialize the weka Instances
void	initializeLabel(java.lang.String label, java.util.SortedMap<java.lang.Integer,java.util.SortedMap<java.lang.Integer,java.util.SortedMap<java.lang.Boolean,java.util.SortedMap<java.lang.Long,java.lang.String>>>> labelInstances, java.util.Properties properties, SparseData sparseData) initialize attributes on a per-label basis even if the data is the same across all labels.

Methods inherited from class org.apache.ctakes.ytex.kernel.BaseSparseDataFormatter

addNumericAttribute, exportAttributeNames, exportAttributeNames, exportSparseMatrix, exportSparseRow, getSparseLineValues, updateLabelClassMapTransductive

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CLASS

public static final java.lang.String CLASS

See Also:

Constant Field Values

INSTANCE_ID

public static final java.lang.String INSTANCE_ID

See Also:

Constant Field Values

instanceLabel

InstanceData instanceLabel

wekaAttributes

FastVector wekaAttributes

Constructor Detail

WekaFormatterFactory.WekaFormatter

public WekaFormatterFactory.WekaFormatter(KernelUtil kernelUtil)

Method Detail

addNominalAttribute

private void addNominalAttribute(java.lang.String attributeName,
                       java.util.SortedSet<java.lang.String> attributeValues,
                       boolean addDummy0)

Add a nominal attribute to the list of attributes

Parameters:

attributeName -

attributeValues -

addDummy0 - if true, add a dummy attribute as the first attribute value in the list of potential attribute values.

addWordsToInstances

private void addWordsToInstances(Instances instances,
                       SparseData bagOfWordsData,
                       java.util.SortedMap<java.lang.Long,java.lang.String> instanceClasses)
                          throws java.io.IOException

add sparse data to instances

Parameters:

instances -

bagOfWordsData -

instanceClasses -

Throws:

java.io.IOException

clearFold

public void clearFold()

Description copied from interface: SparseDataFormatter

clear all data structures set up during initializeFold

clearLabel

public void clearLabel()

exportFold

public void exportFold(SparseData sparseData,
              java.util.SortedMap<java.lang.Long,java.lang.String> sortedMap,
              boolean train,
              java.lang.String label,
              java.lang.Integer run,
              java.lang.Integer fold)
                throws java.io.IOException

Description copied from interface: SparseDataFormatter

export the fold train/test set. called once per train/test set, 2x per fold.

Throws:

java.io.IOException

initializeAttributes

protected void initializeAttributes(SparseData bagOfWordsData,
                        java.util.SortedSet<java.lang.String> classNames)

initialize attributes

Parameters:

bagOfWordsData -

classNames -

initializeExport

public void initializeExport(InstanceData instanceLabel,
                    java.util.Properties properties,
                    SparseData sparseData)
                      throws java.io.IOException

Description copied from class: BaseSparseDataFormatter

get needed properties out of outdir. convert class names into integers for libsvm. attempt to parse the class name into an integer. if this fails, use an index that we increment. index corresponds to class name's alphabetical order.

Specified by:

initializeExport in interface SparseDataFormatter

Overrides:

initializeExport in class BaseSparseDataFormatter

Throws:

java.io.IOException

initializeFold

public void initializeFold(SparseData sparseData,
                  java.lang.String label,
                  java.lang.Integer run,
                  java.lang.Integer fold,
                  java.util.SortedMap<java.lang.Boolean,java.util.SortedMap<java.lang.Long,java.lang.String>> foldInstanceLabelMap)
                    throws java.io.IOException

Description copied from interface: SparseDataFormatter

initialize data structures for the fold that will be exported. called before export.

Throws:

java.io.IOException

initializeInstances

public Instances initializeInstances(SparseData sparseData,
                            java.util.SortedMap<java.lang.Long,java.lang.String> instanceClasses,
                            boolean train,
                            java.lang.String label,
                            java.lang.Integer run,
                            java.lang.Integer fold)
                              throws java.io.IOException

initialize the weka Instances

Parameters:

arffRelation -

sql -

classLabels -

idfMap -

docLengthMap -

Returns:

Throws:

java.io.IOException

initializeLabel

public void initializeLabel(java.lang.String label,
                   java.util.SortedMap<java.lang.Integer,java.util.SortedMap<java.lang.Integer,java.util.SortedMap<java.lang.Boolean,java.util.SortedMap<java.lang.Long,java.lang.String>>>> labelInstances,
                   java.util.Properties properties,
                   SparseData sparseData)
                     throws java.io.IOException

initialize attributes on a per-label basis even if the data is the same across all labels. The class ids might be different for different labels.

Throws:

java.io.IOException