org.apache.ctakes.ytex.weka

Class WekaFormatterFactory.WekaFormatter

java.lang.Object

org.apache.ctakes.ytex.kernel.BaseSparseDataFormatter

org.apache.ctakes.ytex.weka.WekaFormatterFactory.WekaFormatter

All Implemented Interfaces:

SparseDataFormatter

Direct Known Subclasses:

WekaAttributeEvaluatorImpl.WekaAttributeEvaluatorFormatter

Enclosing class:

WekaFormatterFactory

public static class WekaFormatterFactory.WekaFormatter
extends BaseSparseDataFormatter

Field Summary

Fields

Modifier and Type	Field and Description
static String	CLASS
static String	INSTANCE_ID

Fields inherited from class org.apache.ctakes.ytex.kernel.BaseSparseDataFormatter

exportProperties, kernelUtil, labelToClassIndexMap, maxAttributeIndex, nominalAttributeMap, numericAttributeMap, outdir

Fields inherited from interface org.apache.ctakes.ytex.kernel.SparseDataFormatter

ATTR_INSTANCE_ID, SCOPE, SCOPE_FOLD, SCOPE_LABEL

Constructor Summary

Constructors

Constructor and Description
WekaFormatter(KernelUtil kernelUtil)

Method Summary

Modifier and Type	Method and Description
void	clearFold() clear all data structures set up during initializeFold
void	clearLabel()
void	exportFold(SparseData sparseData, SortedMap<Long,String> sortedMap, boolean train, String label, Integer run, Integer fold) export the fold train/test set.
protected void	initializeAttributes(SparseData bagOfWordsData, SortedSet<String> classNames) initialize attributes
void	initializeExport(InstanceData instanceLabel, Properties properties, SparseData sparseData) get needed properties out of outdir.
void	initializeFold(SparseData sparseData, String label, Integer run, Integer fold, SortedMap<Boolean,SortedMap<Long,String>> foldInstanceLabelMap) initialize data structures for the fold that will be exported.
weka.core.Instances	initializeInstances(SparseData sparseData, SortedMap<Long,String> instanceClasses, boolean train, String label, Integer run, Integer fold) initialize the weka Instances
void	initializeLabel(String label, SortedMap<Integer,SortedMap<Integer,SortedMap<Boolean,SortedMap<Long,String>>>> labelInstances, Properties properties, SparseData sparseData) initialize attributes on a per-label basis even if the data is the same across all labels.

Methods inherited from class org.apache.ctakes.ytex.kernel.BaseSparseDataFormatter

addNumericAttribute, exportAttributeNames, exportAttributeNames, exportSparseMatrix, exportSparseRow, getSparseLineValues, updateLabelClassMapTransductive

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CLASS

public static final String CLASS

See Also:

Constant Field Values

INSTANCE_ID

public static final String INSTANCE_ID

See Also:

Constant Field Values

Constructor Detail

WekaFormatter

public WekaFormatter(KernelUtil kernelUtil)

Method Detail

clearFold

public void clearFold()

Description copied from interface: SparseDataFormatter

clear all data structures set up during initializeFold

clearLabel

public void clearLabel()

exportFold

public void exportFold(SparseData sparseData,
                       SortedMap<Long,String> sortedMap,
                       boolean train,
                       String label,
                       Integer run,
                       Integer fold)
                throws IOException

Description copied from interface: SparseDataFormatter

export the fold train/test set. called once per train/test set, 2x per fold.

Throws:

IOException

initializeAttributes

protected void initializeAttributes(SparseData bagOfWordsData,
                                    SortedSet<String> classNames)

initialize attributes

Parameters:

bagOfWordsData -

classNames -

initializeExport

public void initializeExport(InstanceData instanceLabel,
                             Properties properties,
                             SparseData sparseData)
                      throws IOException

Description copied from class: BaseSparseDataFormatter

get needed properties out of outdir. convert class names into integers for libsvm. attempt to parse the class name into an integer. if this fails, use an index that we increment. index corresponds to class name's alphabetical order.

Specified by:

initializeExport in interface SparseDataFormatter

Overrides:

initializeExport in class BaseSparseDataFormatter

Throws:

IOException

initializeFold

public void initializeFold(SparseData sparseData,
                           String label,
                           Integer run,
                           Integer fold,
                           SortedMap<Boolean,SortedMap<Long,String>> foldInstanceLabelMap)
                    throws IOException

Description copied from interface: SparseDataFormatter

initialize data structures for the fold that will be exported. called before export.

Throws:

IOException

initializeInstances

public weka.core.Instances initializeInstances(SparseData sparseData,
                                               SortedMap<Long,String> instanceClasses,
                                               boolean train,
                                               String label,
                                               Integer run,
                                               Integer fold)
                                        throws IOException

initialize the weka Instances

Parameters:

arffRelation -

sql -

classLabels -

idfMap -

docLengthMap -

Returns:

Throws:

IOException

initializeLabel

public void initializeLabel(String label,
                            SortedMap<Integer,SortedMap<Integer,SortedMap<Boolean,SortedMap<Long,String>>>> labelInstances,
                            Properties properties,
                            SparseData sparseData)
                     throws IOException

initialize attributes on a per-label basis even if the data is the same across all labels. The class ids might be different for different labels.

Throws:

IOException