org.apache.ctakes.ytex.libsvm

Class LibSVMFormatterFactory.LibSVMFormatter

java.lang.Object

org.apache.ctakes.ytex.kernel.BaseSparseDataFormatter

org.apache.ctakes.ytex.libsvm.LibSVMFormatterFactory.LibSVMFormatter

All Implemented Interfaces:

SparseDataFormatter

Direct Known Subclasses:

SparseMatrixFormatterFactory.SparseMatrixDataFormatter, SVMLightFormatterFactory.SVMLightFormatter

Enclosing class:

LibSVMFormatterFactory

public static class LibSVMFormatterFactory.LibSVMFormatter
extends BaseSparseDataFormatter

Field Summary

Fields inherited from class org.apache.ctakes.ytex.kernel.BaseSparseDataFormatter

exportProperties, kernelUtil, labelToClassIndexMap, maxAttributeIndex, nominalAttributeMap, numericAttributeMap, outdir

Fields inherited from interface org.apache.ctakes.ytex.kernel.SparseDataFormatter

ATTR_INSTANCE_ID, SCOPE, SCOPE_FOLD, SCOPE_LABEL

Constructor Summary

Constructors

Constructor and Description
LibSVMFormatter(KernelUtil kernelUtil)

Method Summary

Modifier and Type	Method and Description
void	clearFold() clean up fold specific state
void	clearLabel()
protected List<Long>	exportDataForInstances(SparseData bagOfWordsData, SortedMap<Long,String> instanceClassMap, com.google.common.collect.BiMap<String,Integer> classToIndexMap, BufferedWriter wData, BufferedWriter wId)
protected void	exportDataForLabel(String filename, String idFilename, SparseData bagOfWordsData, SortedMap<Long,String> instanceClassMap, com.google.common.collect.BiMap<String,Integer> classToIndexMap) Export data file and id file
void	exportFold(SparseData sparseData, SortedMap<Long,String> instanceClassMap, boolean train, String label, Integer run, Integer fold) export the given train/test set
void	initializeExport(InstanceData instanceLabel, Properties properties, SparseData sparseData) get needed properties out of outdir.
void	initializeFold(SparseData sparseData, String label, Integer run, Integer fold, SortedMap<Boolean,SortedMap<Long,String>> foldInstanceLabelMap) write a file with the attribute names corresponding to the indices in the libsvm data file
void	initializeLabel(String label, SortedMap<Integer,SortedMap<Integer,SortedMap<Boolean,SortedMap<Long,String>>>> labelInstances, Properties properties, SparseData sparseData)
protected void	writeLibsvmLine(BufferedWriter wData, SortedMap<Integer,Double> instanceValues)

Methods inherited from class org.apache.ctakes.ytex.kernel.BaseSparseDataFormatter

addNumericAttribute, exportAttributeNames, exportAttributeNames, exportSparseMatrix, exportSparseRow, getSparseLineValues, updateLabelClassMapTransductive

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LibSVMFormatter

public LibSVMFormatter(KernelUtil kernelUtil)

Method Detail

initializeExport

public void initializeExport(InstanceData instanceLabel,
                             Properties properties,
                             SparseData sparseData)
                      throws IOException

Description copied from class: BaseSparseDataFormatter

get needed properties out of outdir. convert class names into integers for libsvm. attempt to parse the class name into an integer. if this fails, use an index that we increment. index corresponds to class name's alphabetical order.

Specified by:

initializeExport in interface SparseDataFormatter

Overrides:

initializeExport in class BaseSparseDataFormatter

Throws:

IOException

initializeLabel

public void initializeLabel(String label,
                            SortedMap<Integer,SortedMap<Integer,SortedMap<Boolean,SortedMap<Long,String>>>> labelInstances,
                            Properties properties,
                            SparseData sparseData)
                     throws IOException

Throws:

IOException

initializeFold

public void initializeFold(SparseData sparseData,
                           String label,
                           Integer run,
                           Integer fold,
                           SortedMap<Boolean,SortedMap<Long,String>> foldInstanceLabelMap)
                    throws IOException

write a file with the attribute names corresponding to the indices in the libsvm data file

Throws:

IOException

exportFold

public void exportFold(SparseData sparseData,
                       SortedMap<Long,String> instanceClassMap,
                       boolean train,
                       String label,
                       Integer run,
                       Integer fold)
                throws IOException

export the given train/test set

Throws:

IOException

exportDataForLabel

protected void exportDataForLabel(String filename,
                                  String idFilename,
                                  SparseData bagOfWordsData,
                                  SortedMap<Long,String> instanceClassMap,
                                  com.google.common.collect.BiMap<String,Integer> classToIndexMap)
                           throws IOException

Export data file and id file

Parameters:

filename -

idFilename -

bagOfWordsData -

instanceClassMap -

numericAttributeMap -

nominalAttributeMap -

label -

Throws:

IOException

exportDataForInstances

protected List<Long> exportDataForInstances(SparseData bagOfWordsData,
                                            SortedMap<Long,String> instanceClassMap,
                                            com.google.common.collect.BiMap<String,Integer> classToIndexMap,
                                            BufferedWriter wData,
                                            BufferedWriter wId)
                                     throws IOException

Parameters:

bagOfWordsData - data to be exported

instanceClassMap - instance ids - class name map

classToIndexMap - class name - class id map

wData - file to write data to

wId - file to write ids to

Returns:

list of instance ids corresponding to order with which they were exported

Throws:

IOException

writeLibsvmLine

protected void writeLibsvmLine(BufferedWriter wData,
                               SortedMap<Integer,Double> instanceValues)
                        throws IOException

Throws:

IOException

clearFold

public void clearFold()

clean up fold specific state

clearLabel

public void clearLabel()