com.bbn.bue.common.evaluation

Class BrokenDownFMeasureAggregator

java.lang.Object

com.bbn.bue.common.evaluation.BrokenDownFMeasureAggregator

All Implemented Interfaces:

BootstrapInspector.SummaryAggregator<Map<String,FMeasureCounts>>, Finishable

public final class BrokenDownFMeasureAggregator
extends Object
implements BootstrapInspector.SummaryAggregator<Map<String,FMeasureCounts>>

If we have some metric broken down by categories which results in F-measure counts, these will print bootstrapped precision/recall/F-measure scores. Each of these is provided with an output directory (outputDir) and a name. The following outputs will be written:

• outputDir/name.bootstrapped.txt: A human readable chart with the botostrapped percentiles for precision, recall, F1, and accuracy.
• outputDir/name.bootstrapped.csv: the same information in a machine-friendly CSV form.
• outputDir/name.bootstrapped.medians.csv: CSV for the median bootstrapped values only.
• outputDir/name.bootstrapped.raw: Machine-consumable list of all the bootstrap samples for all four metrics. This is useful for passing to gnuplot to make box and whisker graphs.

Method Summary

Methods

Modifier and Type	Method and Description
static BrokenDownFMeasureAggregator	create(String name, File outputDir)
void	finish()
void	observeSample(Collection<Map<String,FMeasureCounts>> observationSummaries)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

create

public static BrokenDownFMeasureAggregator create(String name,
                                  File outputDir)

observeSample

public void observeSample(Collection<Map<String,FMeasureCounts>> observationSummaries)

Specified by:

observeSample in interface BootstrapInspector.SummaryAggregator<Map<String,FMeasureCounts>>

finish

public void finish()
            throws IOException

Specified by:

finish in interface Finishable

Throws:

IOException