com.bbn.bue.common.evaluation

Class BrokenDownPRFAggregator

java.lang.Object

com.bbn.bue.common.evaluation.BrokenDownPRFAggregator

All Implemented Interfaces:

BootstrapInspector.SummaryAggregator<Map<String,SummaryConfusionMatrix>>, Finishable

public final class BrokenDownPRFAggregator
extends Object
implements BootstrapInspector.SummaryAggregator<Map<String,SummaryConfusionMatrix>>

If we have some metric broken down by categories which results in confusion matrices, these will print bootstrapped precision/recall/F-measure scores. Each of these is provided with an output directory (outputDir) and a name. The following outputs will be written:

• outputDir/name.bootstrapped.txt: A human readable chart with the bootstrapped percentiles for precision, recall, F1, and accuracy.
• outputDir/name.bootstrapped.csv: the same information in a machine-friendly CSV form.
• outputDir/name.bootstrapped.medians.csv: CSV for the median bootstrapped values only.
• outputDir/name.bootstrapped.raw: Machine-consumable list of all the bootstrap samples for all four metrics. This is useful for passing to gnuplot to make box and whisker graphs.

Method Summary

Methods

Modifier and Type	Method and Description
static BrokenDownPRFAggregator	create(String name, File outputDir)
void	finish()
void	observeSample(Collection<Map<String,SummaryConfusionMatrix>> observationSummaries)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

create

public static BrokenDownPRFAggregator create(String name,
                             File outputDir)

observeSample

public void observeSample(Collection<Map<String,SummaryConfusionMatrix>> observationSummaries)

Specified by:

observeSample in interface BootstrapInspector.SummaryAggregator<Map<String,SummaryConfusionMatrix>>

finish

public void finish()
            throws IOException

Specified by:

finish in interface Finishable

Throws:

IOException