com.bbn.bue.common.evaluation

Class BinaryFScoreBootstrapStrategy<T>

java.lang.Object

com.bbn.bue.common.evaluation.BinaryFScoreBootstrapStrategy<T>

All Implemented Interfaces:

BootstrapInspector.BootstrapStrategy<Alignment<? extends T,? extends T>,Map<String,SummaryConfusionMatrix>>

@Beta
public final class BinaryFScoreBootstrapStrategy<T>
extends Object
implements BootstrapInspector.BootstrapStrategy<Alignment<? extends T,? extends T>,Map<String,SummaryConfusionMatrix>>

A bootstrap sampling strategy for precision, recall, F-score, and accuracy. This also supports breaking down the output based on the results of some provided function. An item is consider a true positive if it has an alignment in the key. Each unaligned test item is considered to be a false positive and each unaligned key item is considered to be a false negative. If a breakdown function is specified, separate results will be produced for each output of that function where the alignment is filtered to include only items with the same value from the function (e.g. to break down results by event type).

Method Summary

Methods

Modifier and Type	Method and Description
static <T> BinaryFScoreBootstrapStrategy<T>	create(String name, File outputDir)
static <T> BinaryFScoreBootstrapStrategy<T>	createBrokenDownBy(String name, com.google.common.base.Function<? super T,String> breakdownFunction, File outputDir)
BootstrapInspector.ObservationSummarizer<Alignment<? extends T,? extends T>,Map<String,SummaryConfusionMatrix>>	createObservationSummarizer()
Collection<BootstrapInspector.SummaryAggregator<Map<String,SummaryConfusionMatrix>>>	createSummaryAggregators()
BootstrapInspector.SummaryAggregator<Map<String,SummaryConfusionMatrix>>	prfAggregator()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

createBrokenDownBy

public static <T> BinaryFScoreBootstrapStrategy<T> createBrokenDownBy(String name,
                                                      com.google.common.base.Function<? super T,String> breakdownFunction,
                                                      File outputDir)

create

public static <T> BinaryFScoreBootstrapStrategy<T> create(String name,
                                          File outputDir)

createObservationSummarizer

public BootstrapInspector.ObservationSummarizer<Alignment<? extends T,? extends T>,Map<String,SummaryConfusionMatrix>> createObservationSummarizer()

Specified by:

createObservationSummarizer in interface BootstrapInspector.BootstrapStrategy<Alignment<? extends T,? extends T>,Map<String,SummaryConfusionMatrix>>

createSummaryAggregators

public Collection<BootstrapInspector.SummaryAggregator<Map<String,SummaryConfusionMatrix>>> createSummaryAggregators()

Specified by:

createSummaryAggregators in interface BootstrapInspector.BootstrapStrategy<Alignment<? extends T,? extends T>,Map<String,SummaryConfusionMatrix>>

prfAggregator

public BootstrapInspector.SummaryAggregator<Map<String,SummaryConfusionMatrix>> prfAggregator()