com.articulate.sigma

Class InferenceTestSuite

java.lang.Object

com.articulate.sigma.InferenceTestSuite

public class InferenceTestSuite
extends Object

A framework for doing a series of assertions and queries, and for comparing the actual result of queries against an expected result. Also will keep track of the time needed for each query. Tests are expected in files with a .tq extension contained in a directory specified by the "inferenceTestDir" parameter, and results are provided in the same directory with a .res extension. The test files contain legal KIF expressions including several kinds of meta-information. Meta-predicates include (note ), (query ), and (answer ..). There may be only one note and query statements, but there may be several answer statements, if multiple binding sets are expected. Comments are allowed in test files, and are signified by a ';', after which all content on the line is ignored. Note that since answers are provided in an ordered list, without reference to their respective variable names, that the inference engine is assumed to return bindings in the same order.

Field Summary

Fields

Modifier and Type	Field and Description
static int	_DEFAULT_TIMEOUT Default timeout for queries with unspecified timeouts
static long	totalTime Total time

Constructor Summary

Constructors

Constructor and Description
InferenceTestSuite()

Method Summary

Modifier and Type	Method and Description
static void	inferenceUnitTest(String testpath, KB kb, ArrayList expectedAnswers, ArrayList<String> actualAnswers) The method will be called in InferenceTest in unit test; It takes a TQG file path, reading the kif statements and queries and expected answers; It parses E's inference output for actual answers; Note that this procedure DOES NOT delete any prior user assertions.
static void	main(String[] args) Test method
static String	test(KB kb) Convenience method that sets default parameters
static String	test(KB kb, String systemChosen, int timeout) Convenience method that sets some default parameters
static String	test(KB kb, String systemChosen, int defaultTimeout, String TPTPlocation) The main method that controls running a set of tests and returning the result as an HTML page showing test results and links to proofs.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

totalTime

public static long totalTime

Total time

_DEFAULT_TIMEOUT

public static int _DEFAULT_TIMEOUT

Default timeout for queries with unspecified timeouts

Constructor Detail

InferenceTestSuite

public InferenceTestSuite()

Method Detail

test

public static String test(KB kb)
                   throws IOException

Convenience method that sets default parameters

Throws:

IOException

test

public static String test(KB kb,
                          String systemChosen,
                          int timeout)
                   throws IOException

Convenience method that sets some default parameters

Parameters:

timeout - is a default timeout that is likely to be overwritten by a specification in the test data

Throws:

IOException

test

public static String test(KB kb,
                          String systemChosen,
                          int defaultTimeout,
                          String TPTPlocation)
                   throws IOException

The main method that controls running a set of tests and returning the result as an HTML page showing test results and links to proofs. Note that this procedure deletes any prior user assertions.

Throws:

IOException

inferenceUnitTest

public static void inferenceUnitTest(String testpath,
                                     KB kb,
                                     ArrayList expectedAnswers,
                                     ArrayList<String> actualAnswers)

The method will be called in InferenceTest in unit test; It takes a TQG file path, reading the kif statements and queries and expected answers; It parses E's inference output for actual answers; Note that this procedure DOES NOT delete any prior user assertions.

main

public static void main(String[] args)

Test method