com.articulate.sigma

Class DB

java.lang.Object

com.articulate.sigma.DB

public class DB
extends Object

A class to interface with databases and database-like formats, such as spreadsheets.

Field Summary

Fields

Modifier and Type	Field and Description
static HashSet<String>	amenityTerms
static HashMap<String,HashMap<String,String>>	sentiment
static HashSet<String>	stopConcepts

Constructor Summary

Constructors

Constructor and Description
DB()

Method Summary

Modifier and Type	Method and Description
static HashMap<String,Integer>	addConceptSentimentScores(HashMap<String,Integer> scores, String SUMOs, int total) Add new scores to existing scores.
static HashMap<String,Integer>	computeConceptSentiment(String input) Associate individual concepts with a sentiment score
static HashMap<String,Integer>	computeConceptSentimentFromFile(String filename) Associate individual concepts with a sentiment score
static int	computeSentiment(String input) Calculate an integer sentiment value for a string of words.
static int	computeSentimentForWord(String word) Find the sentiment value for a given word, after finding the root form of the word.
static void	DiningDBImport()
static void	disambigReviews(ArrayList<Hotel> hotels)
static boolean	emptyString(String input)
void	exportTable(KB kb) Export a comma-delimited table of all the ground binary statements in the knowledge base.
static ArrayList<String>	fill(String value, int count)
void	generateDB(KB kb) Generate an SQL database from the knowledge base Tables must be defined as instances of &%DatabaseTable and must have &%localDocumentation and &%HasDatabaseColumn relations.
static ArrayList<String>	geocode(String address) Call Google's geocode API to convert an address string into a lat/lon, which is returned as an ArrayList of two String elements containing a real-number format latitude and longitude.
static HashSet<String>	getAllRest()
static ArrayList<String>	getFoodWordSenses(ArrayList<String> al)
static ArrayList<String>	getWordSenses(ArrayList<String> al)
static void	guessGender(String fname)
static void	main(String[] args) A test method
static String	parseCuisines(String cuisine, String RST_RESTAURANTNAME, String RST_RESTAURANTID)
static HashSet<String>	parseOneRestFile(String fname) A test method.
static HashSet<String>	parseRest(String menu, String placename, String price, String address, String latitude, String longitude, String phone)
void	printSpreadsheet(TreeMap rows, ArrayList relations) Print a comma-delimited matrix.
static String	printTopSUMOInReviews(ArrayList<AVPair> topSUMO)
HashMap	printTPTPDataInCSV(HashMap byProver) Print statistics in a summary form for TPTP test run data
static String	processTimeDate(String timeDate)
HashMap	processTPTPData() Read statistics for TPTP test run data
static void	readAmenities()
static ArrayList<ArrayList>	readDataInterchangeFormatFile(Reader inReader) Parse an input stream Reader from a Data Interchange Format (.dif) file into an ArrayList of ArrayLists.
static ArrayList<ArrayList>	readDataInterchangeFormatFile(String fname) Parse and load a Data Interchange Format (.dif) file into an ArrayList of ArrayLists.
static void	readSentimentArray() Fill out from a CSV file a map of word keys, and values broken down by POS, listing whether it's a positive or negative word interior hash map keys are type, POS, stemmed, polarity
static ArrayList<ArrayList<String>>	readSpreadsheet(Reader inReader, List<String> lineStartTokens, boolean quote, char delimiter) Parse the input from a Reader for a CSV file into an ArrayList of ArrayLists.
static ArrayList<ArrayList<String>>	readSpreadsheet(String fname, List lineStartTokens, boolean quote)
static ArrayList<ArrayList<String>>	readSpreadsheet(String fname, List lineStartTokens, boolean quote, char delimiter) Parse a CSV file into an ArrayList of ArrayLists.
static HashMap<String,String>	readStateAbbrevs()
static void	readStopConceptArray() Fill out from a CSV file a set of concepts that should be ignored during content extraction
static void	RearDBtoKIF()
HashMap	resortTPTPData(HashMap stats) Reorganize statistics in a summary form for TPTP test run data
static void	SUMOReviews(ArrayList<Hotel> reviews)
static void	testSentiment()
static void	testSentimentCorpus()
static void	textFileSentiment(String fname, boolean neg) Compute sentiment for each line of a text file and output as CSV.
static void	textSentiment()
static void	textSentimentByPeriod()
static ArrayList<AVPair>	topSUMOInReviews(ArrayList<Hotel> reviews) Excludes cases of where the mapping is to multiple SUMO terms
static HashMap<String,Integer>	wordSensesInReviews(ArrayList<Hotel> reviews)
static String	wordWrap(String input, int length)
static String	writeSpreadsheet(ArrayList<ArrayList<String>> values, boolean quote)
static String	writeSpreadsheetLine(ArrayList<String> al, boolean quote)
static int	writeSuoKifStatements(KB kb, String sourceFilePath) Writes to sourceFilePath all Formulae in kb that have sourceFilePath as source file.
static int	writeSuoKifStatements(Set statements, PrintWriter pw)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

sentiment

public static HashMap<String,HashMap<String,String>> sentiment

amenityTerms

public static HashSet<String> amenityTerms

stopConcepts

public static HashSet<String> stopConcepts

Constructor Detail

DB

public DB()

Method Detail

printTPTPDataInCSV

public HashMap printTPTPDataInCSV(HashMap byProver)
                           throws IOException

Print statistics in a summary form for TPTP test run data

Throws:

IOException

resortTPTPData

public HashMap resortTPTPData(HashMap stats)
                       throws IOException

Reorganize statistics in a summary form for TPTP test run data

Throws:

IOException

processTPTPData

public HashMap processTPTPData()
                        throws IOException

Read statistics for TPTP test run data

Throws:

IOException

generateDB

public void generateDB(KB kb)

Generate an SQL database from the knowledge base Tables must be defined as instances of &%DatabaseTable and must have &%localDocumentation and &%HasDatabaseColumn relations.

readSpreadsheet

public static ArrayList<ArrayList<String>> readSpreadsheet(Reader inReader,
                                                           List<String> lineStartTokens,
                                                           boolean quote,
                                                           char delimiter)

Parse the input from a Reader for a CSV file into an ArrayList of ArrayLists. If lineStartTokens is a non-empty list, all lines not starting with one of the String tokens it contains will be concatenated. ';' denotes a comment line and will be skipped

Parameters:

inReader - A reader for the file to be processed

lineStartTokens - If a List containing String tokens, all lines not starting with one of the tokens will be concatenated

quote - signifies whether to retain quotes in elements

Returns:

An ArrayList of ArrayLists

readSpreadsheet

public static ArrayList<ArrayList<String>> readSpreadsheet(String fname,
                                                           List lineStartTokens,
                                                           boolean quote,
                                                           char delimiter)

Parse a CSV file into an ArrayList of ArrayLists. If lineStartTokens is a non-empty list, all lines not starting with one of the String tokens it contains will be concatenated.

Parameters:

fname - The pathname of the CSV file to be processed

lineStartTokens - If a List containing String tokens, all lines not starting with one of the tokens will be concatenated

quote - signifies whether to retain quotes in elements

Returns:

An ArrayList of ArrayLists

readSpreadsheet

public static ArrayList<ArrayList<String>> readSpreadsheet(String fname,
                                                           List lineStartTokens,
                                                           boolean quote)

writeSpreadsheetLine

public static String writeSpreadsheetLine(ArrayList<String> al,
                                          boolean quote)

Parameters:

quote - signifies whether to quote entries from the spreadsheet

writeSpreadsheet

public static String writeSpreadsheet(ArrayList<ArrayList<String>> values,
                                      boolean quote)

Parameters:

quote - signifies whether to quote entries from the spreadsheet

readDataInterchangeFormatFile

public static ArrayList<ArrayList> readDataInterchangeFormatFile(Reader inReader)

Parse an input stream Reader from a Data Interchange Format (.dif) file into an ArrayList of ArrayLists.

Parameters:

inReader - A reader created from the .dif file to be processed

Returns:

An ArrayList of ArrayLists

readDataInterchangeFormatFile

public static ArrayList<ArrayList> readDataInterchangeFormatFile(String fname)

Parse and load a Data Interchange Format (.dif) file into an ArrayList of ArrayLists.

Parameters:

fname - The pathname of the file to be processed

Returns:

An ArrayList of ArrayLists

writeSuoKifStatements

public static int writeSuoKifStatements(Set statements,
                                        PrintWriter pw)

writeSuoKifStatements

public static int writeSuoKifStatements(KB kb,
                                        String sourceFilePath)

Writes to sourceFilePath all Formulae in kb that have sourceFilePath as source file.

Parameters:

kb - The KB from which Formulae will be written

sourceFilePath - The canonical pathname of the file to which Formulae will be written

Returns:

An int denoting the number of expressions saved to the file named by sourceFilePath

printSpreadsheet

public void printSpreadsheet(TreeMap rows,
                             ArrayList relations)

Print a comma-delimited matrix. The values of the rows are TreeMaps, whose values in turn are Strings. The ArrayList of relations forms the column headers, which are Strings.

Parameters:

rows - - the matrix

relations - - the relations that form the column header

exportTable

public void exportTable(KB kb)

Export a comma-delimited table of all the ground binary statements in the knowledge base. Only the relations that are actually used are included in the header.

Parameters:

The - knowledge base.

wordWrap

public static String wordWrap(String input,
                              int length)

emptyString

public static boolean emptyString(String input)

RearDBtoKIF

public static void RearDBtoKIF()

parseCuisines

public static String parseCuisines(String cuisine,
                                   String RST_RESTAURANTNAME,
                                   String RST_RESTAURANTID)

topSUMOInReviews

public static ArrayList<AVPair> topSUMOInReviews(ArrayList<Hotel> reviews)

Excludes cases of where the mapping is to multiple SUMO terms

Returns:

a list of attribute value pairs where the count is in the attribute and the SUMO term is the value

wordSensesInReviews

public static HashMap<String,Integer> wordSensesInReviews(ArrayList<Hotel> reviews)

Returns:

a map of all the word senses used in the reviews and a count of their appearances

SUMOReviews

public static void SUMOReviews(ArrayList<Hotel> reviews)

disambigReviews

public static void disambigReviews(ArrayList<Hotel> hotels)

Parameters:

an - ArrayList of Hotel with reviews as text

processTimeDate

public static String processTimeDate(String timeDate)

readStateAbbrevs

public static HashMap<String,String> readStateAbbrevs()

Parameters:

w - states whether to write SUMO statements

fill

public static ArrayList<String> fill(String value,
                                     int count)

DiningDBImport

public static void DiningDBImport()

getWordSenses

public static ArrayList<String> getWordSenses(ArrayList<String> al)

Returns:

a list of SUMO terms that are the best guess at classes for each word

getFoodWordSenses

public static ArrayList<String> getFoodWordSenses(ArrayList<String> al)

Returns:

a list of SUMO terms that are the best guess at classes for each word

parseRest

public static HashSet<String> parseRest(String menu,
                                        String placename,
                                        String price,
                                        String address,
                                        String latitude,
                                        String longitude,
                                        String phone)

getAllRest

public static HashSet<String> getAllRest()

geocode

public static ArrayList<String> geocode(String address)

Call Google's geocode API to convert an address string into a lat/lon, which is returned as an ArrayList of two String elements containing a real-number format latitude and longitude.

printTopSUMOInReviews

public static String printTopSUMOInReviews(ArrayList<AVPair> topSUMO)

parseOneRestFile

public static HashSet<String> parseOneRestFile(String fname)

A test method.

Parameters:

fname - has no file extension or directory

readStopConceptArray

public static void readStopConceptArray()

Fill out from a CSV file a set of concepts that should be ignored during content extraction

readSentimentArray

public static void readSentimentArray()

Fill out from a CSV file a map of word keys, and values broken down by POS, listing whether it's a positive or negative word interior hash map keys are type, POS, stemmed, polarity

computeSentiment

public static int computeSentiment(String input)

Calculate an integer sentiment value for a string of words.

computeSentimentForWord

public static int computeSentimentForWord(String word)

Find the sentiment value for a given word, after finding the root form of the word.

addConceptSentimentScores

public static HashMap<String,Integer> addConceptSentimentScores(HashMap<String,Integer> scores,
                                                                String SUMOs,
                                                                int total)

Add new scores to existing scores. Note the side effect on scores.

Returns:

a map of concept keys and integer sentiment score values

computeConceptSentimentFromFile

public static HashMap<String,Integer> computeConceptSentimentFromFile(String filename)

Associate individual concepts with a sentiment score

Returns:

a map of concept keys and integer sentiment score values

computeConceptSentiment

public static HashMap<String,Integer> computeConceptSentiment(String input)

Associate individual concepts with a sentiment score

Returns:

a map of concept keys and integer sentiment score values

readAmenities

public static void readAmenities()

textSentimentByPeriod

public static void textSentimentByPeriod()

textSentiment

public static void textSentiment()

textFileSentiment

public static void textFileSentiment(String fname,
                                     boolean neg)

Compute sentiment for each line of a text file and output as CSV.

testSentiment

public static void testSentiment()

testSentimentCorpus

public static void testSentimentCorpus()

guessGender

public static void guessGender(String fname)

main

public static void main(String[] args)

A test method