LING573SharedTask

Repo for the LING573 Question Answering Shared Task D1 report can be found at doc/reports/D1.pdf

Results for D2 can be reproduced by running ./D2_run_all.sh D2 report can be found at doc/reports/D2.pdf

D3 Lenient Score: 0.3609 Strict Score: 0.2433

D3 report can be found at doc/reports/D3.pdf

D4 DevTest (TREC 2006) Lenient Score: 0.390364270146 Strict Score: 0.268501844668

EvalTest (TREC 2007) Lenient Score: 0.415578587723 Strict Score: 0.26704210807

D4 report can be found at doc/reports/D4.pdf

Execute the following commands to reproduce the results:

Dev Test

./GenerateParallelDevTestRunCondorScript.sh 

condor_submit parallel_run_all.cmd

./AgregateDevTestResultsAndEvaluate.sh

./GenerateParallelEvalTestRunCondorScript.sh 

condor_submit parallel_run_all.cmd

./AgregateEvalTestResultsAndEvaluate.sh

Name		Name	Last commit message	Last commit date
Latest commit History 118 Commits
CachedWebContent		CachedWebContent
devtest		devtest
doc		doc
evaltest		evaltest
outputs		outputs
processed		processed
results		results
src		src
AgregateDevTestResultsAndEvaluate.sh		AgregateDevTestResultsAndEvaluate.sh
AgregateEvalTestResultsAndEvaluate.sh		AgregateEvalTestResultsAndEvaluate.sh
AnswerQuestionForParallelProcessing.sh		AnswerQuestionForParallelProcessing.sh
D2_run_all.sh		D2_run_all.sh
EvaluateSystem.sh		EvaluateSystem.sh
GenerateParallelDevTestRunCondorScript.sh		GenerateParallelDevTestRunCondorScript.sh
GenerateParallelEvalTestRunCondorScript.sh		GenerateParallelEvalTestRunCondorScript.sh
README.md		README.md
compute_mrr.py		compute_mrr.py