Jana Sukkarieh

Also published as: Jana Z. Sukkarieh


pdf bib
Scoring Spoken Responses Based on Content Accuracy
Fei Huang | Lei Chen | Jana Sukkarieh
Proceedings of the Seventh Workshop on Building Educational Applications Using NLP


pdf bib
Building a Textual Entailment Suite for the Evaluation of Automatic Content Scoring Technologies
Jana Z. Sukkarieh | Eleanor Bolge
Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)

Automatic content scoring for free-text responses has started to emerge as an application of Natural Language Processing in its own right, much like question answering or machine translation. The task, in general, is reduced to comparing a student’s answer to a model answer. Although a considerable amount of work has been done, common benchmarks and evaluation measures for this application do not currently exist. It is yet impossible to perform a comparative evaluation or progress tracking of this application across systems ― an application that we view as a textual entailment task. This paper concentrates on introducing an Educational Testing Service-built test suite that makes a step towards establishing such a benchmark. The suite can be used as regression and performance evaluations both intra-c-rater® or inter automatic content scoring technologies. It is important to note that existing textual entailment test suites like PASCAL RTE or FraCas, though beneficial, are not suitable for our purposes since we deal with atypical naturally-occurring student responses that need to be categorized in order to serve as regression test cases.


pdf bib
Towards Agile and Test-Driven Development in NLP Applications
Jana Sukkarieh | Jyoti Kamal
Proceedings of the Workshop on Software Engineering, Testing, and Quality Assurance for Natural Language Processing (SETQA-NLP 2009)

pdf bib
Automating Model Building in c-rater
Jana Sukkarieh | Svetlana Stoyanchev
Proceedings of the 2009 Workshop on Applied Textual Inference (TextInfer)


pdf bib
Automatic Short Answer Marking
Stephen G. Pulman | Jana Z. Sukkarieh
Proceedings of the Second Workshop on Building Educational Applications Using NLP


pdf bib
Mind your language! Controlled language for inference purposes
Jana Sukkarieh
EAMT Workshop: Improving MT through other language technology tools: resources and tools for building MT