A Repository of Data and Evaluation Resources for Natural Language Generation

Anja Belz, Albert Gatt


Abstract
Starting in 2007, the field of natural language generation (NLG) has organised shared-task evaluation events every year, under the Generation Challenges umbrella. In the course of these shared tasks, a wealth of data has been created, along with associated task definitions and evaluation regimes. In other contexts too, sharable NLG data is now being created. In this paper, we describe the online repository that we have created as a one-stop resource for obtaining NLG task materials, both from Generation Challenges tasks and from other sources, where the set of materials provided for each task consists of (i) task definition, (ii) input and output data, (iii) evaluation software, (iv) documentation, and (v) publications reporting previous results.
Anthology ID:
L12-1476
Volume:
Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
Month:
May
Year:
2012
Address:
Istanbul, Turkey
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Mehmet Uğur Doğan, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
4027–4032
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/807_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
Anja Belz and Albert Gatt. 2012. A Repository of Data and Evaluation Resources for Natural Language Generation. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12), pages 4027–4032, Istanbul, Turkey. European Language Resources Association (ELRA).
Cite (Informal):
A Repository of Data and Evaluation Resources for Natural Language Generation (Belz & Gatt, LREC 2012)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/807_Paper.pdf