Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk

Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor 2010-06 Association for Computational Linguistics Los Angeles text conference publication ws-2010-naacl-hlt-2010-creating https://aclanthology.org/W10-0700/ Creating Speech and Language Data With Amazon’s Mechanical Turk Chris Callison-Burch author Mark Dredze author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication callison-burch-dredze-2010-creating https://aclanthology.org/W10-0701/ 2010-06 1 12 Corpus Creation for New Genres: A Crowdsourced Approach to PP Attachment Mukund Jha author Jacob Andreas author Kapil Thadani author Sara Rosenthal author Kathleen McKeown author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication jha-etal-2010-corpus https://aclanthology.org/W10-0702/ 2010-06 13 20 Clustering dictionary definitions using Amazon Mechanical Turk Gabriel Parent author Maxine Eskenazi author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication parent-eskenazi-2010-clustering https://aclanthology.org/W10-0703/ 2010-06 21 29 Semi-supervised Word Alignment with Mechanical Turk Qin Gao author Stephan Vogel author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication gao-vogel-2010-semi https://aclanthology.org/W10-0704/ 2010-06 30 34 Rating Computer-Generated Questions with Mechanical Turk Michael Heilman author Noah A Smith author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication heilman-smith-2010-rating https://aclanthology.org/W10-0705/ 2010-06 35 40 Crowdsourced Accessibility: Elicitation of Wikipedia Articles Scott Novotney author Chris Callison-Burch author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication novotney-callison-burch-2010-crowdsourced https://aclanthology.org/W10-0706/ 2010-06 41 44 Document Image Collection Using Amazon’s Mechanical Turk Audrey Le author Jerome Ajot author Mark Przybocki author Stephanie Strassel author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication le-etal-2010-document https://aclanthology.org/W10-0707/ 2010-06 45 52 Using Amazon Mechanical Turk for Transcription of Non-Native Speech Keelan Evanini author Derrick Higgins author Klaus Zechner author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication evanini-etal-2010-using https://aclanthology.org/W10-0708/ 2010-06 53 56 Exploring Normalization Techniques for Human Judgments of Machine Translation Adequacy Collected Using Amazon Mechanical Turk Michael Denkowski author Alon Lavie author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication denkowski-lavie-2010-exploring https://aclanthology.org/W10-0709/ 2010-06 57 61 Can Crowds Build parallel corpora for Machine Translation Systems? Vamshi Ambati author Stephan Vogel author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication ambati-vogel-2010-crowds https://aclanthology.org/W10-0710/ 2010-06 62 65 Turker-Assisted Paraphrasing for English-Arabic Machine Translation Michael Denkowski author Hassan Al-Haj author Alon Lavie author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication denkowski-etal-2010-turker https://aclanthology.org/W10-0711/ 2010-06 66 70 Annotating Large Email Datasets for Named Entity Recognition with Mechanical Turk Nolan Lawson author Kevin Eustice author Mike Perkowitz author Meliha Yetisgen-Yildiz author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication lawson-etal-2010-annotating https://aclanthology.org/W10-0712/ 2010-06 71 79 Annotating Named Entities in Twitter Data with Crowdsourcing Tim Finin author William Murnane author Anand Karandikar author Nicholas Keller author Justin Martineau author Mark Dredze author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication finin-etal-2010-annotating https://aclanthology.org/W10-0713/ 2010-06 80 88 MTurk Crowdsourcing: A Viable Method for Rapid Discovery of Arabic Nicknames? Chiara Higgins author Elizabeth McGrath author Laila Moretto author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication higgins-etal-2010-mturk https://aclanthology.org/W10-0714/ 2010-06 89 92 An Enriched MT Grammar for Under $100 Omar F Zaidan author Juri Ganitkevitch author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication zaidan-ganitkevitch-2010-enriched https://aclanthology.org/W10-0715/ 2010-06 93 98 Using the Amazon Mechanical Turk to Transcribe and Annotate Meeting Speech for Extractive Summarization Matthew Marge author Satanjeev Banerjee author Alexander Rudnicky author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication marge-etal-2010-using https://aclanthology.org/W10-0716/ 2010-06 99 107 Using Mechanical Turk to Annotate Lexicons for Less Commonly Used Languages Ann Irvine author Alexandre Klementiev author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication irvine-klementiev-2010-using https://aclanthology.org/W10-0717/ 2010-06 108 113 Opinion Mining of Spanish Customer Comments with Non-Expert Annotations on Mechanical Turk Bart Mellebeek author Francesc Benavent author Jens Grivolla author Joan Codina author Marta R. Costa-jussà author Rafael Banchs author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication mellebeek-etal-2010-opinion https://aclanthology.org/W10-0718/ 2010-06 114 121 Crowdsourcing and language studies: the new generation of linguistic data Robert Munro author Steven Bethard author Victor Kuperman author Vicky Tzuyin Lai author Robin Melnick author Christopher Potts author Tyler Schnoebelen author Harry Tily author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication munro-etal-2010-crowdsourcing https://aclanthology.org/W10-0719/ 2010-06 122 130 Not-So-Latent Dirichlet Allocation: Collapsed Gibbs Sampling Using Human Judgments Jonathan Chang author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication chang-2010-latent https://aclanthology.org/W10-0720/ 2010-06 131 138 Collecting Image Annotations Using Amazon’s Mechanical Turk Cyrus Rashtchian author Peter Young author Micah Hodosh author Julia Hockenmaier author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication rashtchian-etal-2010-collecting https://aclanthology.org/W10-0721/ 2010-06 139 147 Non-Expert Evaluation of Summarization Systems is Risky Dan Gillick author Yang Liu author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication gillick-liu-2010-non https://aclanthology.org/W10-0722/ 2010-06 148 151 Shedding (a Thousand Points of) Light on Biased Language Tae Yano author Philip Resnik author Noah A Smith author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication yano-etal-2010-shedding https://aclanthology.org/W10-0723/ 2010-06 152 158 Evaluation of Commonsense Knowledge with Mechanical Turk Jonathan Gordon author Benjamin Van Durme author Lenhart Schubert author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication gordon-etal-2010-evaluation https://aclanthology.org/W10-0724/ 2010-06 159 162 Cheap Facts and Counter-Facts Rui Wang author Chris Callison-Burch author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication wang-callison-burch-2010-cheap https://aclanthology.org/W10-0725/ 2010-06 163 167 The Wisdom of the Crowd’s Ear: Speech Accent Rating and Annotation with Amazon Mechanical Turk Stephen Kunath author Steven Weinberger author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication kunath-weinberger-2010-wisdom https://aclanthology.org/W10-0726/ 2010-06 168 171 Crowdsourcing Document Relevance Assessment with Mechanical Turk Catherine Grady author Matthew Lease author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication grady-lease-2010-crowdsourcing https://aclanthology.org/W10-0727/ 2010-06 172 179 Preliminary Experiments with Amazon’s Mechanical Turk for Annotating Medical Named Entities Meliha Yetisgen-Yildiz author Imre Solti author Fei Xia author Scott Halgrim author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication yetisgen-yildiz-etal-2010-preliminary https://aclanthology.org/W10-0728/ 2010-06 180 183 Tools for Collecting Speech Corpora via Mechanical-Turk Ian Lane author Matthias Eck author Kay Rottmann author Alex Waibel author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication lane-etal-2010-tools https://aclanthology.org/W10-0729/ 2010-06 184 187 Measuring Transitivity Using Untrained Annotators Nitin Madnani author Jordan Boyd-Graber author Philip Resnik author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication madnani-etal-2010-measuring https://aclanthology.org/W10-0730/ 2010-06 188 194 Amazon Mechanical Turk for Subjectivity Word Sense Disambiguation Cem Akkaya author Alexander Conrad author Janyce Wiebe author Rada Mihalcea author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication akkaya-etal-2010-amazon https://aclanthology.org/W10-0731/ 2010-06 195 203 Non-Expert Correction of Automatically Generated Relation Annotations Matthew R Gormley author Adam Gerber author Mary Harper author Mark Dredze author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication gormley-etal-2010-non https://aclanthology.org/W10-0732/ 2010-06 204 207 Using Mechanical Turk to Build Machine Translation Evaluation Sets Michael Bloodgood author Chris Callison-Burch author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication bloodgood-callison-burch-2010-using https://aclanthology.org/W10-0733/ 2010-06 208 211 Creating a Bi-lingual Entailment Corpus through Translations with Mechanical Turk: $100 for a 10-day Rush Matteo Negri author Yashar Mehdad author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication negri-mehdad-2010-creating https://aclanthology.org/W10-0734/ 2010-06 212 216 Error Driven Paraphrase Annotation using Mechanical Turk Olivia Buzek author Philip Resnik author Ben Bederson author 2010-06 text Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk Chris Callison-Burch editor Mark Dredze editor Association for Computational Linguistics Los Angeles conference publication buzek-etal-2010-error https://aclanthology.org/W10-0735/ 2010-06 217 221