%0 Conference Proceedings %T The importance of precise tokenizing for deep grammars %A Forst, Martin %A Kaplan, Ronald M. %Y Calzolari, Nicoletta %Y Choukri, Khalid %Y Gangemi, Aldo %Y Maegaard, Bente %Y Mariani, Joseph %Y Odijk, Jan %Y Tapias, Daniel %S Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC’06) %D 2006 %8 May %I European Language Resources Association (ELRA) %C Genoa, Italy %F forst-kaplan-2006-importance %X We present a non-deterministic finite-state transducer that acts as a tokenizer and normalizer for free text that is input to a broad-coverage LFG of German. We compare the basic tokenizer used in an earlier version of the grammar and the more sophisticated tokenizer that we now use. The revised tokenizer increases the coverage of the grammar in terms of full parses from 68.3% to 73.4% on sentences 8,001 through 10,000 of the TiGer Corpus. %U http://www.lrec-conf.org/proceedings/lrec2006/pdf/172_pdf.pdf