Richard Rohwer
2016
An Annotated Corpus and Method for Analysis of Ad-Hoc Structures Embedded in Text
Eric Yeh
|
John Niekrasz
|
Dayne Freitag
|
Richard Rohwer
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
We describe a method for identifying and performing functional analysis of structured regions that are embedded in natural language documents, such as tables or key-value lists. Such regions often encode information according to ad hoc schemas and avail themselves of visual cues in place of natural language grammar, presenting problems for standard information extraction algorithms. Unlike previous work in table extraction, which assumes a relatively noiseless two-dimensional layout, our aim is to accommodate a wide variety of naturally occurring structure types. Our approach has three main parts. First, we collect and annotate a a diverse sample of “naturally” occurring structures from several sources. Second, we use probabilistic text segmentation techniques, featurized by skip bigrams over spatial and token category cues, to automatically identify contiguous regions of structured text that share a common schema. Finally, we identify the records and fields within each structured region using a combination of distributional similarity and sequence alignment methods, guided by minimal supervision in the form of a single annotated record. We evaluate the last two components individually, and conclude with a discussion of further work.
2005
New Experiments in Distributional Representations of Synonymy
Dayne Freitag
|
Matthias Blume
|
John Byrnes
|
Edmond Chow
|
Sadik Kapadia
|
Richard Rohwer
|
Zhiqiang Wang
Proceedings of the Ninth Conference on Computational Natural Language Learning (CoNLL-2005)
2004
Towards Full Automation of Lexicon Construction
Richard Rohwer
|
Dayne Freitag
Proceedings of the Computational Lexical Semantics Workshop at HLT-NAACL 2004
Search
Co-authors
- Dayne Freitag 3
- Matthias Blume 1
- John Byrnes 1
- Edmond Chow 1
- Sadik Kapadia 1
- show all...