Open Resources and Tools for the Shallow Processing of Portuguese: The TagShare Project
Florbela Barreto | António Branco | Eduardo Ferreira | Amália Mendes | Maria Fernanda Bacelar do Nascimento | Filipe Nunes | João Ricardo Silva
Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC’06)
This paper presents the TagShare project and the linguistic resources and tools for the shallow processing of Portuguese developed in its scope. These resources include a 1 million token corpus that has been accurately hand annotated with a variety of linguistic information, as well as several state of the art shallow processing tools capable of automatically producing that type of annotation. At present, the linguistic annotations in the corpus are sentence and paragraph boundaries, token boundaries, morphosyntactic POS categories, values of inflection features, lemmas and namedentities. Hence, the set of tools comprise a sentence chunker, a tokenizer, a POS tagger, nominal and verbal analyzers and lemmatizers, a verbal conjugator, a nominal inflector, and a namedentity recognizer, some of which underline several online services.
Multifunctional Computational Lexicon of Contemporary Portuguese: An Available Resource for Multitype Applications
Florbela Barreto | Raquel Amaro
Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC’04)
This paper presents some aspects of the first Portuguese frequency lexicon extracted from a corpus of large dimensions. The Multifunctional Computational Lexicon of Contemporary Portuguese (henceforth MCL) rised from the necessity of filling a gap existent in the studies of the contemporary Portuguese. Until recently, the frequency lexicons of Portuguese were of very small dimensions, such as Português Fundamental, which is constituted by 2.217 words extracted from a 700.000 word corpus and the Frequency Dictionary of Portuguese Words based on a literary corpus of 500.000 words. We describe here the main steps taken for collecting the lexical and frequency data and some of the major problems that arouse in the process. The resulting lexicon is a freely available reliable resource for several types of applications.