Anna Steinberg Schulten
Author directory2026
A Practitioner’s Guide to Systematic Prompt Evaluation for Information Extraction
Anna Steinberg Schulten | Malte Schierholz | Lisa Reichenbach | Frauke Kreuter | Alexander Fraser
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Anna Steinberg Schulten | Malte Schierholz | Lisa Reichenbach | Frauke Kreuter | Alexander Fraser
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Practitioners across industries increasingly use large language models to extract information from unstructured documents such as financial filings, legal contracts, and sustainability reports, yet typically rely on generic online recommendations for prompt design that lack empirical grounding in their target setting. We address this gap with a practical methodology for systematically varying individual prompt components (prompt structure, contextual information, and model selection) and measuring their effect on extraction quality. We use greenhouse gas emissions extraction from corporate sustainability reports as a case study of fixed numeric extraction from high-stakes PDF documents that vary widely in structure and presentation and are dispersed across company websites. Instantiated in a retrieval-augmented generation pipeline, our evaluation shows that best practices from industry-facing prompting guides do not always hold: a structured prompt incorporating roles, definitions, extraction rules, and JSON formatting unexpectedly underperforms a simpler question-style prompt, while the benefit of adding tabular context proves both prompt- and model-specific. We condense our evaluation procedure and findings into a practitioner’s decision guide for systematically testing design choices on task-specific data rather than adopting generic recommendations by default.
NLP for Social Good: A Survey and Outlook of Challenges, Opportunities and Responsible Deployment
Antonia Karamolegkou | Angana Borah | Eunjung Cho | Sagnik Ray Choudhury | Martina Galletti | Pranav Gupta | Oana Ignat | Priyanka Kargupta | Neema Kotonya | Hemank Lamba | Sun-Joo Lee | Arushi Mangla | Ishani Mondal | Fatima Zahra Moudakir | Deniz Nazar | Poli Nemkova | Dina Pisarevskaya | Naquee Rizwan | Nazanin Sabri | Keenan Samway | Dominik Stammbach | Anna Steinberg Schulten | David Tomás | Steven R Wilson | Bowen Yi | Jessica H Zhu | Arkaitz Zubiaga | Anders Søgaard | Alexander Fraser | Zhijing Jin | Rada Mihalcea | Joel R. Tetreault | Daryna Dementieva
Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Antonia Karamolegkou | Angana Borah | Eunjung Cho | Sagnik Ray Choudhury | Martina Galletti | Pranav Gupta | Oana Ignat | Priyanka Kargupta | Neema Kotonya | Hemank Lamba | Sun-Joo Lee | Arushi Mangla | Ishani Mondal | Fatima Zahra Moudakir | Deniz Nazar | Poli Nemkova | Dina Pisarevskaya | Naquee Rizwan | Nazanin Sabri | Keenan Samway | Dominik Stammbach | Anna Steinberg Schulten | David Tomás | Steven R Wilson | Bowen Yi | Jessica H Zhu | Arkaitz Zubiaga | Anders Søgaard | Alexander Fraser | Zhijing Jin | Rada Mihalcea | Joel R. Tetreault | Daryna Dementieva
Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Natural language processing (NLP) now shapes many aspects of our world, yet its potential for positive social impact is underexplored. This paper surveys work in “NLP for Social Good" (NLP4SG) across nine domains relevant to global development and risk agendas, summarizing principal tasks and challenges. We analyze ACL Anthology trends, finding that inclusion and AI harms attract the most research, while domains such as poverty, peacebuilding, and environmental protection remain underexplored. Guided by our review, we outline opportunities for responsible and equitable NLP and conclude with a call for cross-disciplinary partnerships and human-centered approaches to ensure that future NLP technologies advance the public good.
Climatextract: A Systematic Prompt Evaluation For Climate Information Extraction
Anna Steinberg Schulten | Malte Schierholz | Lisa Reichenbach | Frauke Kreuter | Alexander Fraser
Proceedings of the 3rd Workshop on Natural Language Processing Meets Climate Change (ClimateNLP 2026)
Anna Steinberg Schulten | Malte Schierholz | Lisa Reichenbach | Frauke Kreuter | Alexander Fraser
Proceedings of the 3rd Workshop on Natural Language Processing Meets Climate Change (ClimateNLP 2026)
Automated extraction of corporate greenhouse gas (GHG) emissions from sustainability reports is critical for climate crisis governance, yet the choice of prompt design, context provision, and model in LLM-based pipelines is largely guided by informal best-practice recommendations rather than systematic evaluation. With **Climatextract**, we assess these choices in a RAG pipeline, comparing closed-source against open-weight models, a structured "best-practice" prompt against a simple question-style prompt, and text-only against text-plus-table contexts. We find that performance is non-monotonic across model generations, a structured prompt with roles, definitions, extraction rules, and JSON formatting is significantly outperformed by a question-style prompt, and tabular context helps only in a specific model-prompt combination. A cost-benefit analysis shows that performance gains are often disproportionate to cost increases.
Beyond Dictionaries: Machine-Learned Normalization of Emission Units in Information Extraction
Lisa Reichenbach | Simon Oehler | Malte Schierholz | Anna Steinberg Schulten
Proceedings of the 3rd Workshop on Natural Language Processing Meets Climate Change (ClimateNLP 2026)
Lisa Reichenbach | Simon Oehler | Malte Schierholz | Anna Steinberg Schulten
Proceedings of the 3rd Workshop on Natural Language Processing Meets Climate Change (ClimateNLP 2026)
Sustainability reports denote greenhouse gas emissions with heterogeneous unit strings, such as abbreviations, inconsistent formatting, and scale markers. In emission extraction pipelines, these units must be normalized to a common target, e.g. t CO2e, to enable reliable comparison and aggregation of emissions across companies, reporting years, scopes, and regions. We propose a hybrid normalization approach: If a raw unit string is not found in a curated dictionary, a machine learning classifier maps noisy unit strings to normalized emission-unit categories that can then be converted to the target unit. The classifier is trained using character-level TF-IDF, lightweight string features, and LLM-assisted data augmentation. On random-splits of the augmented dataset, an ensemble model achieves approximately 95% accuracy. Additional evaluation on rare real-world unit strings indicates that supervised fallback classifiers can handle out-of-dictionary variants in climate-related information extraction.
Search
Fix author
Co-authors
- Alexander Fraser 3
- Lisa Reichenbach 3
- Malte Schierholz 3
- Frauke Kreuter 2
- Angana Borah 1
- Eunjung Cho 1
- Sagnik Ray Choudhury 1
- Daryna Dementieva 1
- Martina Galletti 1
- Pranav Gupta 1
- Oana Ignat 1
- Zhijing Jin 1
- Antonia Karamolegkou 1
- Priyanka Kargupta 1
- Neema Kotonya 1
- Hemank Lamba 1
- Sun-Joo Lee 1
- Arushi Mangla 1
- Rada Mihalcea 1
- Ishani Mondal 1
- Fatima Zahra Moudakir 1
- Deniz Nazar 1
- Poli Nemkova 1
- Simon Oehler 1
- Dina Pisarevskaya 1
- Naquee Rizwan 1
- Nazanin Sabri 1
- Keenan Samway 1
- Dominik Stammbach 1
- Anders Søgaard 1
- Joel Tetreault 1
- David Tomás 1
- Steven R Wilson 1
- Bowen Yi 1
- Jessica H Zhu 1
- Arkaitz Zubiaga 1