Nadia Verdha
Author directory2026
ACL-Verbatim: hallucination-free question answering for research
Gábor Recski | Szilveszter Tóth | Nadia Verdha | István Boros | Ádám Kovács
Proceedings of the 4th Workshop on Artificial Intelligence for Scientific Publications
Gábor Recski | Szilveszter Tóth | Nadia Verdha | István Boros | Ádám Kovács
Proceedings of the 4th Workshop on Artificial Intelligence for Scientific Publications
Researchers need efficient and reliable methods for collecting high-quality information from trusted sources, but modern tools for AI-assisted research still suffer from the tendency of Large Language Models (LLMs) to produce factually inaccurate or nonsensical output, commonly referred to as hallucinations. We apply the extractive question answering system VerbatimRAG (CITATION) to research papers in the ACL Anthology[<https://aclanthology.org/>], directly mapping user queries to verbatim text spans in retrieved documents. We contribute a novel ground truth dataset for the task of mapping user queries to relevant text spans in research papers, and use it to train and evaluate a variety of extractive models. Human annotation is performed by NLP researchers and is based on synthetic user queries generated using a custom pipeline based on the ScIRGen methodology (CITATION), paired with chunks of research papers retrieved by VerbatimRAG. On this benchmark, a 150M-parameter ModernBERT token classifier trained on silver supervision from our pipeline achieves the best word-level F1 (53.6), ahead of the strongest evaluated LLM extractor (48.7).
RuleChef: Grounding LLM Task Knowledge in Human-Editable Rules
Ádám Kovács | Nadia Verdha | Gabor Recski
Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026)
Ádám Kovács | Nadia Verdha | Gabor Recski
Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026)
We present RuleChef, a framework that uses large language models (LLMs) to generate executable rules for NLP tasks such as text classification, Named Entity Recognition (NER), or relation extraction. Rules are generated based on a task description and a set of labeled examples, then they are iteratively improved based both on additional examples and on human feedback over existing rules. RuleChef can also be used to bootstrap rules using the observed input-output pairs from any existing model for a given task. LLMs are used only at learning time, synthesizing rules and iteratively patching them based on failures measured on a held-out split. The result of this process is a fast, deterministic, and inspectable rule system. Preliminary evaluation is performed on both classification and NER tasks. We release RuleChef as open-source software under an Apache 2.0 license.