Michal P. Karpowicz
Author directory2026
Query Symbolically or Retrieve Semantically? A Dataset and Method for Semi-Structured Question Answering
Mateusz Czyżnikiewicz | Ryszard Tuora | Adam Kozakiewicz | Tomasz Ziętkiewicz | Mateusz Galiński | Michał Tomasz Godziszewski | Michal P. Karpowicz | Timothy Hospedales | Cristina Cornelio
Findings of the Association for Computational Linguistics: EMNLP 2026
Mateusz Czyżnikiewicz | Ryszard Tuora | Adam Kozakiewicz | Tomasz Ziętkiewicz | Mateusz Galiński | Michał Tomasz Godziszewski | Michal P. Karpowicz | Timothy Hospedales | Cristina Cornelio
Findings of the Association for Computational Linguistics: EMNLP 2026
Retrieval-Augmented Generation (RAG) systems for question answering typically retrieve evidence by semantic similarity between the query and document chunks. While effective for unstructured text, this approach is less reliable on semi-structured corpora where answering may require exact filtering, aggregation, or exhaustive retrieval over structured attributes across multiple documents. Symbolic approaches support such operations, but they are often brittle on noisy natural-language corpora. We address this gap with DualGraph, a RAG framework that represents documents through two complementary views: a Textual Knowledge Graph for semantic retrieval and a Symbolic Knowledge Graph for symbolic querying over typed subject–predicate–object triples. Building on these two components, we provide multiple strategies for selecting or combining semantic and symbolic evidence. We also introduce SpecsQA, a benchmark from a commercial shopping website with semi-structured product documents and manually curated questions spanning open-ended and specification-oriented retrieval. Experiments show that DualGraph consistently outperforms state-of-the-art dense-retrieval, GraphRAG, symbolic, and table-oriented baselines across question types. Code and data are available at https://github.com/corneliocristina/DualGraphRAG.
2025
Representation-based Broad Hallucination Detectors Fail to Generalize Out of Distribution
Zuzanna Dubanowska | Maciej Żelaszczyk | Michał Brzozowski | Paolo Mandica | Michal P. Karpowicz
Findings of the Association for Computational Linguistics: EMNLP 2025
Zuzanna Dubanowska | Maciej Żelaszczyk | Michał Brzozowski | Paolo Mandica | Michal P. Karpowicz
Findings of the Association for Computational Linguistics: EMNLP 2025
We critically assess the efficacy of the current SOTA in hallucination detection and find that its performance on the RAGTruth dataset is largely driven by a spurious correlation with data. Controlling for this effect, state-of-the-art performs no better than supervised linear probes, while requiring extensive hyperparameter tuning across datasets. Out-of-distribution generalization is currently out of reach, with all of the analyzed methods performing close to random. We propose a set of guidelines for hallucination detection and its evaluation.