Marcos Paulo C M Queiroz
Author directory2026
ParaSpeechRAG: A Benchmark for Robust Speech Retrieval under Paralinguistic and Acoustic Perturbations
Alexandre Costa Ferro Filho | Marcos Paulo C M Queiroz | Matheus Franco Medeiros | Gabriel Orlow De Oliveira Sene | Murilo Alvares Silva | Diogo Fernandes Costa Silva | Arlindo Rodrigues Galvão Filho
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Alexandre Costa Ferro Filho | Marcos Paulo C M Queiroz | Matheus Franco Medeiros | Gabriel Orlow De Oliveira Sene | Murilo Alvares Silva | Diogo Fernandes Costa Silva | Arlindo Rodrigues Galvão Filho
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Speech Retrieval-Augmented Generation (Speech RAG) systems are increasingly used in real-world settings where spoken queries vary across speakers, emotions, and acoustic conditions. However, current evaluations primarily focus on clean-condition retrieval accuracy, leaving unclear whether these systems remain semantically invariant under paralinguistic variation. We introduce ParaSpeechRAG, a counterfactual robustness benchmark that isolates non-semantic acoustic factors while preserving lexical content. The benchmark spans controlled perturbations across speaker identity, emotion and prosody, additive noise, speaking rate, and codec compression, enabling systematic evaluation of semantic invariance in speech retrieval. We evaluate three retriever families: ASR-based cascades, speech-text multimodal retrievers (CLASP), and general-purpose audio-language models (GLAP). Results reveal a consistent robustness–accuracy trade-off: multimodal retrievers achieve higher performance under clean conditions but are substantially more sensitive to paralinguistic and acoustic perturbations, particularly emotion and noise. In contrast, ASR-based cascades are more robust to these variations due to their text-centric bottleneck, though with reduced expressive capacity. These findings highlight an overlooked dimension of instability in Speech RAG systems and underscore the need for robustness-aware evaluation beyond clean-condition benchmarks.
Acessilia at Dr.DocBench 2026: Agentic Document Parsing through Canonical Tree Adjudication
Marcelo Akira Inuzuka | Marcos Paulo C M Queiroz | Jhonata Fernandes Cordeiro | Eduardo Fraga Pereira
The Proceedings of Workshop on Document Intelligence and Understanding
Marcelo Akira Inuzuka | Marcos Paulo C M Queiroz | Jhonata Fernandes Cordeiro | Eduardo Fraga Pereira
The Proceedings of Workshop on Document Intelligence and Understanding
We present Acessilia, an agentic document-parsing architecture developed for the Dr.DocBench track of the DocInsights 2026 shared task. Independent structural agents use Docling and MinerU to generate alternative canonical document trees. A Tree Differ aligns these representations using textual and spatial evidence, identifying discrepancies that are resolved by an adjudicator agent leveraging a vision-language model and visual evidence. The architecture supports hierarchical adjudication of specialised subtrees, including tables and mathematical expressions, while a deterministic serialiser converts the reconciled tree into the benchmark format. On the 509-page hidden test set, the final integrated pipeline achieves an official EvalAI overall score of 70.37, compared with 58.09 for the MinerU-only baseline, an absolute improvement of 12.28 points. Reading order shows the largest gain, increasing from 53.44 to 72.30, while text accuracy reaches 74.67 and table TEDS reaches 58.31. Formula CDM remains near zero at 0.22. These results demonstrate the effectiveness of combining complementary parser outputs through a shared canonical representation, structural alignment, and adjudication, while highlighting the need for stronger mathematical recognition and specialised processing.