Ethan Seefried
Author directory2026
AstroCLIMB: Astronomy Citation Linking from Illustrations - a Multimodal Benchmark and Overview of the WASP 2026 Shared Task
Felix Grezes | Atilla Kaan Alkan | Kelly Lockhart | Alberto Accomazzi | Ethan Seefried | Tirthankar Ghosal
Proceedings of the 4th Workshop on Artificial Intelligence for Scientific Publications
Felix Grezes | Atilla Kaan Alkan | Kelly Lockhart | Alberto Accomazzi | Ethan Seefried | Tirthankar Ghosal
Proceedings of the 4th Workshop on Artificial Intelligence for Scientific Publications
Scientists rely on figures to share their discoveries, but this makes the information contained in the figures difficult to parse, archive, and search. Multimodal neural-network models, designed to handle multiple types of data, promise to extract this information, but have not yet been widely tested and adopted by the astronomy community. In partnership with astroexplorer.org, we propose a novel dataset with over 100K figures and captions, and an associated task as a benchmark to evaluate a model’s multimodal capabilities. The task is to reconstruct the citation graph of astronomy papers solely from their figures and captions. AstroCLIMB was the shared task for WASP 2026. It attracted 15 participants on the open competition platform Kaggle, of which 10 submitted system papers. Results show that zero-shot methods and general purpose metrics underperform compared to finetuned methods, indicating that scientific figures are still hard to understand for currently available multimodal models. The dataset, benchmark task, and associated code are publicly available online.
TRACS: Telescope Reference Astronomy Categorization Dataset and Shared Task
Felix Grezes | Kelly Lockhart | Alberto Accomazzi | Jennifer Lynn Bartlett | Ethan Seefried | Anjali Pandiri | Tirthankar Ghosal
Proceedings of the 4th Workshop on Artificial Intelligence for Scientific Publications
Felix Grezes | Kelly Lockhart | Alberto Accomazzi | Jennifer Lynn Bartlett | Ethan Seefried | Anjali Pandiri | Tirthankar Ghosal
Proceedings of the 4th Workshop on Artificial Intelligence for Scientific Publications
To assess the scientific impact of observational facilities, Astronomers analyze publications which have made use of the data by the facility. This requires bibliographies annotating and linking data products with the literature, allowing bibliometrics to measure impact of the data. Creating bibliographies is laborious, involves specialists searching the literature for names, acronyms and identifiers, then determining how/if observations were used in those publications.
These bibliographies are useful beyond metrics: from the perspective of a research scientist, the data-literature connections provide a critical path to data discovery and access. Thus, by leveraging the efforts of librarians and archivists, we can use telescope bibliographies to support the scientific inquiry process. To this end, we introduce the TRACS: Telescope Reference and Astronomy Categorization dataset and Shared task, consisting of over 89K public English texts from space telescope bibliographies, categorized using a new, simple taxonomy based on discussion with established bibliographers.
We hope TRACS will be used to train modern Machine Learning and Artificial Intelligence models that in turn will help data curators build bibliographies. We evaluate how off-the-shelf Large Language Models perform on automatic bibliography curation as a baseline analysis. Results show the difficulty of the task and the need for custom tools.
These bibliographies are useful beyond metrics: from the perspective of a research scientist, the data-literature connections provide a critical path to data discovery and access. Thus, by leveraging the efforts of librarians and archivists, we can use telescope bibliographies to support the scientific inquiry process. To this end, we introduce the TRACS: Telescope Reference and Astronomy Categorization dataset and Shared task, consisting of over 89K public English texts from space telescope bibliographies, categorized using a new, simple taxonomy based on discussion with established bibliographers.
We hope TRACS will be used to train modern Machine Learning and Artificial Intelligence models that in turn will help data curators build bibliographies. We evaluate how off-the-shelf Large Language Models perform on automatic bibliography curation as a baseline analysis. Results show the difficulty of the task and the need for custom tools.
Enhancing Operational Safety via Agentic Dialogue Hazard Identification Analysis
Sanjay Das | Ran Elgedawy | Ethan Seefried | Ryan Burchfield | Tirthankar Ghosal
Proceedings of the 27th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Sanjay Das | Ran Elgedawy | Ethan Seefried | Ryan Burchfield | Tirthankar Ghosal
Proceedings of the 27th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Operational safety in high-stakes domains such as industrial process control, autonomous, and safety-critical systems demand reliable hazard identification. While large language models (LLMs) have shown promise in automating safety analysis tasks, single-turn, monolithic inference is brittle: it lacks the self-correction, deliberation, and contextual refinement that safety engineers apply iteratively. In this paper, we introduce HAZDIAL, a framework that investigates whether structured agentic dialogue (multi-agent, multi-turn interactions) improves the quality of NLP-based hazard identification over single-pass baselines. We systematically compare two dialogue modalities: adversarial debate and constructive discussion, and propose an genetic algorithm-based agentic interaction optimization. We evaluate all configurations against a curated golden dataset using standard classification metrics (accuracy, precision, recall, F1) and a novel dialogue metrics. This work advances the intersection of dialogue systems, multi-agent reasoning, and AI safety, providing empirical evidence for dialogue-driven hazard analysis.
REFSafE: A RAG-Enabled Framework for Predictive Risk Analysis and Automated Safety Report Generation in Mission-Critical Environments
Sanjay Das | Ran Elgedawy | Ethan Seefried | Ryan A. Burchfield | Gavin Wiggins | Dana Hewit | Sudarshan Srinivasan | Prasanna Balaprakash | Robert M. Patton | Todd Thomas | Tirthankar Ghosal
Proceedings of the 1st Workshop on Multilingual Report Generation via Retrieval Augmented Generation (RAG4Reports 2026)
Sanjay Das | Ran Elgedawy | Ethan Seefried | Ryan A. Burchfield | Gavin Wiggins | Dana Hewit | Sudarshan Srinivasan | Prasanna Balaprakash | Robert M. Patton | Todd Thomas | Tirthankar Ghosal
Proceedings of the 1st Workshop on Multilingual Report Generation via Retrieval Augmented Generation (RAG4Reports 2026)
Operational safety in mission-critical environments requires AI systems that are accurate, interpretable, and resistant to hallucination. We present an agentic Retrieval-Augmented Generation (RAG) framework, REFSafe, for grounded hazard analysis and automated safety report generation. The system integrates Large Language Models (LLMs) with structured operational data, historical incident repositories, policy documents, and external authoritative sources. Through iterative agentic reasoning, the framework retrieves, verifies, and synthesizes evidence prior to generation, enforcing citation-backed outputs with explicit source attribution (documents, links, and prior events) to ensure traceability and trust.To mitigate hallucinations and unsupported claims, all risk assessments and forecasts are constrained to retrieved evidence, with confidence signals derived from retrieval relevance and source consistency. A transparent pipeline enables subject matter experts (SMEs) to validate predictions, and provide structured feedback, forming a continuous performance calibration loop. Preliminary deployment demonstrates improved reliability in hazard detection and safety/vulnerability report generation. This work advances trustworthy, evidence-grounded AI for predictive safety intelligence in mission-critical operations.
2025
Overview of TRACS: the Telescope Reference and Astronomy Categorization Dataset & Shared Task
Felix Grezes | Jennifer Lynn Bartlett | Kelly Lockhart | Alberto Accomazzi | Ethan Seefried | Anjali Pandiri | Tirthankar Ghosal
Proceedings of the Third Workshop for Artificial Intelligence for Scientific Publications
Felix Grezes | Jennifer Lynn Bartlett | Kelly Lockhart | Alberto Accomazzi | Ethan Seefried | Anjali Pandiri | Tirthankar Ghosal
Proceedings of the Third Workshop for Artificial Intelligence for Scientific Publications
To evaluate the scientific influence of observational facilities, astronomers examine the body of publications that have utilized data from those facilities. This depends on curated bibliographies that annotate and connect data products to the corresponding literature, enabling bibliometric analyses to quantify data impact. Compiling such bibliographies is a demanding process that requires expert curators to scan the literature for relevant names, acronyms, and identifiers, and then to determine whether and how specific observations contributed to each publication. These bibliographies have value beyond impact assessment: for research scientists, explicit links between data and literature form an essential pathway for discovering and accessing data. Accordingly, by building on the work of librarians and archivists, telescope bibliographies can be repurposed to directly support scientific inquiry. In this context, we present the Telescope Reference and Astronomy Categorization Shared task (TRACS) and its accompanying dataset, which comprises more than 89,000 publicly available English-language texts drawn from space telescope bibliographies. These texts are labeled according to a new, compact taxonomy developed in consultation with experienced bibliographers.
Search