Susie Xi Rao
Author directory2026
LLMs and Reasoning in Health Insurance Policy Documents: A Dataset and Argument Graph Extraction Study
Govind Arun | Sidharth N Krishna | Susie Xi Rao | Ajo Babu George
The Proceedings of Workshop on Document Intelligence and Understanding
Govind Arun | Sidharth N Krishna | Susie Xi Rao | Ajo Babu George
The Proceedings of Workshop on Document Intelligence and Understanding
Health insurance policy documents justify coverage decisions through clinical evidence and regulatory criteria, but the underlying reasoning is buried in dense medical and legal text. A pipeline is presented that extracts argument components and relations from these documents and assembles them into directed argument graphs. A dataset of 5,230 sentences and 5,685 relations across 53 documents from Aetna, CMS, and United Healthcare is constructed along with two custom annotation tools. Six classical baselines, three fine-tuned transformer models, and three instruction-tuned LLMs are evaluated, with the LLMs assessed under zero-shot, few-shot, and chain-of-thought prompting. PubMedBERT and Legal-BERT, fine-tuned on the dataset, achieve the strongest results overall (0.731 and 0.653 Macro F1 on component classification and relation extraction, respectively). Notably, the much simpler TF-IDF + SVM baseline is competitive with these fine-tuned transformers (0.709 and 0.649 Macro F1) and outperforms the best prompted LLM by 12 and 21 F1 points respectively. The dataset and code are available at https://anonymous.4open.science/r/LLM-Driven-Argument-Mapping-3ACB/README.md
2024
Next-Gen Cleantech Solutions: Mining Insights from Media and Patent Data with Natural Language Processing (NLP) and Large Language Models (LLMs)
Guang Lu | Janna Lipenkova | Susie Xi Rao | Daniel Perruchoud
Proceedings of the 9th edition of the Swiss Text Analytics Conference
Guang Lu | Janna Lipenkova | Susie Xi Rao | Daniel Perruchoud
Proceedings of the 9th edition of the Swiss Text Analytics Conference
2023
SAINE: Scientific Annotation and Inference Engine of Scientific Research
Susie Xi Rao | Yilei Tu | Peter H. Egger
Proceedings of the 13th International Joint Conference on Natural Language Processing and the 3rd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics: System Demonstrations
Susie Xi Rao | Yilei Tu | Peter H. Egger
Proceedings of the 13th International Joint Conference on Natural Language Processing and the 3rd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics: System Demonstrations