Rasmus T. Aavang
2026
HiFi-KPI: A Dataset for Hierarchical KPI Extraction from Earnings Filings
Rasmus T. Aavang | Giovanni Rizzi | Rasmus Tjalk-Bøggild | Alexandre Iolov | Mike Zhang | Johannes Bjerva
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Rasmus T. Aavang | Giovanni Rizzi | Rasmus Tjalk-Bøggild | Alexandre Iolov | Mike Zhang | Johannes Bjerva
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Accurate tagging of earnings reports can yield significant short-term returns for stakeholders. The machine-readable inline eXtensible Business Reporting Language (iXBRL) is mandated for public financial filings. Yet, its complex, fine-grained taxonomy limits the cross-company transferability of tagged Key Performance Indicators (KPIs). To address this, we introduce the Hierarchical Financial Key Performance Indicator (HiFi-KPI) dataset, a large-scale corpus of 1.65M paragraphs and 198k unique, hierarchically organized labels linked to iXBRL taxonomies. HiFi-KPI supports multiple tasks and we evaluate three: KPI classification, KPI extraction, and structured KPI extraction. For rapid evaluation, we also release HiFi-KPI-Lite, a manually curated 2.5K-instance subset. Baselines on HiFi-KPI-Lite show that encoder-based models achieve over 0.906 macro-F1 on classification, while Large Language Models (LLMs) reach 0.440 F1 on structured extraction. Finally, a qualitative analysis reveals that extraction errors primarily relate to dates. We open-source all code and data at Anonymous.
Effective Performance Measurement: Challenges and Opportunities in KPI Extraction from Earnings Calls
Rasmus T. Aavang | Rasmus Tjalk-Bøggild | Alexandre Iolov | Giovanni Rizzi | Mike Zhang | Johannes Bjerva
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 6: Industry Track)
Rasmus T. Aavang | Rasmus Tjalk-Bøggild | Alexandre Iolov | Giovanni Rizzi | Mike Zhang | Johannes Bjerva
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 6: Industry Track)
Earnings calls are a key source of financial information about public companies. However, extracting information from these calls is difficult.Unlike the templatic filings required by the U.S. Securities and Exchange Commission (SEC) to report a company’s financial situation, earnings conference calls have no built-in labels, are unstructured, and feature conversational language.We explore this challenging domain by assessing the information captured by models trained on SEC filings and in-context learning methods. To establish a baseline, we first evaluate the generalization capabilities of SEC-trained models across established SEC datasets.To support our investigation, we introduce three novel benchmarks: (1) SEC Filings Benchmark (SECB), (2) Earnings Calls Benchmark (ECB), and ECB-A, a subset with 5,346 expert annotations to support our qualitative analysis.We find that encoder-based models struggle with the domain shift. Finally, we propose a system utilizing LLMs to perform open-ended extraction from unstructured call transcripts, verified by human evaluation (79.7% precision), providing a baseline for this valuable domain through the consistent tracking of emergent KPIs.