OASIS: An Open-vocabulary Benchmark for Aspect-Opinion-Sentiment Extraction with Implicit-aspect Specificity

Junyeop Im, Jonghyun Park, Dong-Kyu Chae


Abstract
In e-commerce product review mining, Aspect-Based Sentiment Analysis (ABSA) aims to extract fine-grained opinions toward specific aspects in reviews. Existing ABSA benchmarks have expanded from aspect-level sentiment classification to opinion-aware tuple extraction. However, they still provide limited support for evaluating implicit aspects with fine-grained specificity. In particular, implicit aspects are often omitted, collapsed into placeholders, or mapped to predefined categories, which can obscure what reviewers actually evaluate. We introduce OASIS, a review-level Open-vocabulary benchmark for Aspect-Opinion-Sentiment (AOS) extraction with Implicit-aspect Specificity. OASIS contains 6,775 Amazon reviews across eight product domains and 21,054 annotated tuples, where implicit aspects are directly represented as contextually inferred noun phrases rather than closed-set labels. This design yields an implicit-aspect-heavy evaluation setting, with 70.10% of tuples involving implicit aspects. We evaluate a range of open-source and proprietary LLMs under fine-tuned and few-shot settings, showing that full AOS extraction remains challenging even for strong models. We further show that open-vocabulary aspect phrases in OASIS can provide task-useful information. Our benchmark and experimental code is available at: https://github.com/DILAB-HYU/OASIS.
Anthology ID:
2026.findings-emnlp.769
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
16201–16231
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.769/
DOI:
Bibkey:
Cite (ACL):
Junyeop Im, Jonghyun Park, and Dong-Kyu Chae. 2026. OASIS: An Open-vocabulary Benchmark for Aspect-Opinion-Sentiment Extraction with Implicit-aspect Specificity. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 16201–16231, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
OASIS: An Open-vocabulary Benchmark for Aspect-Opinion-Sentiment Extraction with Implicit-aspect Specificity (Im et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.769.pdf