Artificial Intuition: Efficient Classification of Scientific Abstracts

Harsh Sakhrani, Naseela Pervez, Anirudh Ravikumar, Fred Morstatter, Alexandra Graddy-Reed, Andrea Belz


Abstract
It is desirable to coarsely classify short scientific texts, such as grant or publication abstracts, for strategic insight or research portfolio management. These texts efficiently transmit dense information to experts possessing a rich body of knowledge to aid interpretation. Yet this task is remarkably difficult to automate because of brevity and the absence of context. To address this gap, we have developed a novel approach to generate and appropriately assign coarse domain-specific labels. We show that a Large Language Model (LLM) can provide metadata essential to the task, in a process akin to the augmentation of supplemental knowledge representing human intuition, and propose a workflow. As a pilot study, we use a corpus of award abstracts from the National Aeronautics and Space Administration (NASA). We develop new assessment tools in concert with established performance metrics.
Anthology ID:
2024.sdp-1.18
Volume:
Proceedings of the Fourth Workshop on Scholarly Document Processing (SDP 2024)
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Tirthankar Ghosal, Amanpreet Singh, Anita Waard, Philipp Mayr, Aakanksha Naik, Orion Weller, Yoonjoo Lee, Shannon Shen, Yanxia Qin
Venues:
sdp | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
191–201
Language:
URL:
https://aclanthology.org/2024.sdp-1.18
DOI:
Bibkey:
Cite (ACL):
Harsh Sakhrani, Naseela Pervez, Anirudh Ravikumar, Fred Morstatter, Alexandra Graddy-Reed, and Andrea Belz. 2024. Artificial Intuition: Efficient Classification of Scientific Abstracts. In Proceedings of the Fourth Workshop on Scholarly Document Processing (SDP 2024), pages 191–201, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
Artificial Intuition: Efficient Classification of Scientific Abstracts (Sakhrani et al., sdp-WS 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.sdp-1.18.pdf