Constructing Domain-Specific Evaluation Sets for LLM-as-a-judge

Constructing Domain-Specific Evaluation Sets for LLM-as-a-judge Ravi Shanker Raju author Swayambhoo Jain author Bo Li author Jonathan Lingjie Li author Urmish Thakker author 2024-11 text Proceedings of the 1st Workshop on Customizable NLP: Progress and Challenges in Customizing NLP for a Domain, Application, Group, or Individual (CustomNLP4U) Sachin Kumar editor Vidhisha Balachandran editor Chan Young Park editor Weijia Shi editor Shirley Anugrah Hayati editor Yulia Tsvetkov editor Noah Smith editor Hannaneh Hajishirzi editor Dongyeop Kang editor David Jurgens editor Association for Computational Linguistics Miami, Florida, USA conference publication raju-etal-2024-constructing 10.18653/v1/2024.customnlp4u-1.14 https://aclanthology.org/2024.customnlp4u-1.14/ 2024-11 167 181