Liying Li
Author directory2026
Beyond Accuracy: Robustness, Cost, and Governance Trade-offs for Vision-Language Models in Templated Document Extraction
Kushal Patel | Pushkal Shrivastava | Mackenzie Lees | Qirui Lu | Bhargobjyoti Saikia | Liying Li | Junlin Jiang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Kushal Patel | Pushkal Shrivastava | Mackenzie Lees | Qirui Lu | Bhargobjyoti Saikia | Liying Li | Junlin Jiang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Vision-language models (VLMs) are increasingly used to extract structured fields from business documents, yet most evaluations report accuracy on clean benchmarks and offer little guidance to practitioners choosing an approach for a given task complexity. We address this gap with a measurement-grounded study and an open-source release. Across eleven systems (three commercial, two reasoning, five open-source VLMs in pretrained and fine-tuned form, and a non-LLM OCR→regex floor) scored on a 750-document held-out pool of synthetic checks, fine-tuning on 3K samples lifts the best open-source VLMs above F1 0.98—above every zero-shot commercial system on this task—while GPT-5 leads the commercial pool on F1 and Claude Sonnet 4.5 collapses on Date. To turn these measurements into actionable choices, we introduce a practitioner-oriented selection framework that maps a task profile (quality, latency, governance, volume) to a recommended approach via filtering and total-cost minimization, illustrated on a hypothetical mid-volume document-extraction scenario.
2024
Where Am I From? Identifying Origin of LLM-generated Content
Liying Li | Yihan Bai | Minhao Cheng
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Liying Li | Yihan Bai | Minhao Cheng
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Generative models, particularly large language models (LLMs), have achieved remarkable success in producing natural and high-quality content. However, their widespread adoption raises concerns regarding copyright infringement, privacy violations, and security risks associated with AI-generated content. To address these concerns, we propose a novel digital forensics framework for LLMs, enabling the tracing of AI-generated content back to its source. This framework embeds a secret watermark directly into the generated output, eliminating the need for model retraining. To enhance traceability, especially for short outputs, we introduce a “depth watermark” that strengthens the link between content and generator. Our approach ensures accurate tracing while maintaining the quality of the generated content. Extensive experiments across various settings and datasets validate the effectiveness and robustness of our proposed framework.