Byoungjip Kim
2024
Prospector: Improving LLM Agents with Self-Asking and Trajectory Ranking
Byoungjip Kim
|
Youngsoo Jang
|
Lajanugen Logeswaran
|
Geon-Hyeong Kim
|
Yu Jin Kim
|
Honglak Lee
|
Moontae Lee
Findings of the Association for Computational Linguistics: EMNLP 2024
Large language models (LLMs) have shown the ability to solve complex decision-making tasks beyond natural language processing tasks. LLM agents based on few-shot in-context learning (ICL) achieve surprisingly high performance without training. Despite their simplicity and generalizability, ICL-based agents are limited in their ability to incorporate feedback from an environment. In this paper, we introduce Prospector, an LLM agent that consists of two complementary LLMs, an Actor and a Critic. To elicit better instruction-aligned actions from the LLM agent, we propose AskAct prompting that performs an additional self-asking step such as goal and progress checking before generating an action. Furthermore, to implicitly incorporate the environment feedback, we propose Trajectory Ranking that orders generated trajectories by predicting the expected total reward. Prospector encourages the LLM Actor to generate diverse (creative) trajectories, and harnesses the LLM Critic to select the most rewarding trajectory. On representative decision-making benchmark environments such as ALFWorld and WebShop, we empirically demonstrate that Prospector can considerably increase the success rate of given tasks, while outperforming recent advancements such as ReAct and Reflexion.
2023
On Sample-Efficient Code Generation
Hojae Han
|
Yu Jin Kim
|
Byoungjip Kim
|
Youngwon Lee
|
Kyungjae Lee
|
Kyungmin Lee
|
Moontae Lee
|
Kyunghoon Bae
|
Seung-won Hwang
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: Industry Track
Large language models often struggle to predict runtime behavior in code generation tasks, leading to a reliance on rejection sampling (best-of-n) to generate multiple code snippets then select the best. Our distinction is reducing sampling costs, without compromising generation quality. We introduce EFFICODE, a novel framework that prioritizes sampling on test problems that models can solve. We show how EFFICODE estimates solvability to optimize computational costs during multiple sampling. Based on empirical evidence, EFFICODE consistently demonstrates reduced sampling budgets while maintaining comparable code generation performance, especially when problems are challenging. In addition, utilizing EFFICODE to rank sampled code snippets also shows its effectiveness in answer code selection for reducing temporal costs, by not requiring any execution or test case generation.
Search
Co-authors
- Yu Jin Kim 2
- Moontae Lee 2
- Hojae Han 1
- Youngwon Lee 1
- Kyungjae Lee 1
- show all...