Aaditya Pai
Author directory2026
Environment Steering: Using Data Flow Control to Improve Agent Utility and Safety
Charlie Summers | Prajwal Raghunath | Aaditya Pai | Mayur Kulkarni | Zhuo Zhang | Oliver Kennedy | Eugene Wu
Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026)
Charlie Summers | Prajwal Raghunath | Aaditya Pai | Mayur Kulkarni | Zhuo Zhang | Oliver Kennedy | Eugene Wu
Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026)
LLM agents can make unsafe tool calls even when instructed to behave safely. Existing defenses constrain agents before execution, modify tool inputs/outputs, or rely on LLM judges; these approaches may depend on model behavior or block unsafe actions without helping the agent recover. We argue that the execution environment should instead enforce safety as the agent runs and steer it toward safe alternatives when violations occur—we call this Environment Steering. We implement this by modeling the agent and harness execution state as database tables, track the record-level data flows, and check these data flows against declarative policies during runtime. When violations are detected, policy- and context-specific feedback steers the agent toward safe trajectories. On AgentDyn, this enables the agent to improve task success rate over no-defense while achieving 0% attack success rate.
PARSE: Provenance-Aware Retrieval Sanitization for Professional Domain LLM Agents
Aaditya Pai
Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026)
Aaditya Pai
Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026)
Prompt injection defenses evaluated on synthetic benchmarks do not generalize to real enterprise documents, which are longer, denser, and interleave legitimate authority language with factual content. We demonstrate this gap with a benchmark of 122 tasks across five professional domains (financial, legal, medical, scientific, DevOps) built on real retrieved documents—actual SEC filings, Federal Register rules, PubMed abstracts, arXiv papers, and GitHub postmortems—paired with LLM-generated tasks and camouflaged payloads that were not human-validated. Paraphrasing, the strongest defense on synthetic benchmarks, shows no statistically significant attack success rate reduction on real documents (p=0.500) while degrading utility from 91.8% to 82.8%. We introduce PARSE (Provenance-Aware Retrieval Sanitization), a domain-aware, fact-preserving sanitization pipeline that classifies each sentence by injection likelihood, extracts structured facts before rewriting, and verifies fact preservation via a consistency-checking loop. A directiveness gate routes 59% of real enterprise documents to a lightweight path, concentrating computational cost on high-risk documents. PARSE achieves 15.6% attack success rate—a 39% reduction versus the 25.4% baseline—at 86.9% utility, the largest reduction of any condition evaluated (h=−0.245), nominally significant (p=0.014) but not surviving correction for multiple comparisons. Practitioners should evaluate defenses on domain-matched real documents, not synthetic proxies.