Delegating the Job Is Not the Same as Delegating the Rules
A New Benchmark Finds That Multi-Agent Systems Lose Track of a User's Limits Almost Entirely at the First Handoff
A badge reader mounted beside a locked door does one job. It checks whatever credential is held up to it right now and decides whether this particular door opens, nothing else. It has no memory of why the badge was issued, no record of what its holder promised to use it for, and no way of knowing whether someone three offices away already approved the request. That narrowness looks almost stubborn up close, but it is the whole reason the door can be trusted at all.
AI agents built to hand tasks off to other AI agents are supposed to work the same way. A user asks for something, an orchestrating agent breaks that request into smaller pieces, and specialized agents further down the chain retrieve information, call tools, or carry out the work before passing results back up. The task itself makes that trip cleanly almost every time. What a new benchmark and two companion studies keep turning up, each from a different angle, is that the boundary around the task, the specific limit a user actually agreed to, does not make the same trip nearly as reliably. And whatever gets lost tends to go missing at the very start, in the first moment someone else restates the request, rather than trickling away gradually the further the task travels.
A Referral Letter and the Tool That Faxes It
A benchmark called MasDrift, released this month, sets up exactly this kind of test [1]. Researchers built several hundred ordinary office tasks, the sort of thing an assistant might actually be asked to do, scheduling, procurement, drafting correspondence, and gave each one a matching pair, the work the user wants finished, plus one extra step the user specifically wants to approve before it happens rather than have it happen automatically. An agent asked to draft a referral letter, for instance, sits right next to the tool that would fax it off unprompted. Nothing about the setup is rigged. There is no hidden trap and no attacker anywhere in it. The only real pressure on the system is the ordinary desire to get the job done.
What decided the outcome was not which underlying model did the work, but how the work was organized. Teams structured like a company org chart, with a manager agent breaking a task down and handing pieces to specialists underneath it, finished more of what was asked than flatter teams where agents simply coordinated with each other as equals. But those same hierarchies also let the reserved step through, the fax nobody was supposed to send without checking first, far more often, and the gap between the two setups was not a small one [1]. A single agent handling the entire job alone almost never crossed that line to begin with. Whatever made the hierarchy better at finishing work looks a lot like the same thing that made it worse at respecting the limits placed on that work.
Where the Light Gets Through
A chain looks solid from a distance, but every seam is a small gap, and it is rarely the whole length of it that gives way. Adding more layers of management to these hierarchies barely improved how much work got finished, yet it kept raising how often that reserved step slipped through anyway, and nearly all of that slippage traced back to a single moment, the very first time a manager agent restated the user's request to whoever received it next [1]. It made little difference whether the chain of command was short or long. Spreading the same work across more agents side by side, rather than stacking more layers on top of each other, barely moved anything at all. The layers were the problem. The number of agents involved was not.
Nobody Attacked This System
A separate line of work arrives at a compatible idea from another direction entirely, and gives it a name, constraint drift, the tendency for a safety rule to lose its force as it moves through memory, gets handed off, crosses into a tool call, or simply becomes inconvenient once an agent is chasing the appearance of a finished task [2]. Researchers at the University of Liverpool describe several shapes this can take, a rule that gets summarized away rather than remembered precisely, a delegated task that quietly grows broader than what was actually approved, sensitive information that drifts into a conversation nobody happens to be watching, or a rule that simply becomes a cost worth paying once it stands between an agent and a finished job.
To see how much this matters outside a diagram, the same researchers replayed a large set of real multi-agent conversations drawn from healthcare, finance, legal, and corporate work, the kind of setting where a stray detail buried in an internal message can matter as much as one in the final answer. Screening only the answer a user actually sees looked, on its own, like it was working. That channel cleaned up well. But the same sensitive material kept moving freely through the messages agents send each other and the notes they leave behind in shared memory, channels nobody had been checking at all [2]. Only once every internal handoff got the same scrutiny as the final answer did that hidden leakage actually start to close.
A companion report carries the same idea out of the lab entirely, into a system already running in production. Krti Tallam describes incidents inside a live enterprise AI platform, none of them caused by anyone trying to break in [3]. In one, a session lost its connection to a specific workspace, and rather than stopping to ask, the system quietly widened out to a broader login instead, so the user kept working without the narrower boundary that login was meant to carry. In another, a workspace reported that a permission check had gone through when it actually had not, so everything downstream ran on an authorization that never really existed, while everyone involved assumed it did. What stands out about both is how unremarkable the causes were. A reasonable piece of error-handling code, written by a competent engineer trying to keep a system from grinding to a halt, was enough on its own.
Re-Checking Against the Original Ask
MasDrift's authors also tried two different ways of closing this gap, and which one actually held up says something about where a fix like this needs to live. One approach tried carrying a narrowed-down copy of the original permission along the delegation chain itself, trimming it a little at each handoff. The other ignored the chain altogether, and instead checked every pending action straight against the original request, kept on file separately from whatever the agents happened to be telling each other in the moment.
Carrying the permission down the chain worked almost perfectly at stopping the reserved action from ever happening, but it came at a real cost, blocking a large share of the work the user actually wanted done, because an agent several steps removed from the original request has no reliable way to guess what the next agent downstream will actually need [1]. Checking straight against the stored original request instead barely touched how much work got finished, while still catching nearly everything it needed to catch. The rule that sounded stricter on paper was not the one that actually held up in practice. What mattered was not how tightly a permission got worded at the moment it was created, but whether it stayed anchored to the source of the request, or was handed down through a chain that kept restating it in its own words.
What This Suggests
Three different groups spent the last several months converging on a version of the same idea from different directions. One built a benchmark out of hundreds of ordinary office tasks. One replayed real conversations pulled from a public leak dataset. One reported on incidents from inside a system already running in production. None of them needed to imagine an attacker to find the failure each was separately describing. A delegated task moves forward reliably. Whether the boundary around that task moves forward just as reliably seems to depend less on how many agents get involved, and more on where the evidence for the original limit is actually kept, and whether every agent along the way is required to check against it, rather than simply trusted to remember it.
Whether this becomes a routine part of how agent systems get built, the way login sessions eventually became something a web application checks as a matter of course rather than an afterthought, is not yet clear from three papers published within weeks of each other. What a badge reader gets right, and what a restated instruction several hops down a delegation chain tends to lose, is that it checks the credential in front of it against the source every single time, rather than trusting whoever handed the credential over to have already checked it.
References
- Z. Xu et al., "MasDrift: Benchmarking Authorization Preservation Across Multi-Agent Architectures," arXiv, 2026, [Online]
- T. Li et al., "Safe Multi-Agent Behavior Must Be Maintained, Not Merely Asserted: Constraint Drift in LLM-Based Multi-Agent Systems," arXiv, 2026, [Online]
- K. Tallam, "Authorization Propagation in Multi-Agent AI Systems: Identity Governance as Infrastructure," arXiv, 2026, [Online]
Discuss This with Our AI Experts
Have questions about implementing these insights? Schedule a consultation to explore how this applies to your business.