Compute, Latency, and Safety: Architecting Stateful Guardrails for Multi-Agent Workflows#

Purva Chiniya — Amazon Ads

• Why: Securing inter-agent handoffs is the agentic analogue of service-to-service authentication and authorization — your workload/agentic-identity interest. The threat model here (untrusted data corrupting downstream agent privileges) is a delegation/privilege-escalation problem, not just an ML one.
• What: MLOps infrastructure for securing multi-agent systems at enterprise scale: continuous, stateful red-teaming pipelines built on the open-source SecRepoBench evaluation framework, and specialized low-latency SLMs deployed as deterministic orchestration guardrails — cross-agent payloads routed through high-speed checks that catch prompt injection ("indirect orchestration exploits") and operational drift without frontier-model cost or throughput collapse. (from abstract only)
• How: Small, fast validators placed in-line on the agent-to-agent data path, evaluating state changes continuously — architecturally the same shape as a sidecar policy check in a service mesh.
• Where applicable: Enterprise multi-agent deployments; abstract-level with no scale numbers given, so treat the effectiveness claims with caution. The enforcement pattern is the transferable part.