Preparing for AI Agent Governance
Author: Jacob Pratt
Industry leaders have named 2025 the “year of agentic exploration,” foretelling the adoption of systems that will change how we interact, what jobs we perform, and even how we think. However, these innovations face significant hurdles: widespread AI agent adoption has been stifled by persistent reliability and security challenges, giving policymakers an opportunity to prepare thoughtfully for how to promote the benefits and protect against the risks of AI agents.
Making the right public policy decisions on AI governance, including on the institutions, policies, regulations, and tools that ensure that AI systems operate in the public interest, requires substantial research and evidence. Though there is significant research done on AI more broadly and the theoretical impacts of AI agents, we don’t yet know enough about how AI agents will be used or what impacts they may have. The key challenge for policymakers is not whether to regulate now, but how to govern AI agents while their impacts are still uncertain, and understand what evidence will be needed to make informed decisions when decisive action is needed.
In this paper, the author outline a research agenda to guide policymakers and researchers in preparing for the governance of AI agents. Structured around three core technology governance requirements for policymakers – foundational understanding, impact assessment, and intervention evaluation – we present 12 top-level questions and 45 detailed open sub-questions from literature and partner discussions that policymakers and researchers should explore. We also explore how monitoring, sandboxes, and testbeds can be an important first step for policymakers.
PAI has already started conducting research that supports this agenda, and have recently published work on prioritizing real-time failure detection and global governance. We will continue to build on this work, and look forward to collaborating with our community to advance AI agent governance.
Please click here to read the full article.
Image credit: Image by rawpixel.com on Freepik