CIOPages
All RFP questions

RFP Questions · AI Governance

Agentic safety & autonomy controls questions to ask a software vendor

94 agentic safety & autonomy controls questions for the RFI, the RFP and the finalists, with scoring guidance, in one Excel workbook.

What this module is for

These are the agentic safety & autonomy controls questions to put to any software vendor, whatever the product does. Add them to an RFP next to the questions about the product itself.

What it covers. Questions on what an AI agent in the product may do: scoped actions, tool permissions, isolation between runs and from production systems, spending and rate limits, and a way to stop it.

A selection usually runs in three rounds. The module has questions for each:

  • RFI, to the long list. 26 questions screen out vendors that fall short.
  • RFP, to the shortlist. 30 questions ask for detail.
  • Deep dive, to the finalists. 38 questions ask for evidence.

Each question comes with why it matters, what a good answer looks like and the red flags. The workbook scores the answers 0 to 5, weights them and totals them by round and section.

3 questions from the module

From the RFI round. The first shows part of the guide each question carries; the workbook adds follow-ups, a response format, a weight and a score column.

1. Describe how customers configure the set of actions an agent is permitted to take, including whether permissions can be scoped per action type rather than granted as a single bundle.

Why it matters. All-or-nothing permission models force customers to over-grant authority to agents, expanding blast radius from any single failure or prompt injection. OWASP LLM06:2025 Excessive Agency names excessive permissions as a root cause and recommends limiting permissions to the minimum necessary. This question screens vendors whose permission model is too coarse for regulated environments.

Good answer
  • Describes named permission primitives at per-action or per-tool granularity.
  • References a policy or role configuration surface (UI, API, or IaC).
  • Distinguishes read-only actions from state-changing actions.
Red flags
  • Only a single 'agent enabled' toggle exists.
  • Permissions inherit entirely from the user session with no agent-specific scoping.
  • Permission model described only in marketing language without enumerable scopes.

2. Provide a table of external tools, APIs, or systems your agents can invoke out of the box, indicating which are enabled by default.

Why it matters. The tool catalog defines the agent's reach into customer systems and the public internet. Defaults apply to every tool the customer has not reviewed. This question surfaces the baseline attack surface.

3. Describe the isolation boundary between agent runs, including whether each run executes in a separate process, container, or VM, and what state, if any, can persist between runs.

Why it matters. Cross-run contamination — memory, files, credentials, or context bleeding from one customer's run to another — is a tenancy-breaking failure. Buyers need to understand the concrete isolation primitives, not just marketing assurances.

What the module covers

  • Action scoping & per-action permissions (23)
  • Tool-use & external-system permissions (23)
  • Sandboxing & blast-radius containment (19)
  • Kill-switches & emergency controls (21)
  • Maturity and observability (8)

This module is one of 7 in AI Governance. All 7 in one workbook: $499

Questions about this module

How many agentic safety & autonomy controls questions are there?

94: 26 for the RFI stage, 30 for the RFP and 38 deep-dive questions for the finalists.

What comes with each question?

Why it matters, what a good answer looks like, the red flags, follow-up questions, the response format, whether most buyers treat it as mandatory, and a suggested weight for scoring.

Which license do I need?

The Enterprise License covers any number of evaluations inside one organization. The Consultancy License covers use with any number of clients. Neither allows reselling or republishing the questions.

Included in these RFP packages

Each package carries this module's screening questions next to its questions about the software.

Related

Keep reading

Buyer Guide
AI Agent & Agentic AI Platforms
Checklist
AI Governance & Ethics Checklist

Ensure responsible AI development and deployment across your organization.

State of Play
Data governance platforms

The annual review of this market: what changed, with answers from the vendors in it.