CIOPages
All RFP questions

RFP Questions · AI Governance

AI cost predictability & FinOps questions to ask a software vendor

95 ai cost predictability & finops questions for the RFI, the RFP and the finalists, with scoring guidance, in one Excel workbook.

What this module is for

These are the ai cost predictability & finops questions to put to any software vendor, whatever the product does. Add them to an RFP next to the questions about the product itself.

What it covers. Questions on controlling AI spend: token and compute metering, cost forecasting, budgets and caps, attribution to teams and projects, and optimization options.

A selection usually runs in three rounds. The module has questions for each:

  • RFI, to the long list. 31 questions screen out vendors that fall short.
  • RFP, to the shortlist. 32 questions ask for detail.
  • Deep dive, to the finalists. 32 questions ask for evidence.

Each question comes with why it matters, what a good answer looks like and the red flags. The workbook scores the answers 0 to 5, weights them and totals them by round and section.

3 questions from the module

From the RFI round. The first shows part of the guide each question carries; the workbook adds follow-ups, a response format, a weight and a score column.

1. Provide a comprehensive list of every billable unit your platform meters, and describe the metering mechanism for each. Include units such as input/output/cached tokens, embeddings, image/audio units, fine-tuning, tool calls, retrieval operations, and other agent-step actions. For each unit, specify whether it appears on the invoice or is visible only in usage reports.

Why it matters. AI products bill in heterogeneous units that don't map to traditional license SKUs. Buyers need a complete inventory of billable units to forecast spend. Agentic workflows can multiply costs through chained tool calls and retrievals, so visibility into the cost of each step is critical, not just the top-level request, to avoid significant hidden costs.

Good answer
  • Provides a complete, well-defined list of all billable units.
  • Clearly distinguishes metering for different token types (input, output, cached).
  • Details per-step accounting for agentic workflows (tool calls, retrieval).
Red flags
  • Vague answer referring only to 'tokens' or 'API calls'.
  • Fails to distinguish costs for tool calls or agent steps from primary generation.
  • Only meters the top-level user request in an agentic workflow.

2. What tooling do you provide to forecast monthly or quarterly spend based on a customer's historical usage patterns?

Why it matters. Budget owners need predictive tooling to set guardrails and justify spend internally. Without forecasting, AI budgets become reactive and unpredictable, hindering adoption.

3. What automated cost-optimization recommendations does your platform provide (e.g. 'this workload could use a cheaper model', 'prompt caching would save X%', 'batch API eligible')?

Why it matters. Vendor-side recommendations capture optimizations the customer might miss. The answer shows whether the vendor recommends options that lower the customer's spend, such as a cheaper model.

What the module covers

  • Unit accounting (tokens, embeddings, agent steps) (33)
  • Cost prediction & budgeting tooling (18)
  • Cost-optimization recommendations (18)
  • Per-team, per-project, per-workload attribution (16)

This module is one of 7 in AI Governance. All 7 in one workbook: $499

Questions about this module

How many ai cost predictability & finops questions are there?

95: 31 for the RFI stage, 32 for the RFP and 32 deep-dive questions for the finalists.

What comes with each question?

Why it matters, what a good answer looks like, the red flags, follow-up questions, the response format, whether most buyers treat it as mandatory, and a suggested weight for scoring.

Which license do I need?

The Enterprise License covers any number of evaluations inside one organization. The Consultancy License covers use with any number of clients. Neither allows reselling or republishing the questions.

Included in these RFP packages

Each package carries this module's screening questions next to its questions about the software.

Related

Keep reading

Buyer Guide
Cloud Cost Management & FinOps
Free calculator
Cloud Egress Cost Calculator

An Excel calculator for cloud egress cost, the break-even and payback for a dedicated link, and a month-by-month projection.

Free model
AI Unit Economics Model

An Excel model of the cost of one completed task for an AI feature, against today's cost, with break-even volume and sensitivity to price and retries.