CIOPages
All RFP questions

RFP Questions · AI Governance

Model & data governance questions to ask a software vendor

101 model & data governance questions for the RFI, the RFP and the finalists, with scoring guidance, in one Excel workbook.

What this module is for

These are the model & data governance questions to put to any software vendor, whatever the product does. Add them to an RFP next to the questions about the product itself.

What it covers. Questions on how the vendor governs the models behind the product: versioning, notice of behavior changes, training-data lineage, model risk management and what you can see when a model changes. Applies to vendor-built, fine-tuned and third-party models.

A selection usually runs in three rounds. The module has questions for each:

  • RFI, to the long list. 25 questions screen out vendors that fall short.
  • RFP, to the shortlist. 40 questions ask for detail.
  • Deep dive, to the finalists. 36 questions ask for evidence.

Each question comes with why it matters, what a good answer looks like and the red flags. The workbook scores the answers 0 to 5, weights them and totals them by round and section.

3 questions from the module

From the RFI round. The first shows part of the guide each question carries; the workbook adds follow-ups, a response format, a weight and a score column.

1. Confirm that customers can pin usage to a specific, immutable model version identifier. If so, describe your versioning scheme and the guarantee of immutability (i.e., that underlying weights and inference configuration will not change for a pinned version).

Why it matters. Stable, pinnable model versions are foundational for production reliability. Vendors may silently swap model weights behind a stable identifier, breaking customer workflows that were validated against a prior version. This question verifies the vendor's commitment to immutability, a critical control for managing behavioral drift and ensuring repeatable outcomes.

Good answer
  • Explicitly confirms customers can pin to an immutable version identifier
  • Describes a clear versioning scheme (e.g., semantic, dated snapshots)
  • Distinguishes between immutable (pinned) versions and floating aliases (e.g., 'latest')
Red flags
  • Only offers floating aliases with no option to pin
  • Reserves the right to make silent updates behind a stable identifier
  • Ambiguous definition of what constitutes a 'version'

2. Describe the categories and sources of data used to train or fine-tune the model(s) behind your product, including any use of public web data, licensed datasets, synthetic data, and customer data.

Why it matters. Training data provenance is the basis for downstream IP, copyright, privacy, and bias risk. Buyers need a high-level disclosure to triage exposure before deeper diligence. Vendors using third-party models should disclose what they can document about the upstream provider's data.

3. List the specific model(s) that power your product, including base model name, provider, version, and whether the model is vendor-developed, fine-tuned from a third-party base, or accessed via a third-party API.

Why it matters. Buyers cannot evaluate downstream risk (data flow, sub-processors, geopolitical exposure, IP indemnification) without knowing which models are in use. Vendors who obscure this disclosure transfer unmanaged risk to the customer.

What the module covers

  • Model versioning & behavioral change (24)
  • Training data provenance & permissions (26)
  • Model lineage & dependency disclosure (20)
  • Model risk management process (31)

This module is one of 7 in AI Governance. All 7 in one workbook: $499

Questions about this module

How many model & data governance questions are there?

101: 25 for the RFI stage, 40 for the RFP and 36 deep-dive questions for the finalists.

What comes with each question?

Why it matters, what a good answer looks like, the red flags, follow-up questions, the response format, whether most buyers treat it as mandatory, and a suggested weight for scoring.

Which license do I need?

The Enterprise License covers any number of evaluations inside one organization. The Consultancy License covers use with any number of clients. Neither allows reselling or republishing the questions.

Included in these RFP packages

Each package carries this module's screening questions next to its questions about the software.

Related

Keep reading

Buyer Guide
AI Governance & Responsible AI
Free model
AI Unit Economics Model

An Excel model of the cost of one completed task for an AI feature, against today's cost, with break-even volume and sensitivity to price and retries.

Free register
AI Model Risk Register

A spreadsheet register of LLM failure modes per feature, scored by likelihood and impact, with controls and owners.