1. Describe your evaluation methodology for the AI capabilities offered, including which evaluations are run pre-release versus continuously, and who designs them.
Why it matters. Buyers need to know whether quality claims rest on a disciplined, repeatable evaluation process or on ad-hoc internal testing.
- Distinguishes pre-release, release-gate, and continuous evaluations
- Names specific evaluation suites (internal and external) and describes their cadence
- Identifies a dedicated evaluation team or function separate from model development
- Conflates QA testing with model evaluation
- No standing evaluation suite; testing is per-release and ad hoc
- Evaluation design owned solely by the team that ships the model