Governance & Evaluation
Evaluation Framework Policy
Purpose
Defines the standardized evaluation framework for capability and safety testing.
Scope
All models prior to release under the Model Release Policy.
Definitions
Evaluation Suite.
Policy Statements
Four domains: capability, safety, robustness (including multimodal and prompt-injection resistance), and alignment. [FIX] Each domain's minimum passing thresholds are explicitly scaled to and cite the Risk Classification table in Doc. 24, and reference specific benchmark versions per the Benchmark Methodology Policy Doc. 27. Results feed directly into the Model Card and Safety Report.
Responsibilities
AI Safety Research Lead and Research Evaluation team jointly own the framework.
Compliance Requirements
No model proceeds without a completed evaluation suite explicitly mapped to its risk level.
Enforcement
Incomplete evaluations block release.
Reporting Process
Exceptions Process
Partial evaluation for minor patch updates requires AI Safety Research Lead approval.
Review Process
Quarterly.
Contact Information
Related Policies
This policy references
Referenced by
None
