Announcing our updated Responsible Scaling Policy

Anthropic has updated its Responsible Scaling Policy (RSP), a risk governance framework used to mitigate potential catastrophic risks from frontier AI systems. The update introduces a more flexible and nuanced approach to assessing and managing AI risks while maintaining the commitment not to train or deploy models unless adequate safeguards are implemented. Key improvements include new capability thresholds, refined processes for evaluating model capabilities and safeguard adequacy, and enhanced internal governance and external input measures. The policy focuses on catastrophic risks but also covers other areas such as misinformation, violence, hateful behavior, fraudulent practices, and broader societal impacts of AI models. The updated RSP is based on the principle of proportional protection, with safety and security measures that scale with potential risks. It defines two key Capability Thresholds: Autonomous AI Research and Development, and Chemical, Biological, Radiological, and Nuclear (CBRN) weapons assistance. The policy also includes implementation and oversight mechanisms, such as capability assessments, safeguard assessments, documentation and decision-making processes, and measures for internal governance and external input. Anthropic is actively seeking feedback on its methodologies and has shared the assessment methodology with both AI Safety Institutes and a selection of independent experts and organizations. The company is also hiring for various roles related to risk management at Anthropic.