Anthropic partners with METR, SecureBio for AI safety evaluation
Anthropic has partnered with nonprofits METR and SecureBio to integrate independent evaluators into its AI safety practices, following CEO Dario Amodei's proposal and a White House accord encouraging external audits. The company has a three-tier evaluation system, with METR as the top-tier evaluator, granting six researchers employee-level access to systems, hardware, office space, and internal tools. METR can publish its own assessments without Anthropic's approval, though the company can request redactions only for narrowly defined categories like customer data. SecureBio serves as a first-tier evaluator with limited access. Anthropic is also in early discussions with Hugging Face and works with Accenture, which it funds directly, raising independence questions. This move follows recent AI agent incidents and marks a significant step toward transparency and accountability in frontier AI development.