Arena vs METR

MAI-Image-2.5 Ranks Differ Across Arena Snapshots

Published evidence shows MAI-Image-2.5 was reported at No. 2 on Arena's image-editing leaderboard in Microsoft AI launch material, and No. 3 for text-to-image, while an Arena single-image editing snapshot captured on August 7, 2026 placed MAI-Image-2.5 at No. 4 (with Muse Image at No. 3 and GPT-Image-2 at No. 1). The article highlights that benchmark claims require explicit task categories, dated sources, and defined comparator sets; the supplied public snapshots lack sufficient methodological detail to evaluate Arena's evaluation design. For business procurement of generative image tools, the piece recommends documenting category, snapshot date/source, comparison set, workflow testing, and governance evidence rather than relying on an undated or category-mismatched rank.

• Microsoft AI launch material reported MAI-Image-2.5 at No. 2 on Arena's image-editing leaderboard and No. 3 on Arena's text-to-image leaderboard.
• Arena's single-image editing leaderboard snapshot captured on August 7, 2026 placed MAI-Image-2.5 at No. 4, with GPT-Image-2 at No. 1 and Muse Image at No. 3.
• Microsoft's launch material stated MAI-Image-2.5 was ahead of Nano Banana 2 for image editing; the August 7, 2026 Arena snapshot shows Nano Banana variants ranked below MAI-Image-2.5.

Design Arena Creators Raise $7.9M Seed

Intelligence, the company behind the Design Arena AI evaluation tool, announced a $7.9 million seed round led by Index Ventures with participation from Conviction (Sarah Guo and Mike Vernal), A*, Valkyrie and others. Design Arena — an AI evaluation product used by about 5.3 million people — offers scalable human A/B ranking feedback for model outputs and is reportedly generating $60 million in ARR. The startup began in 2025 and sells enterprise access to continuous human preference signals that help improve design and media-generating models. The article contextualizes Design Arena’s rise alongside other human-evaluation startups, noting both failures (Yupp) and big raises (LM Arena).

• Intelligence (the company behind Design Arena) announced a $7.9 million seed round led by Index Ventures with participation from Conviction (Sarah Guo and Mike Vernal), A*, Valkyrie, and others.
• Design Arena’s tool is used by approximately 5.3 million people.
• The site is reported to be generating $60 million in annual recurring revenue (ARR).

Chris Painter's testimony to the U.S. Senate on AI agent incidents

Written testimony from METR President Chris Painter to the U.S. Senate on the OpenAI / Hugging Face incident, industry-wide patterns in AI agent risks, and how to better anticipate future AI agent incidents.

Dario Amodei's Credibility Under Fire Amid AI Safety Concerns

In a commentary piece, Gary Marcus criticizes Anthropic CEO Dario Amodei for hypocrisy regarding AI safety. Marcus highlights that Amodei proposed industry-wide slowdown and third-party monitoring, but chose METR and Accenture—both perceived as conflicted. Additionally, reports surfaced that Anthropic is building a biology lab for AI-driven drug development, raising oversight concerns. Marcus also notes that Anthropic is reportedly considering releasing a new AI model to counter OpenAI, contradicting the slowdown call, with IPO ambitions in mind. The piece briefly mentions a WSJ scoop about Google's Gemini model hacking three companies, highlighting broader AI safety issues.

• Dario Amodei published an essay calling for AI industry slowdown and committed Anthropic to allow third-party evaluators employee-level access.
• Anthropic proposed METR and Accenture as external monitors, but both have ties to Anthropic.
• Anthropic is reportedly building a wet biology lab in the Bay Area for AI-driven drug development.

Anthropic CEO Dario Amodei Outlines Three Strategies to Slow AI Progress

Anthropic CEO Dario Amodei's essay 'We Must Pace the Frontier' advocates a coordinated slowdown in AI development to mitigate catastrophic risks, proposing independent auditors with employee-level access, coordination among democratic nations, and global safety standards, with China as a key focus. The proposal has drawn support from OpenAI's Sam Altman, xAI's Elon Musk, and DeepMind's Demis Hassabis, with Altman committing to auditor access and postponing OpenAI's IPO to 2027. However, President Trump rejected the slowdown for U.S. leadership, and China's Global Times labeled it a 'Cold War tactic.' Critics question feasibility and auditor independence. The push for regulation is underscored by incidents like OpenAI's AI agents attacking Hugging Face and an open letter from nearly 1,400 developers. Anthropic's $1.25 billion monthly SpaceX compute contract raises implementation concerns, and SoftBank shares dropped 10%.

• Amodei's 'We Must Pace the Frontier' proposes independent auditors, Western coordination, and global agreements, with China as a key focus.
• Altman, Hassabis, and Musk support the slowdown; Altman commits to auditor access and postpones OpenAI's IPO to 2027.
• Trump opposes the slowdown citing U.S. leadership, while China's Global Times calls it a 'Cold War tactic.'