Observed Signal · Sep 27, 2026 · Policy Update · Source: Noahpinion · Impact: 3/5 · Sentiment: Neutral
Ramez Naum doubts AI fast takeoff to superintelligence
In this essay, futurist Ramez Naum argues that a rapid 'intelligence explosion' via recursive self-improvement (RSI) is unlikely based on current data. He analyzes OpenAI's and Anthropic's internal reports, which show that AI models significantly boost research productivity but with diminishing returns. Naum estimates that the self-improvement loop is currently 5-10 times too weak to sustain itself, let alone run away. He points to gaps between benchmark performance and real-world research task success, as well as steep scaling costs. While narrow superintelligence in verifiable domains like math and coding is emerging, broad superintelligence remains distant. He calls for better data transparency from AI labs to track progress realistically.
The article provides a data-driven analysis of AI self-improvement capabilities, relevant for AI-driven advertising technologies, and sparks industry debate about realistic AI progress.
Track OpenAI Signals & Market Shifts in Real-Time
Polaris7 autonomous intelligence agents track regulatory filings, primary sources, executive changes, and deal flow 24/7. Create your free Explorer workspace to monitor these entities.
Key Takeaways & Evidence Grounding
- Ramez Naum estimates the AI self-improvement loop is 5-10x too weak to sustain itself.
- OpenAI's internal data shows models succeed on only ~15-minute research tasks at 80% success.
- Anthropic reports internal AI models autonomously complete zero AI R&D tasks.
- Anthropic estimates doubling AI progress requires 40x productivity uplift from AI assistance.
- Frontier ECI indicator gained ~16 points per year from Jan 2024 to Sep 2026.
Connected Companies & Entities
2 Entities mapped“OpenAI's internal data shows much shorter stretches of autonomous work on research tasks....”
“Anthropic also released a graph showing how Claude accelerates AI research....”
Ontology Mapping & Concepts
Related Market Signals & Shifts
Recent verified developments and strategic activity across this market segment.
AI self-improvement fears spark existential concerns at Anthropic and OpenAI
Researchers at Anthropic and OpenAI have raised fresh concerns about recursive self-improvement (RSI), where AI systems help develop more capable successors, potentially leading to rapid capability growth and loss of human control. Both companies report that autonomous model improvement is happening faster than expected. The concerns were triggered by Anthropic's alignment lead Evan Hubinger stating a >10% chance AI could kill all humans within a decade, and a colleague's resignation. OpenAI's chief scientist Jakub Pachocki warned about unpreparedness for rapid capability jumps. Researchers across both labs have echoed these warnings, emphasizing the lack of a scientific plan to address RSI risks. Anthropic outlined three possible future scenarios, including one where humans lose substantial control over AI development.
The Race to Recursive Self-Improving AI
An analysis piece published on 2026-05-26 argues that the AI conversation is shifting from AGI hype toward recursive self-improvement (RSI), which the author views as a likely industry theme by 2027. The article surveys startups and research activity — naming firms such as Anthropic, Recursive Superintelligence, DeepSeek and chip-focused players — and cites financing, alumni networks from DeepMind/OpenAI, and partnerships (e.g., Google/Blackstone) as factors accelerating enterprise AI and prospective RSI efforts. The author discusses potential economic and scientific implications, questions the commercial viability of buzzy RSI startups, and predicts 2027 as the start of a broader “Machine Economy” era driven by self-improving AI and enterprise adoption.
RSI Is the New AGI, Hard to Pin Down
The article examines the rising interest in recursive self-improvement (RSI) — AI systems that iteratively upgrade themselves — and how the term has become a catchall similar to AGI. It surveys recent projects and actors chasing RSI, including Richard Socher’s Recursive Superintelligence, Alex Karpathy’s Auto-Research work, and Adaption’s AutoScientist, while noting examples of AI systems already writing code or winning competitions (Anthropic’s Claude Code, Disarray’s agent). Experts and institutions including Google’s Sundar Pichai and Georgetown’s CSET caution that meaningful, human-free RSI remains speculative and distant, pointing to engineering, compute, verification, and alignment challenges. The piece frames RSI as a contested, imprecise milestone with significant uncertainty about timing and impact despite accelerating agentic research activity.
Track Real-Time Market Signals & Shifts
Set up custom watchlists to receive automated, evidence-grounded executive digests whenever material signals or shifts occur across your tracked landscape.