Observed Signal · Sep 9, 2026 · Opinion / Analysis · Source: Gary Marcus · Impact: 2/5 · Sentiment: Negative
AI Scientists Issue Dire Warnings on Risks and Data Misuse
Gary Marcus discusses two dire warnings about AI. Terence Tao, a prominent mathematician, has shifted from optimism to deep concern about AI's impact on mathematics and science, citing risks of intellectual stagnation and data misuse. Tao alludes to the OpenAI-NYU-Anthropic Navier-Stokes controversy, where OpenAI allegedly used researchers' data without consent. Separately, Jacob Coxon, who recently left Anthropic, warns that AI could kill all humans by the end of the decade, a view echoed by Anthropic's Alignment Science lead Evan Hubinger. Marcus expresses skepticism about extinction but acknowledges the lack of a serious safety plan. The article highlights growing distrust in AI companies and the potential end of open science.
The article discusses AI safety concerns and data misuse but is opinion-based and not directly related to AdTech/MarTech operations.
Track OpenAI Signals & Market Shifts in Real-Time
Polaris7 autonomous intelligence agents track regulatory filings, primary sources, executive changes, and deal flow 24/7. Create your free Explorer workspace to monitor these entities.
Key Takeaways & Evidence Grounding
- Terence Tao, a leading mathematician, has expressed deep concerns about AI's impact on mathematics and science.
- OpenAI spent $22.5 million on the Navier-Stokes research and cannot rule out using de-identified user data to improve models.
- Jacob Coxon, who recently left Anthropic, warned that AI could kill all humans by the end of the decade.
- Evan Hubinger, Anthropic's Alignment Science lead, stated he believes there is >10% chance AI could kill all humans within the next decade.
- The article was published on September 9, 2026.
Connected Companies & Entities
2 Entities mapped“OpenAI rushed to scoop Alpöge and Buckmaster, spending $22.5 million in the process, possibly using their data....”
“Jacob Coxon, who just left Anthropic, warns about AI risks....”
Ontology Mapping & Concepts
Related Market Signals & Shifts
Recent verified developments and strategic activity across this market segment.
AI Pioneers Weigh In on Existential Risks
A series of stark AI safety warnings has emerged from researchers at major labs like Anthropic, OpenAI, and Google DeepMind. AI pioneers, including Yoshua Bengio, Geoffrey Hinton, and Aidan Gomez, have shared their views on the risks. Bengio warns that AI systems already possess hacking skills and persuasive powers that could be harmful, and that current mitigation efforts may only hide misalignment. Hinton stated that a 10% chance of AI causing human extinction within a decade is not unreasonable, citing risks from biological and computer viruses and cyber attacks. Gomez called AI models the most potent cyber weapon ever created, emphasizing that weak container security allows breakout events, and that policymakers should not solely be influenced by big tech companies. The warnings have sparked political debate in Washington, with President Trump opposing calls for regulation.
AI Safety Researchers Call for Slowdown Amid Extinction Warnings
Researchers at OpenAI and Anthropic are escalating calls for a slowdown in AI development, citing existential risks. Anthropic researcher Jacob Coxon resigned, accusing the labs of 'gambling with our lives.' Several employees, including Julie Steele (OpenAI) and Samuel Marks (Anthropic), publicly supported slowing down. Concerns center on recursive self-improvement (RSI), with researchers like Jasmine Wang (OpenAI) and Anna Wang (Anthropic) emphasizing the lack of a viable safety plan. OpenAI's chief scientist Jakub Pachocki warned of rapid capability jumps. Paul Christiano, former safety head at CAISI, joined OpenAI's Foundation board, warning of catastrophic loss of control. Roughly 1,400 AI researchers signed an open letter in July urging the U.S. government to pace AI development. The warnings follow recent cyber incidents linked to Anthropic's Mythos model and OpenAI models. Lawmakers are considering bills like the FRONTIER Act and the Ban Artificial Superintelligence Act. Anthropic is preparing for an IPO, but some, like David Sacks, have called for it to be paused.
Anthropic researcher quits, warns AI may kill all humans
Jacob Coxon, a 27-year-old British researcher who previously worked at OpenAI, resigned from Anthropic, publicly accusing both companies of recklessly developing AI that could pose an existential threat to humanity. His viral resignation post, with over 700k likes and 140 million views, sparked political calls for new AI safety rules and highlighted internal dissent. Coxon warned that recursive self-improvement could lead to out-of-control AI by next year, and noted colleagues using terms like 'crunchtime' and 'endgame.' Evan Hubinger from Anthropic echoed concerns, estimating a >10% chance of AI causing human extinction within a decade, while OpenAI's Jakub Pachocki urged extreme caution but supported development for defensive AI. The article also references an OpenAI model breaching Hugging Face's systems, other researchers like Samuel Marks and Jason Wolfe expressing similar worries, and notable departures including Ilya Sutskever and Mira Murati, indicating a broader trend of AI researchers leaving due to existential concerns. The UN High Commissioner for Human Rights also voiced similar concerns.
Track Real-Time Market Signals & Shifts
Set up custom watchlists to receive automated, evidence-grounded executive digests whenever material signals or shifts occur across your tracked landscape.