Observed Signal · Jul 2, 2026 · Industry Analysis · Source: Astral Codex Ten · Impact: 3/5 · Sentiment: Positive
AI Superforecasters Near Human Parity
The article examines the rapid rise of AI "superforecasters": specially scaffolded LLMs that research and produce probabilistic forecasts. Startups such as FutureSearch and Preseen claim strong returns on prediction markets and finance (e.g., FutureSearch produced a 7% forecast that US respiratory infections will halve by 2040; Preseen gave 8.8%). Metaculus benchmarking shows brand-name base models approaching crowd predictions as of May 2026, while forecasting-focused scaffolds add roughly nine months of effective model progress; scaffolded AIs are approaching top professional human forecasters and may reach parity within months. The piece discusses implications for finance, prediction markets, policy advice, and public trust, and argues that readily-available AI forecasters could democratize access to high-quality forecasting while reshaping markets where forecasting labor is valuable.
Shows LLM-based forecasting reaching near-professional human levels with tangible claims of market and finance impact; could change decision-making, prediction markets, and financial trading strategies.
Track Kalshi Signals & Market Shifts in Real-Time
Polaris7 autonomous intelligence agents track regulatory filings, primary sources, executive changes, and deal flow 24/7. Create your free Explorer workspace to monitor these entities.
Key Takeaways & Evidence Grounding
- FutureSearch produced a forecast that the chance US respiratory infections would halve by 2040 is 7%.
- Preseen answered the same question with an 8.8% probability.
- An anonymous AI superforecaster founder said their system turned $35 into $2 million on Kalshi over seven months (claimed by the founder).
- Metaculus analysis (May 2026) finds that forecasting-focused scaffolds are worth roughly nine months of base-model progress and that scaffolded AIs are closing the gap on top professional forecasters.
- In a recent Metaculus Cup, humans took first and second places while Preseen’s AI finished third, indicating humans and AIs are currently in a statistical dead heat on tournament-style forecasting.
Connected Companies & Entities
5 Entities mapped“I met an AI superforecaster startup founder who told me his AI had turned $35 into $2 million on Kalshi over seven months....”
“I met another who said they were beating the stock market by 25% with a market-neutral portfolio - of course this could be luck, but they’d ...”
“If this is true, then why aren’t all the top trading firms rushing to switch to AI? I don’t know the details, but Jane Street is building th...”
“remember when Google DeepMind used superforecasters to predict risks from one of their models?...”
“Or some tech company (Anthropic? X.AI?) might genuinely be biased....”
Ontology Mapping & Concepts
Related Market Signals & Shifts
Recent verified developments and strategic activity across this market segment.
AI Roundup: Growth Forecasts, Risks, Privacy, Adoption
A Noahpinion roundup surveys recent AI research, debates, and risks. A Forecasting Research Institute survey finds economists, AI experts, superforecasters, and the public predict similar near-term AI capability gains by 2030, but only AI experts expect a material GDP growth acceleration (up to ~4–5%). The newsletter highlights biosecurity concerns (debate over how easily AI could enable creation of effective bioweapons), accelerating offensive cyber capabilities documented by Lyptus Research, and quantum research that may lower the cost of breaking common cryptography. A paper by Lermen et al. shows LLM methods can deanonymize pseudonymous users at scale. The piece also notes signs of slowing workplace generative-AI adoption in several surveys and raises concerns about widespread, adversarial, or rent-seeking uses of AI (e.g., quant trading, automated hacking).
AI Superforecasting Could Transform FDA Drug Approvals
This guest post on Astral Codex Ten argues that AI superforecasting could transform FDA drug approval processes. The author, Josh Morrison of 1DaySooner, proposes a gradual implementation where the FDA first adds quantitative forecasts to existing decisions, such as predicting patient deaths or drug efficacy during trials. These forecasts would be checked against real-world data, eventually becoming public and then legal triggers for automatic approvals or trial progression. The post discusses the potential for reduced subjectivity, increased predictability for drug developers, and more efficient trials, while acknowledging the need for validation and calibration before full adoption.
AI Trends for 2026
The author reviews ten 2025 AI predictions, grading outcomes across reasoning models, personalization, agents, multiplayer collaboration, creative credits, content normalization, regulation, consolidation, and investor sentiment. Highlights include a shift from “bigger models” to reasoning-focused models, the unexpected arrival of GPT-5, product-layer personalization (ChatGPT Memory, Gemini profiles, Claude workspace memory), and widespread early agent adoption in customer service and developer workflows (examples cited: Intercom Fin, Shopify Sidekick, Harvey). The author argues 2026 will focus less on new primitives and more on harnessing models — standardizing tool and workflow interfaces (MCP-like protocols, LLMs.txt conventions), building robust harnesses around models, and enabling real-time multiplayer human–agent collaboration. Political signaling and capital markets (pro-AI PAC activity, possible Anthropic/OpenAI IPOs) are flagged as key uncertainties that could shape the AI decade.
Track Real-Time Market Signals & Shifts
Set up custom watchlists to receive automated, evidence-grounded executive digests whenever material signals or shifts occur across your tracked landscape.