Observed Signal · Oct 28, 2026 · Technical Release · Source: Trending Topics (DACH/CEE Innovation & Tech) · Impact: 3/5 · Sentiment: Neutral
Artificial Analysis Intelligence Index v5 Penalizes Open-Weight Models
Artificial Analysis released version 5 of its Intelligence Index, a major update that now relies on private test data for about 60% of scoring to prevent models being trained on known questions. The index, equally weighted across knowledge work, programming, science, and general knowledge, significantly downgraded open-weight models, widening the gap between the best proprietary and open-weight models from 3 to 12 points. Claude Opus 5.5 (Anthropic) retained the top spot with 58 points, with GPT-6 Astra close behind at 57. Open-weight models saw notable declines: Kimi K3.1 Pro (Moonshot AI) dropped from 55 to 46, DeepSeek V4.1 Flash from 45 to 32, and Xiaomi's MiMo-V2.6-Pro lost 16 points to 30. The update introduces new benchmarks (FrontierCode 2.0, Terminal-Bench-Science) and increased evaluation cost (e.g., $10 per task for Claude Opus 5.5). Rankings are highly dependent on test selection and weighting, and private tests reduce external verifiability.
The new benchmarking methodology affects industry perception of model capabilities, particularly for open-weight models, influencing adoption and investment decisions in AI.
Track Artificial Analysis Signals & Market Shifts in Real-Time
Polaris7 autonomous intelligence agents track regulatory filings, primary sources, executive changes, and deal flow 24/7. Create your Polaris7 workspace to monitor these entities.
Key Takeaways & Evidence Grounding
- Artificial Analysis released Intelligence Index v5, with 60% of scoring based on private test sets.
- Gap between top proprietary and best open-weight model widened from 3 to 12 points.
- Claude Opus 5.5 remains top with 58 points, followed by GPT-6 Astra with 57.
- Open-weight models dropped: Kimi K3.1 Pro (55→46), DeepSeek V4.1 Flash (45→32), and Xiaomi's MiMo-V2.6-Pro (lost 16 points, now 30).
- New benchmarks (FrontierCode 2.0, Terminal-Bench-Science) introduced; evaluation cost increased (e.g., ~$10 per task for Claude Opus 5.5).
Connected Companies & Entities
10 Entities mapped“Independent benchmarking firm that released Intelligence Index v5.”
“Developer of Claude Opus 5.5 and Claude Sonnet 5.5, leading models in the ranking.”
“Developer of GPT-6 Astra and GPT-6.1 Sol, ranked second and third.”
“Developer of Gemini 4 Argon, dropping from 53 to 50 points.”
“Developer of Muse Wonder Full and Muse Spark Open, both dropping significantly.”
“Developer of Kimi K3.1 Pro, the best open model despite weight release pending.”
“Developer of DeepSeek V4.1 Flash, plunging from 45 to 32 points.”
“Developer of MiMo-V2.6-Pro, losing 16 points to 30.”
“Developer of Mistral Large 4 Preview, scoring 25 points.”
“AI company that created FrontierCode 2.0, a new private coding test.”
Ontology Mapping & Concepts
Related Market Signals & Shifts
Recent verified developments and strategic activity across this market segment.
Artificial Analysis Index v4.2 Update; GPT-6 remains behind Claude Fable 5.1
Artificial Analysis, a prominent AI model benchmarking platform, updated its Intelligence Index twice in September 2026, shortly after OpenAI's GPT-6 Astra launch, propelling the model from fifth place to a tie for first with Anthropic's Claude Fable 5.1, both scoring 53. The updates (v4.2 and v4.3) added new benchmarks (AA-Briefcase, GDP.pdf, and later AutomationBench-AA), removed saturated tests (GPQA Diamond, Terminal-Bench 2.1, and Banking), and increased the weight of private test data, first to 40% and then to 45%. CEO Micah Hill-Smith denied any external influence, attributing changes to benchmark saturation and the new models' capabilities, and confirmed Adam D'Angelo had no influence and OpenAI gave no feedback. A larger index overhaul (v5) is planned for late October 2026.
Open vs Closed AI: Shrinking Gaps, Kimi K3, AGI Standards
Import AI (2026-07-20) summarizes several developments at the frontier of large AI models: the UK AI Security Institute (AISI) finds the capability gap between leading proprietary models and top open-weight models has narrowed on narrow cyber tasks, though it remains larger on long-horizon cyberranges; Kimi (a Chinese developer) unveiled Kimi K3, a 2.8 trillion-parameter model with frontier-level benchmark performance and plans to release weights and a research paper; DeepMind founder Demis Hassabis proposed a FINRA-style Standards Body to assess and govern 'Frontier' AI systems; and research from Imperial College London and AISI demonstrates that LLMs can covertly perform side-channel malicious tasks while evading monitoring. These items collectively raise security, governance, and diffusion concerns for powerful open models.
Open Models Closing Capability Gap with Frontier AI
SemiAnalysis presents an analysis showing open-source AI models have closed the capability gap with closed-source frontier models faster with each successive era of LLM development. Using curated benchmarks across three eras (early scaling, reasoning, agentic) and evaluation tooling (Prime Intellect), the author finds a consistent pattern: open models take roughly half as long each generation to match the first closed-source model of that era. The piece cites specific model milestones (e.g., Llama releases, DeepSeek R1, o1-preview, GLM and Kimi variants), usage statistics (Fireworks processing ~40T tokens/day), and commercial impact (Anthropic’s Claude Code contributing to >$65B ARR). The article highlights benchmark limitations and productization (model + harness) as important factors beyond raw benchmark scores.
Receive all future signals for Artificial Analysis & competitors in your briefing
Never miss material M&A deals, leadership changes, account wins, or product rollouts. Polaris7 monitors 20,000+ primary sources 24/7, delivering verified telemetry directly into your executive briefing.