Observed Signal · Apr 26, 2026 · Technical Release · Source: Exponential View · Impact: 4/5 · Sentiment: Positive
Intelligence Per Token: The New AI Metric
The newsletter argues that as inference compute becomes a binding constraint, the industry should compare AI models by intelligence delivered per token or per dollar rather than by a single benchmark score. The author cites a tweet from OpenAI reasoning lead Noam Brown after GPT-5.5’s rollout, and contrasts US labs’ 'more compute' culture with Chinese labs that optimize for compute scarcity. DeepSeek’s V4 model is highlighted as marginally lower-performing than GPT-5.4 but roughly 4x cheaper, illustrating a shift toward inference-efficiency. The piece notes inference costs are rising in importance (approaching ~10% of engineering headcount spend) and that compute economics will shape model design, deployment and competitiveness.
Major-model rollout (GPT-5.5) and the industry shift toward inference-efficiency materially affect model selection, deployment economics, and infrastructure decisions across AI-dependent tech sectors.
Track DeepSeek Signals & Market Shifts in Real-Time
Polaris7 autonomous intelligence agents track regulatory filings, primary sources, executive changes, and deal flow 24/7. Create your free Explorer workspace to monitor these entities.
Key Takeaways & Evidence Grounding
- OpenAI rolled out GPT-5.5 (mentioned in the newsletter).
- Noam Brown (identified as OpenAI’s reasoning research lead) tweeted that intelligence is a function of inference compute and that models should be compared by intelligence per token or per dollar.
- DeepSeek’s V4 model is described as marginally worse than GPT-5.4 but approximately 4x cheaper.
- The newsletter states inference costs are approaching about 10% of total engineering headcount spend, making inference economics material to teams and product decisions.
- Chinese AI labs are adapting model design to compute scarcity, treating compute constraints as strategic design specifications.
Connected Companies & Entities
3 Entities mappedOntology Mapping & Concepts
Related Market Signals & Shifts
Recent verified developments and strategic activity across this market segment.
Inference Reckoning: From Training to Monetization
The article argues that AI inference — not training — now dominates compute and spending, driven further by agentic, multi-step workflows that multiply token usage. Token prices have collapsed since 2023, but rising usage and 24/7 operational costs have produced multi‑million dollar monthly inference bills for some engineering teams. The piece outlines a three-tier hybrid architecture (cloud for training, private for steady inference, edge for low-latency), recommends mid-tier GPUs and software optimizations (quantization, continuous batching, speculative decoding), and promotes disaggregated inference (separating prefill from decode) as a high‑leverage change. It highlights telecom operators and NVIDIA AI Grids as emerging distributed inference capacity and cites FinOps adoption and benchmarking (throughput, cost-per-token) as central to managing the new economics.
AI Intelligence Becoming Commoditized in Enterprise
The newsletter argues that AI inference is shifting from scarce frontier models to abundant, cheaper models, and that the economic value is moving to the software and orchestration layers above models. It cites a UBS finding that many companies are switching to lower‑cost and open‑source models, Coinbase’s internal efforts to cut AI spend while token usage grows, Hugging Face surpassing $100M ARR, and JPM notes about Amazon offering low-cost open models and NVIDIA partnering with PC makers. The piece warns that U.S. government restrictions on access to frontier models (e.g., GPT-5.6 / Anthropic controls) will accelerate enterprises’ desire to own more of their AI stack. The author recommends planning multimodel workflows focused on routing, governance, caching, private context, and private evals as control becomes the primary enterprise differentiator.
The Weird Economics of AI Tokens
The article analyzes how modern AI billing and infrastructure have made “tokens” the primary economic unit of intelligence. It explains that tokens (pieces of text processed by models) are a useful billing abstraction but differ widely in computational cost and economic value: input vs output tokens, short vs reasoning-heavy requests, and token usage vs usefulness. The piece describes data centers as “token factories,” highlights risks from subscription and context-window costs, and argues that model routing, token observability, and measuring cost per useful task (not cost per token) will shape AI economics going forward.
Track Real-Time Market Signals & Shifts
Set up custom watchlists to receive automated, evidence-grounded executive digests whenever material signals or shifts occur across your tracked landscape.