Observed Signal · Oct 8, 2026 · Interview · Source: t3n · Impact: 2/5 · Sentiment: Positive
OpenAI Expert: Optimize Token Efficiency for AI Agents
In an interview with t3n, Maximilian Hudlberger, Applied AI Engineer at OpenAI, explains that despite decreasing token prices, companies' AI costs can rise significantly, especially with the increasing use of AI agents. He argues that the true measure of cost-effectiveness is not the price per token, but rather the number of tasks completed with a given budget. Unnecessary costs often arise from using the most powerful model for every task, when simpler models would suffice. Businesses should therefore think in terms of completed tasks and optimize their model selection for economic efficiency. The article highlights that the growing deployment of AI agents in enterprise workflows is driving up token consumption, making cost management a critical business factor.
The article provides practical guidance on AI cost management, relevant for companies deploying LLMs and AI agents, but is not a major industry event.
Track OpenAI Signals & Market Shifts in Real-Time
Polaris7 autonomous intelligence agents track regulatory filings, primary sources, executive changes, and deal flow 24/7. Create your free Explorer workspace to monitor these entities.
Key Takeaways & Evidence Grounding
- Maximilian Hudlberger, Applied AI Engineer at OpenAI, was interviewed by t3n.
- Token prices are falling, but overall AI costs for companies can rise, especially with AI agents.
- Cost efficiency should be measured by tasks completed per budget, not by token price alone.
- Using the most powerful AI model for all tasks is inefficient and leads to unnecessary costs.
Connected Companies & Entities
1 Entity mapped“Im Interview erklärt Maximilian Hudlberger, Applied AI Engineer bei OpenAI, wo unnötige Kosten entstehen......”
Ontology Mapping & Concepts
Related Market Signals & Shifts
Recent verified developments and strategic activity across this market segment.
You're optimizing AI cost the wrong way
The article argues that counting tokens or choosing the cheapest model per-token is an insufficient strategy to minimize real AI agent costs. Token composition, cache reuse, number of executions, and the cost of retries matter more than raw token counts. The author presents seven practical strategies for coding agents: protect reusable context, control what enters the prompt, use the most selective search tool, load knowledge on demand with Rules and Skills, control model output, pick model effort by cost-of-error, and measure cost per completed task rather than tokens. Examples note that prompt caching and session TTLs (Anthropic default TTL described), deterministic discovery scripts, and stepwise routing (light/intermediate/strong models or scripts) can reduce total cost by avoiding repeated work. The piece frames these practices as agent engineering focused on system-level cost per correct task completion.
Companies Cut AI Costs with 'Modelmaxxing' Strategy
The article reports a shift in corporate AI usage from indiscriminate high-cost model usage (“tokenmaxxing”) toward a more targeted approach called “modelmaxxing,” where teams pick models by task complexity to reduce inference expenses. Tokenmaxxing reportedly produced extreme consumption at some tech firms — The Information found an internal Meta leaderboard with about 60 trillion tokens in 30 days and a top user consuming ~280 billion tokens — potentially costing hundreds of thousands to millions of dollars. Companies such as Meta and Amazon helped popularize heavy token use. In response, firms and developers (e.g., Bold Metrics’ CTO Morgan Linton and developer Alejandra Thomas) are prescribing specific models for tasks. Model-routing startups have emerged and Ramp’s chief economist reports adoption rising from ~1% to ~5% of companies; a Bitkom survey found about one-third of German firms were surprised by AI costs. The trend aims to keep AI benefits while controlling spend.
Enterprise AI: Tokens vs. Humans Trade-off
CFOs at large U.S. companies are confronting a new budget dilemma as AI inference costs surge, forcing a choice between spending on model tokens or hiring staff. CNBC spoke with Arvind Jain (CEO of Glean) and Matan Grinberg (CEO of Factory AI), who described how many enterprises are exhausting annual AI budgets within months, with roughly 95% of usage still routed to the most expensive frontier models. Companies are moving from a phase of ‘tokenmaxxing’ to reassessing whether premium models are needed for every task; routing simpler work to cheaper model tiers could yield substantial savings. The article cautions that demand may be more price‑sensitive than market assumptions, with implications for valuations and revenue growth of premium model providers like OpenAI and Anthropic.
Track Real-Time Market Signals & Shifts
Set up custom watchlists to receive automated, evidence-grounded executive digests whenever material signals or shifts occur across your tracked landscape.