Observed Signal · Jul 8, 2026 · Funding · Source: AINews swyx · Impact: 3/5 · Sentiment: Positive
Modal CTO on Agent-Centric AI Infrastructure
Modal CTO Akshat Bubna discusses why AI agents require different infrastructure than traditional cloud stacks, describing Modal’s shift from developer experience to agent experience. The interview highlights Modal’s recent $355M Series C, its agent-focused primitives (sandboxes, elastic inference, GPU snapshotting, speculative decoding/DeFlash, Auto Endpoints), a 17-cloud capacity pool, and features for multi-node training, private IPv6 overlays and RDMA networking. Bubna explains autoscaling challenges for bursty inference and RL rollouts (which can require very large numbers of sandboxes), Modal’s open-source work on DeFlash/speculative decoding, and the company’s product focus on making frontier-level inference and agent deployment easier to adopt.
Modal's $355M Series C and its agent-focused infrastructure primitives (sandboxes, elastic inference, GPU snapshotting, speculative decoding/DeFlash, Auto Endpoints) signal meaningful investment and product progress in AI agent infrastructure — relevant to cloud compute supply and software primitives for production agent workloads.
Key Takeaways & Evidence Grounding
- Modal raised $355M in a Series C round (reported in this article).
- Modal operates a capacity pool spanning 17 cloud providers (the article calls this a '17-cloud' supercloud strategy).
- Modal has open-sourced work on DeFlash (a block-based speculative decoding approach) and is shipping features like Auto Endpoints for optimized inference.
- Modal provides agent-focused infrastructure primitives including sandboxes, elastic inference, GPU snapshotting, networked sandboxes, private IPv6 overlay (I6PN), RDMA support and serverless multi-node training.
- Akshat Bubna is identified as Modal’s CTO and is the primary interviewee explaining the company’s agent-centric infrastructure strategy.
Connected Companies & Entities
7 Entities mappedSuno
AI platform for generating and editing complete songs from prompts.
“The thing we first found product market fit with was inference for custom models. So we stayed away from the LLM space, and we were serving ...”
Anthropic
Foundation model company selling AI assistants and model APIs.
“We’re very excited to partner with Anthropic and some of the other foundation labs, will not name who we’re also working with....”
Modal
Serverless AI infrastructure for production GPU workloads.
“Today, fresh off their $355M Series C, Modal is one of the clearest examples of the agent cloud future being built in real time: a cloud pla...”
Runway
Generative media platform for AI video, image and audio.
“The thing we first found product market fit with was inference for custom models. So we stayed away from the LLM space, and we were serving ...”
Ramp
Finance automation platform for cards, spend, payments and procurement.
“Ramp Inspect was a great example of a background agent that was really successful because they were able to use some of the primitives like ...”
Railway
Developer cloud platform for deploying and operating applications.
“We’ve been running a bit of an Agent Cloud series surveying all the top inference/compute/cloud providers, from Databricks to Daytona to Rai...”
Databricks
Enterprise lakehouse platform for data, analytics and AI.
“We’ve been running a bit of an Agent Cloud series surveying all the top inference/compute/cloud providers, from Databricks to Daytona to Rai...”
Ontology Mapping & Concepts
Track Real-Time Market Signals & Shifts
Set up custom watchlists to receive automated, evidence-grounded executive digests whenever material signals or shifts occur across your tracked landscape.