Observed Signal · Jul 8, 2026 · Funding · Source: AINews swyx · Impact: 3/5 · Sentiment: Positive
Modal CTO on Agent-Centric AI Infrastructure
Modal CTO Akshat Bubna discusses why AI agents require different infrastructure than traditional cloud stacks, describing Modal’s shift from developer experience to agent experience. The interview highlights Modal’s recent $355M Series C, its agent-focused primitives (sandboxes, elastic inference, GPU snapshotting, speculative decoding/DeFlash, Auto Endpoints), a 17-cloud capacity pool, and features for multi-node training, private IPv6 overlays and RDMA networking. Bubna explains autoscaling challenges for bursty inference and RL rollouts (which can require very large numbers of sandboxes), Modal’s open-source work on DeFlash/speculative decoding, and the company’s product focus on making frontier-level inference and agent deployment easier to adopt.
Modal's $355M Series C and its agent-focused infrastructure primitives (sandboxes, elastic inference, GPU snapshotting, speculative decoding/DeFlash, Auto Endpoints) signal meaningful investment and product progress in AI agent infrastructure — relevant to cloud compute supply and software primitives for production agent workloads.
Wichtigste Kernpunkte & Evidenz
- Modal raised $355M in a Series C round (reported in this article).
- Modal operates a capacity pool spanning 17 cloud providers (the article calls this a '17-cloud' supercloud strategy).
- Modal has open-sourced work on DeFlash (a block-based speculative decoding approach) and is shipping features like Auto Endpoints for optimized inference.
- Modal provides agent-focused infrastructure primitives including sandboxes, elastic inference, GPU snapshotting, networked sandboxes, private IPv6 overlay (I6PN), RDMA support and serverless multi-node training.
- Akshat Bubna is identified as Modal’s CTO and is the primary interviewee explaining the company’s agent-centric infrastructure strategy.
Verknüpfte Unternehmen
7 verknüpfte UnternehmenSuno
KI-gestützte Plattform zur Generierung und Editierung vollständiger Musiktitel über Text-Prompts oder Audio-Uploads für das B2B- und B2C-Segment.
“The thing we first found product market fit with was inference for custom models. So we stayed away from the LLM space, and we were serving ...”
Anthropic
Anbieter von KI-Basismodellen, der intelligente KI-Assistenten und Modell-APIs für Entwickler und Unternehmen bereitstellt.
“We’re very excited to partner with Anthropic and some of the other foundation labs, will not name who we’re also working with....”
Modal
Serverlose KI-Infrastruktur für hochperformante, skalierbare GPU-Workloads im Produktivbetrieb.
“Today, fresh off their $355M Series C, Modal is one of the clearest examples of the agent cloud future being built in real time: a cloud pla...”
Runway
Generative Medienplattform für KI-gestützte Video-, Bild- und Audiokreation sowie skalierbare API-Workflows.
“The thing we first found product market fit with was inference for custom models. So we stayed away from the LLM space, and we were serving ...”
Ramp
Ramp ist eine integrierte B2B-Finanzautomatisierungsplattform für Corporate Cards, Spesenmanagement, Zahlungsverkehr und strategische Beschaffungsprozesse.
“Ramp Inspect was a great example of a background agent that was really successful because they were able to use some of the primitives like ...”
Railway
Eine Cloud-Entwicklerplattform für das automatisierte Deployment und den reibungslosen Betrieb skalierbarer Applikationen im B2B-Umfeld.
“We’ve been running a bit of an Agent Cloud series surveying all the top inference/compute/cloud providers, from Databricks to Daytona to Rai...”
Databricks
Eine einheitliche Lakehouse-Plattform für Enterprise-Daten, Analytics und künstliche Intelligenz.
“We’ve been running a bit of an Agent Cloud series surveying all the top inference/compute/cloud providers, from Databricks to Daytona to Rai...”
Ontology Mapping & Concepts
Track Real-Time Market Signals & Shifts
Set up custom watchlists to receive automated, evidence-grounded executive digests whenever material signals or shifts occur across your tracked landscape.