Observed Signal · Sep 11, 2026 · Technical Release · Source: OpenAI Blog · Impact: 3/5 · Sentiment: Positive
OpenAI Scales Habitat Storage to 1 Billion Users
OpenAI has shared insights on scaling its internal storage platform, Habitat, to support over 1 billion weekly users. Habitat now handles more than 70 million requests per second and serves over 500 petabytes of data across nearly 40 regions. Initially a Python client library, it evolved into a standalone service, later rewritten in Rust for improved efficiency. Key challenges included asyncio scheduling delays, LIFO connection pooling, and thundering herd problems, addressed with Envoy for connection management. The platform relies on Azure Cosmos DB and a distributed lookaside cache, reducing global read latency by 12 times (p50 from 120 ms to 10 ms). They also implemented hot key throttling, quality-of-service tiering, and a new serverless mode. OpenAI is now building a custom exabyte-scale storage system using RocksDB Cloud and Raft replication for future growth.
OpenAI details scaling its storage infrastructure to handle massive user growth, highlighting architectural decisions and performance optimizations that are relevant for AI-powered advertising and marketing platforms.
Track OpenAI Signals & Market Shifts in Real-Time
Polaris7 autonomous intelligence agents track regulatory filings, primary sources, executive changes, and deal flow 24/7. Create your Polaris7 workspace to monitor these entities.
Key Takeaways & Evidence Grounding
- Habitat now serves over 70 million requests per second, supporting products used by over 1 billion people weekly.
- Habitat serves more than 500 petabytes of data across nearly 40 Azure regions.
- Habitat was rewritten in Rust in Q2 2026, improving CPU efficiency by 6x and memory efficiency by 15x; the new service handles 95% of production requests.
- Global read latency was reduced by 12x, from a p50 of 120 ms to 10 ms, using a distributed lookaside cache with change data capture.
- OpenAI is building a custom exabyte-scale storage system using RocksDB Cloud and Raft-based replication.
Connected Companies & Entities
“Every OpenAI product depends on fast, reliable access to data... Habitat is the online storage platform we built so OpenAI products can quic...”
“we scaled our partnership with Azure Cosmos DB to reliably handle unprecedented demand.”
Ontology Mapping & Concepts
Related Market Signals & Shifts
Recent verified developments and strategic activity across this market segment.
Powering 800 Million ChatGPT Users with PostgreSQL
OpenAI published an engineering post describing how it scaled PostgreSQL to support millions of queries per second and serve 800 million ChatGPT users. The team retained a single-primary Azure PostgreSQL flexible server for writes and operated nearly 50 geo-distributed read replicas, while migrating shardable, write-heavy workloads to sharded systems such as Azure Cosmos DB. Key techniques included aggressive query optimization, workload isolation, PgBouncer connection pooling (reducing average connection time from 50ms to 5ms), cache locking to prevent cache-miss storms, rate limiting, strict schema-change controls, and testing cascading replication with Azure to scale replicas. OpenAI reports low p99 read latency, five-nines availability, and only one SEV-0 Postgres incident in the past 12 months.
OpenAI publishes new engineering and security blog posts
New posts: 'Rapidly scaling online storage to serve over 1 billion ChatGPT users (Part II)' and 'Securing our frontier model training environment'.
Anthropic and OpenAI pursue smaller data center capacity deals
Anthropic and OpenAI are reportedly exploring smaller data center capacity agreements, ranging from 20 to 30 MW, to accelerate deployment of AI workloads across the U.S., U.K., and Nordics. Sources told CNBC that both companies are seeking faster 'speed to usable capacity' from existing powered sites, as large-scale gigawatt projects face community and infrastructural pushback. The shift reflects a growing focus on inference workloads, which can be served by smaller clusters. OpenAI surpassed its Stargate commitment of 10 GW and is adding capacity in Georgia and Ohio, while Anthropic recently signed a $45 billion cloud deal with Nscale. Smaller deployments are seen as practical alternatives to large projects, allowing quicker deployment and flexibility.
Receive all future signals for OpenAI & competitors in your briefing
Never miss material M&A deals, leadership changes, account wins, or product rollouts. Polaris7 monitors 20,000+ primary sources 24/7, delivering verified telemetry directly into your executive briefing.
