Observed Signal · Jun 23, 2026 · Technical Guide · Source: DEV Community · Impact: 2/5 · Sentiment: Neutral
How I Built a Reliable Webhook Delivery System
A developer describes building a production-grade webhook delivery system using FastAPI, PostgreSQL and Redis to solve common reliability issues. The post explains design changes: make delivery asynchronous (return 202 Accepted), add a watchdog to requeue stale IN_FLIGHT jobs, implement exponential backoff retries via a Redis sorted-set delay queue, apply a per-subscription circuit breaker (5 failures, 60s cooldown) and sign payloads with per-subscription HMAC‑SHA256 verified with hmac.compare_digest. Observability is provided with Prometheus and Grafana. The author reports achieving 99.9% delivery reliability across 10,000+ daily webhooks and promises a deeper technical deep-dive later.
Practical engineering guidance on reliable webhook delivery and observability patterns (backoff, circuit breaker, watchdog, HMAC) that benefit engineering teams building integrations, but it is not platform-level or industry-shifting news.
MARKET SIGNALS
Track PostgreSQL Signals & Strategic Shifts
Polaris7 connects regulatory filings, primary sources, leadership changes, and M&A activity into structured intelligence. Set up your Polaris7 workspace to monitor relevant companies in your executive briefing.
- Verified primary sources
- Automated briefings
- Instant watchlist setup
Key Takeaways & Evidence Grounding
- Author used FastAPI, PostgreSQL and Redis to implement the webhook system.
- Delivery was made asynchronous by returning 202 Accepted and persisting events for later delivery.
- A watchdog runs every 30 seconds to requeue stale IN_FLIGHT jobs.
- Retries use exponential backoff (2s → 32s) with a Redis sorted-set delay queue; max 5 attempts.
- A per-subscription circuit breaker trips after 5 consecutive failures with a 60s cooldown; payloads are signed with per-subscription HMAC‑SHA256 and verified using hmac.compare_digest.
- Observed result: 99.9% delivery reliability across 10,000+ daily webhooks with Prometheus + Grafana visibility.
Connected Companies & Entities
Ontology Mapping & Concepts
Related Market Signals & Shifts
Recent verified developments and strategic activity across this market segment.
Making Webhook Delivery Resilient with a Delivery Layer
The article explains how direct webhook integrations fail when receivers are offline and describes a resilient architecture that inserts a persistent delivery layer (Adal) between webhook providers and receivers. Adal accepts and stores incoming webhooks at a permanent HTTPS endpoint, provides delivery history and retries, and can forward events via Direct HTTP to public endpoints or via an outbound WebSocket tunnel (Adal CLI) to private/local services. If automatic retries are exhausted, stored events remain available for manual redelivery during their retention period. The article also covers idempotent receiver design, signature validation, encrypted storage, and the importance of complying with network and security policies when using an intermediary.
Bulletproof Webhook Ingestion for Ruby on Rails
This technical tutorial describes a resilient webhook ingestion pattern for Ruby on Rails applications (Rails 7/8). It recommends immediate acknowledgement of incoming webhooks and asynchronous processing: verify signatures, persist the raw payload to an inbound webhooks table, enqueue a background job, and return 200 OK. The article provides concrete Rails examples including an InboundWebhook model with enum statuses (pending, processing, completed, failed), a lean controller that verifies Stripe signatures and enqueues ProcessWebhookJob, and a background job that retries on deadlocks, updates lifecycle status, logs failures, and re-raises errors for monitoring (Sentry/Honeybadger). It also discusses idempotency strategies (database uniqueness constraints or Redis locks using provider event IDs) and suggests Solid Queue or Sidekiq for background execution. The guide emphasizes decoupling storage from execution to improve throughput, reliability, and recoverability.
Inbox Pattern for Reliable Webhook Testing
A developer guide describing a repeatable, deterministic approach for testing webhook integrations without relying on external tunnels or arbitrary delays. The author recommends separating reception from processing by implementing a tiny HTTP receiver that validates incoming requests and enqueues them into an inbox queue; business processing runs later and is tested separately. The post emphasizes signature verification (valid, modified-payload, wrong-secret tests), injectable retry scheduling ("fake the clock" for fast tests), out-of-order delivery and idempotency checks, and a concise arrange-act-assert testing template. The pattern aims to make webhook tests fast, debuggable, CI-friendly, and deterministic across local and automated environments.
WATCHLIST & BRIEFINGS
Receive future signals for PostgreSQL & competitors in your briefing
Stay ahead of material M&A deals, leadership changes, account wins, and product rollouts. Polaris7 connects primary filings, company newsrooms, and trade reporting directly into your executive briefing.
- Regular primary-source checks
- Structured Watchlist briefings
- Preserves current context
Market Signal Monitoring
Follow affected companies in Polaris7 with regular source checks and structured Watchlist briefings.
Monitor PostgreSQL
Follow affected companies in Polaris7 with regular source checks and structured Watchlist briefings.
