CloudFactory vs infrai

Forward Deployed Engineering is having a moment.

CloudFactory highlights its long-standing expertise in forward deployed engineering, embedding engineers to get enterprise AI into production. Also featured: a new blog post on AI ethics by design, emphasizing responsible data sourcing.

SMS Delivery Status Polling for Waitlist Outage Alerts

The article advises that teams should only rely on an SMS API for critical outage alerts if their backend can poll delivery status and own retry, escalation, cancellation, and timing logic. Delivery reliability and timing constraints drive the design: define service-level objectives, record four reliability invariants (application-owned send IDs, bounded/idempotent retries, defined next actions per delivery state, and incident recovery that suppresses obsolete alerts), and treat providers as transport adapters. The author shortlists Twilio, Vonage, Sinch, and Infrai for evaluation, provides load-testing guidance, and includes a runnable Python example that polls SMS status, honors Retry-After, and applies backoff. The recommended architecture keeps durable incident state in the application and makes provider polling a replaceable adapter.

• Choose an SMS API for critical outage alerts only if the backend can poll delivery status and implement retry, escalation, cancellation, and timing logic.
• Four reliability invariants: application-owned identifier per send; bounded and idempotent retries; every delivery state must map to a defined next action; incident recovery must stop obsolete alerts.
• Article shortlists Twilio, Vonage, Sinch, and Infrai as candidate SMS providers to validate against the same decision record.

Backend-Owned SMS OTP: Cooldowns and Attempt Caps

This technical blog post explains best practices for implementing passwordless phone logins using SMS OTPs in an Express/Node.js backend. It argues that the backend must own resend cooldowns, verification attempt counters, and anti-abuse policies (not the client), model the authentication state machine (ready → code_sent → verified/expired/locked), persist minimal authoritative state, use atomic database transitions, emit single transition events for observability, and use idempotency keys and retry/backoff handling when calling providers. Provider choices (Twilio, Firebase, Auth0, Amazon SNS, Infrai) are discussed with trade-offs between managed verification and owning template/state-machine responsibilities.

• The article recommends the Express/Node.js backend should own SMS OTP resend cooldowns, maximum verification attempts, and anti-abuse counters rather than trusting the client.
• Designs should expose explicit states: send-code, verify-code, resend-code, and lockout; persist minimal authoritative state (challenge ID, phone identity, expiry, next-send time, counters, lockout).
• Use atomic database transitions and idempotency keys tied to admitted transitions to prevent race conditions and duplicate sends.

Bulk LLM Text Classification with Tenant Chargeback

The article recommends treating tenant accounting as the primary artifact when performing bulk CSV moderation with LLMs: create a tenant-owned job with stable row IDs, estimate costs before submission, submit asynchronous batch classification (preferably chat classification with a closed label set), and attach returned results and export references to the same tenant ledger for reconciliation. The author provides an example TypeScript batch submission pattern (idempotency derived from the validated request, bounded retries, handling 429), argues for allocating costs at the job boundary and reconciling at the row level, and discusses when to call providers directly (Infrai, OpenAI, Anthropic, Google Gemini) versus renting batch execution.

• Author recommends asynchronous chat classification with a closed label set and using a tenant ledger as the primary artifact for billing and reconciliation.
• Pattern: create a tenant-owned job with a stable ID per accepted CSV row, show an estimate before submission, persist the provider batch identifier, then reconcile results and costs back to the job and rows.
• TypeScript example demonstrates deriving an idempotency key from the validated batch-request.json, honoring Retry-After for HTTP 429, and using bounded exponential backoff.