Menu

1 / 7

Zillow Runs 100 Million Notifications a Day on One Configuration Layer

DEV Community: cloud·Taha Echakiri·1 day ago
#dBNYS5V5
#devtocloud#devto#dev#campaign#workflow
Reading 0:00
15s threshold

TL;DR

AWS Step Functions Express Workflows is a managed service that runs short workflows on demand; Zillow's unbatched path starts one execution per notification, and its batch mode combines multiple messages into one execution to send more than 100 million emails and push messages a day.

The platform has two parts: a Campaign Orchestrator that reads queued events and starts the right workflow, and a Universal Content Generator that holds the shared, stateless modules every campaign calls.

Zillow built it after twenty-plus campaigns spread across more than ten generator services duplicated the same work and slowed every release.

A router sits in front of the workflows and owns queue polling, batching, idempotency checks, replay, speed control and circuit breakers, so a single campaign can be paused without touching the others.

Express mode provides the higher default start quota and the short-run latency this traffic needs, with at-least-once delivery that the idempotent modules make…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.