The traditional open/blocked model for managing bot traffic is broken. AI crawlers have become too sophisticated for organizations to block them at scale, and they extract value without returning it. Pay-per-crawl replaces the binary choice with a “yes, if” framework: programmatic, usage-based access to content gated by real-time payment requirements via the HTTP 402 status code. Stack Overflow and Cloudflare have co-launched a pay-per-crawl model, offering organizations a new path to public data monetization that complements, not replaces, traditional data licensing. For most of the web's history, content platforms operated on a simple binary: open or blocked. Bots that followed the rules, like search engine crawlers and legitimate aggregators, were welcomed. Bots that misbehaved were added to a blocklist. It was an imperfect system, but it was more or less functional. Then generative AI changed everything.…