This is the technical companion to our update on Distilled, “Keeping the web open and private in the bot era.” Here we take a deeper look at the problem space, the design we’re proposing, and the problems still left to solve .

Bots (and privacy-preserving browsers) not welcome

Browse a news site in a private window. Shop at a major retailer with a VPN. Visit a video streaming platform with anti-fingerprinting defenses tuned up. You’ll see the same responses: registration walls, block pages, and endless CAPTCHAs. The message is clear: if we think you might be a bot, you’re not welcome .

Websites have valid reasons for wanting to block bots. Bots enable volumetric abuse , abuse that wouldn’t otherwise be feasible if they had to be carried out by humans . For example : SEO comment spam, credential stuffing and DDoSing .…