Cloudflare and OpenAI say a research pilot has helped OpenAI discover and index hundreds of millions of new web pages. The pilot used a participating cohort of about 1% of Cloudflare’s total network.

The companies shared those early results on Oct. 15 in a post on Cloudflare’s blog coauthored by two OpenAI staff. Cloudflare announced the pilot on July 8.

The post says finding new pages can initially increase crawling, and it doesn’t report how often the new pages were cited in ChatGPT or how many visits they sent.

How Cloudflare’s Signals Help OpenAI Find Pages

Cloudflare’s network signals are used by OpenAI to help its search crawler find web pages with value. The blog post gives several examples of these pages, such as the user guide of a particular washing machine, the most recent information regarding passport requirements and fees and a restaurant’s menu and hours.…