A new analysis of 858,457 sites hosted on the Duda platform shows how AI crawlers are interacting with websites at scale. The data offers a clearer view of how crawling activity is growing and what SEOs and businesses should do to increase traffic from AI search.
AI Crawling Has Already Reached Scale
AI crawling is growing quickly, with more requests tied to real-time answers and most of that activity coming from a single provider. The data creates a pattern that shows which sites are being crawled and more importantly, why.
Year-Over-Year Growth In LLM Referrals
LLM referral traffic has increased sharply over the past year, with multiple platforms showing meaningful gains from very different starting points.
AI Referral Traffic Patterns
Total LLM referrals: 93,484 to 161,469 (+72.7%)
ChatGPT: 81,652 to 136,095 (+66.7%)
Claude: 106 to 2,488 (23x growth)
Copilot: 22 to 9,560 (from near-zero)
Perplexity: 11,533 to 13,157 (+14.1%)
Growth is not happening evenly, but across the board, referral traffic…