The Agentic Web Index: AI Bot Traffic Statistics

📰

The Agentic Web Index: AI Bot Traffic Statistics | Known Agents

Hacker News·3 months ago

Reading 0:00

15s threshold

Overview

Key ecosystem metrics across 5,000+ websites using Agent Analytics and AI Chat Referral Tracking .

Bot vs. Human Traffic

↓ 1%

Compared to the previous 90 days

The amount of visits from bots vs. humans

Agentrification

↑ 11%

Compared to the previous 90 days

The percentage of bot traffic that's AI-related

AI Chat Referral Volume

↓ 9%

Compared to the previous 90 days

The percentage of human website visits that come from AI chat

See Referral Trends ↓

Robots.txt Effectiveness

How often bots follow robots.txt rules

See Per Agent ↓

Traffic by Agent Type

AI Agent

Uses an actual web browser to autonomously complete complex tasks on behalf of a human user

AI Assistant

Fetches website content in response to a user prompt, to include in an AI-generated answer

AI Coding Agent

Fetches documentation and other resources to help build software

AI Data Provider

Crawls websites to supply structured content to AI systems as a…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.