Menu

1 / 3

Website AI agent traffic: sort Claude-Agent requests from your access log in Python

DEV Community: python·Kim Olsen·4 days ago
#ACgKJklq
#devtopython#devto#dev#agent#claude
Reading 0:00
15s threshold

Website AI agent traffic is not only the agent you deploy. Buyers now send Claude to read pricing pages and book meetings, and this post walks through a small Python checker that finds those requests in an access log, tells the real ones from the fakes, and shows you which of your own rules refused them. By the end you can run it on a day of your log and know whether a real agent was ever turned away, and where.

The full story, with a drawn demo of an invented log, is in the write-up on the buyer's agent and the booking page . The code below is trimmed from the real checker.py that ships in the giveaway; nothing here was rewritten for the post.

What Anthropic says about the website AI agent's identity

Anthropic's help article on hosted browsers says three things a parser needs. When Claude browses for a person, the browser keeps its normal User-Agent and adds the token Claude-Agent .…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.