Menu

Most AI Crawlers Do Not Run Your JavaScript
📰

Most AI Crawlers Do Not Run Your JavaScript

DEV Community: javascript·Techno Accelerator·17 days ago
#tGqI7O0Z
#devtojavascript#devto#dev#user#agent
Reading 0:00
15s threshold

Every GEO article tells you to write helpful content and add schema. Fine advice. It also quietly assumes the machines can read your page, and for a large number of sites that assumption is wrong.

AI search runs in two steps. First the engine crawls and stores what it can read. Then, when somebody asks a question, it pulls the best passages and assembles an answer. The failure happens in step one, and it happens before any content tactic has a chance to matter.

What the crawlers actually do with JavaScript

Vercel ran a study in 2024, widely reported through 2026, logging how the major AI crawlers behave:

GPTBot (OpenAI) fetched JavaScript files only sometimes and executed none of them.

ClaudeBot (Anthropic) downloaded JavaScript in roughly a quarter of requests and executed none.

PerplexityBot read plain HTML only.

Googlebot is the exception.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.