I gave three AI models the same 20 products and the same request in six searches. They never agreed on which one to buy. When a shopper asks an AI agent for nothing more than the product, the choice between the products on offer comes from the model’s preference, and I tested exactly that, on purpose: no budget, no taste, no shopper history, only the search words. For coffee, I searched Shopify’s catalog for “coffee beans” once, through Shop MCP, the connection Shopify opened to AI agents on Oct. 13, and saved the top 20 results. Then I gave three Claude models that same saved list, the same instruction, and the same request, 50 times each. Haiku 4.5 and Sonnet 5 favored the dark roast with the most reviews. Opus 5 picked the medium roast 48 times out of 50, and told me why: “With no stated preferences, a medium roast is the safest crowd-pleaser…”
Shopify Opened A Keyless Connection To Its Catalog For AI Agents On Oct. 13
On Oct.…