I got burned by a "99.9% success rate" claim last year. A scraping vendor's dashboard said everything was fine; my pipeline was quietly filling up with garbage. So when I finally had time, I did the thing I should have done first: I measured. This post is what three days of benchmarking two popular scraping APIs revealed — including a failure-cost gap of 397× on identical failures.
The setup
Two commercial scraping APIs ( ScraperAPI and Scrape.do ), same targets, same network, same validator. Three targets:
A static product catalog page (books.toscrape.com)
A static product detail page
A real JD.com product page — JavaScript-heavy, the kind of page people actually pay these APIs for
Six requests per target per provider per day, for three consecutive days. And the rule that matters most:
Success = HTTP 200 AND the product content is actually present.…