TLDR We pulled verified anti-scraping clauses out of the Terms of Service of 35 AI companies and platforms and 150 top consumer sites, vectorized them as character 4-grams with TF-IDF weights, and linked every cross-company pair at a cosine of 0.35 or higher. The biggest group that came out is the "robot, spider, scraper" template, shared by 17 sites. It's standard-library Python, and on the study's quotes it gives the same similarities as scikit-learn's TfidfVectorizer with a character analyzer.
For the AI Hypocrisy Index we scored how hard each company's Terms ban scraping against how broadly it claims user or public data. Side by side, many of the anti-scraping clauses read like one sentence with a word swapped.…