What would help—as University of Wisconsin law professor Benjamin Sobel told Nieman Lab—would be if Meta added specific language to the policy where the company agrees to respect scraping instructions in robots.txt files. Since complying with robots.txt is voluntary, Meta could possibly rely on the legally enforceable TOS omitting mentions of robots.txt to scrape sites that attempt to block scraping via robots.txt, experts suggested.

When it comes to robots.txt, “you can still express the preference, and unless it’s a legally enforceable preference, it can still be ignored all the same,” Sobel said.

Meta backlash is global

Criticism goes beyond Nieman Lab’s reporting, as news groups globally urge regulators to intervene and block Meta’s controversial terms from kicking in.

A chief executive for the United Kingdom News Media Association, Theo Bamber, accused Meta of a “shameless land grab” relying on the “worst kind of arrogant tech platform bullying.” Bamber urged UK regulators to “stand up for British…