Meta's new commercial terms may let it scrape publisher sites for AI training, Nieman Lab reports
Nieman Lab reported that Meta's updated commercial terms, effective October 30, authorise it to crawl websites linked to business accounts and use the content to train its products. Meta says the update only consolidates existing crawling language and does not change how its crawlers work.
1 / 2
The story, neutrally told
Left · 1Nieman Lab reported that Meta's updated commercial terms appear to let it crawl and scrape websites associated with businesses that use its platforms, including online publishers. The VergeLC “Meta’s new terms appear to give it permission to crawl and scrape websites “associated” with the businesses that use its platforms — including online publishers, according to a report from Nieman Lab.” Read at The Verge ↗ Left · 1The terms take effect on October 30 and apply to business accounts that promote content across Facebook, Instagram, WhatsApp and Messenger. They say Meta may use content from those domains to "develop, improve, research" and "train" its products. The VergeLC “The new terms, which go into effect on October 30th, say Meta can use this outside content to “develop, improve, research,” and “train” its AI products.”“The new policy applies to business accounts that promote their content across Facebook, Instagram, WhatsApp, and Messenger.” Read at The Verge ↗ Left · 2The clause authorises Meta or anyone acting for it to use scrapers, bots and crawlers, and to create "test credentials", to access and pull updates from linked domains. Ars Technica notes the text never mentions AI; that meaning is inferred from the word "train" and the references to automated scraping. The VergeLC “You authorize us (or any entity acting on our behalf) to use automated software (such as web scrapers, bots, robots, spiders, crawlers, and user agents) and create test credentials” Read at The Verge ↗ Ars TechnicaLC “Notably, there is no mention of AI, but it’s inferred from a single use of the word “train” and references to automated scraping and crawling.” Read at Ars Technica ↗
Left · 2Businesses that do not accept the terms "may stop all access or use of our Products for business or commercial purposes". Ars Technica says the update does not allow businesses to opt out. The VergeLC “Businesses that don’t agree to Meta’s new policies “may stop all access or use of our Products for business or commercial purposes,” the terms say.” Read at The Verge ↗ Ars TechnicaLC “the TOS update won’t allow businesses to opt out, instead suggesting that businesses stop using Meta services” Read at Ars Technica ↗ Left · 2Meta has struck AI licensing deals with CNN, Fox News, USA Today and People Inc., so the terms could give it access to far more content than those deals cover. Legal expert Matt Topic called the provision "remarkable" to bury in terms of service, because the material would likely cost many millions of dollars in a licensing market. The VergeLC “Meta has followed OpenAI in striking AI licensing deals with CNN, Fox News, USA Today, and People Inc.” Read at The Verge ↗ Ars TechnicaLC ““this is a remarkable provision to bury in [the] terms of service, given that this would give Meta access to material that would likely cost many millions of dollars in a licensing market.”” Read at Ars Technica ↗ Left · 1Last month Meta launched a Meta One subscription that requires businesses and creators to pay to include links in posts and reels. Nieman Lab said Meta has begun charging users to post links to content it will be permitted to crawl for free. The VergeLC “Last month, Meta launched a new Meta One subscription that requires businesses and creators to pay to include links in posts and reels.”““Put another way, Meta has begun charging users to post links to the same content that it will be permitted to crawl for free,” Nieman Lab says.” Read at The Verge ↗
Left · 1Three legal experts told Nieman Lab it is unclear whether a court would enforce the terms, but that they could be used to argue Meta may scrape news sites for AI training. Cornell Law professor James Grimmelmann warned Meta could train on any content from the sites and possibly deploy it in competition with publishers. Experts also likened the arrangement to the antitrust concept of "tying". Ars TechnicaLC “Three legal experts told Nieman Lab that it’s not clear if a court would enforce the terms”“Meta could “train AI on any content from their sites” and possibly “deploy some of that content, even in competition with the publishers themselves””“seems more like the antitrust concept of “tying,”” Read at Ars Technica ↗ Left · 1Meta described the change as "streamlining", saying crawling language was previously scattered across different terms and is now consolidated. A spokesperson told Nieman Lab that content owners can still manage access through robots.txt, and told Ars that "there is no change to how Meta uses web crawlers; any suggestion to the contrary is false." Ars TechnicaLC ““language around crawling was previously scattered across different terms of use, including terms about using generative AI in ads, and this update consolidates them in one place.””““there is no change to how Meta uses web crawlers; any suggestion to the contrary is false.”” Read at Ars Technica ↗ Left · 1Ars Technica compared the documents and found that "test credentials" appear in neither the current commercial terms nor the Product Catalog or Ad Creative Generative AI Terms being merged in. It says the wording seems to have been introduced this month in the Self-Service Ads Terms, and that the earlier crawling language covered only ad content. Meta did not immediately respond to Ars' request to clarify. Ars TechnicaLC “In Meta’s current commercial terms, there are no mentions of “test credentials””“They specify that businesses consent to scraping only in connection to ad content, not for improving all of Meta’s products”“A Meta spokesperson did not immediately respond to Ars’ request to clarify.” Read at Ars Technica ↗
Left · 1News organisations are already contesting with OpenAI whether training without a licence is fair use, and publishers fear the terms could override robots.txt blocks if courts rule for AI developers. Stephen Beale, founder of The Steampunk Explorer, told Nieman Lab he is considering leaving Facebook over the update. Ars TechnicaLC “Currently news organizations are fighting a battle with OpenAI over whether such training without licensing is fair use”“is already considering quitting the platform over the update” Read at Ars Technica ↗
Every sentence links to the reporting it rests on. The pill in front of each says where its sources sit: Left, Centre or Right when one side supplies at least half of them, Mixed when they are evenly split. The number is how many outlets it cites.
Left2 outlets
- Framing
- Both outlets relay Nieman Lab's report as a potential AI power grab by Meta against publishers. The Verge gives a short summary; Ars Technica adds its own document comparison and legal-expert warnings.
- Emphasis
- Loss of licensing revenue, no opt-out, the link-charging subscription and expert concerns about tying and paywall bypass.
- Leaves out or plays down
- Neither carries independent publisher responses beyond those quoted by Nieman Lab. The Verge has no Meta response to the substance.
- Charged language
- “AI power grab”“sweeping”“seize permission”
- For example
-
“Legal experts warn it’s an AI power grab.” — Ars Technica
“Meta’s terms seemingly risk granting it sweeping permissions” — Ars Technica
“Meta’s new terms may allow it to train AI on news sites for free” — The Verge
Centre0 outlets
No centre outlet in our sources has covered this story yet.
Right0 outlets
No right outlet in our sources has covered this story yet.
What every side reports
- The terms take effect on October 30.
- The text authorises Meta to crawl domains associated with business accounts and use the content to train its products.
- Meta did not immediately respond to The Verge's request for comment, and told Nieman Lab and Ars Technica that robots.txt still lets content owners block crawling.
- Meta launched a paid Meta One subscription last month that charges for links in posts.
Where accounts differ
-
Whether the update changes Meta's scraping rights
- Left
- Nieman Lab, as relayed by Ars Technica and The Verge, says the terms give Meta new, broader permission to scrape linked sites and train AI; Ars's comparison finds fresh language such as "test credentials". Meta says it only consolidates existing language and nothing changes in how it uses crawlers.
Meta organisation
Meta calls the update a "streamlining" that consolidates scattered crawling language and says it has no plans to use the terms to ignore robots.txt. It says nothing changes in how it uses web crawlers.
““Content owners can still manage how their content is accessed by using robots.txt,” the spokesperson said.” — Ars Technica
““these changes reduce overlap between our agreements and improve the clarity of the terms that apply to your use of our products.”” — Ars Technica
Left2 articles
-
Meta’s new terms may allow it to train AI on news sites for free
Critical Short relay of Nieman Lab's report stressing that the terms could let Meta bypass licensing and that it charges for links it can crawl free.

-
Meta may use sweeping new commercial TOS to avoid millions in AI licensing fees
Alarmist Presents the terms as a sweeping grab to avoid licensing fees, backed by legal-expert warnings and its own comparison of the documents.

Centre0 articles
No coverage yet.
Right0 articles
No coverage yet.
- 16 Oct 15:02 First The VergeLC Meta’s new terms may allow it to train AI on news sites for free
- 16 Oct 16:41 +1h 38m Ars TechnicaLC Meta may use sweeping new commercial TOS to avoid millions in AI licensing fees
Times are when each article was published, or when we first saw it if the outlet gave no time.
Ask about this story
Loading…