Cloudflare Wants to Make AI Pay Publishers Per Use

"For every human reader they send back to publishers, AI bots scrape thousands of pages," says Lara Cohen, VP of strategic partnerships for media, creators and AI at Cloudflare, which routes roughly 20% of global internet traffic. Cloudflare has shifted from its earlier "pay per crawl" plan to a beta of "pay per use", where large language models pay for the value they actually extract, say when a publisher's content answers a user's query, with the AI company making an offer and the publisher deciding whether to take it. Cohen is explicit that this is not a replacement for advertising: "I can't turn back the hands of time and make it 1995," she says, framing it as an experiment for "good actors on both sides". Buyers must "declare their crawler" and "show up honestly". The dashboards let publishers see how often models like ChatGPT and Claude pull their content, which URLs are popular, and how many visitors are human.

The crux

The scraper economy is being renegotiated as a priced market rather than a tolerated crawl, with Cloudflare positioning itself as the toll-collector between millions of publishers and the AI companies that ingest their content.

Sell-side read

Publishers get a measurement and settlement layer for a revenue line that has been zero to date, but the honest framing is that AI payments are a new, small, usage-based stream, not a substitute for the traffic and ad revenue being lost.

Watch

whether pay-per-use pricing finds any standardised rate card, and whether the big AI labs consent to being metered rather than scraping.