Cloudflare, Web Infrastructure Company, has launched “Pay per crawl”an experimental platform that allows editors to charge for each visit that artificial intelligence bots make to their websites. More than a technical tool, it is a proposal with deep implications for the digital ecosystem: convert content tracking into a regulated economic exchange between two parts.

During the last months, the company has been deployed some solutions to visualize and block the traffic of Crawlers or automated trackers for the training purposes of AI. With this technological base, the new Marketplace allows editors to decide whether they want to block, allow for free or monetize that tracking. Thus, a specific policy can be applied to each bot, and the owners of the site can set their own prices by crawl.

The logic behind this system is that, as traditional search engines lose influence and conversational agents gain prominence, the balance that web traffic and its monetization through advertising begin to break. Large technological ones are extracting the value of the contents without necessarily redirect traffic, which raises a direct threat to the Economic model of digital media.

“We are attending a paradigm shift in the network where the position of hegemony is being questioned that until now had Google as the main search engine. IA have strengthened with force by changing the search habits that the users had until now.”says Félix Barbeira, responsible for operations and security in Dinahosting in statements to Reason.WHY.

According to Cloudfare’s own analysis, the company indicates that in June 2025 the Crawler of Google He agreed 14 times for the sites for each real visit that derived. In the case of OpenAIthe ratio was 1,700 tracers for each redirected click. And the most extreme data represents it Anthropic: 73,000 accesses for each effective visit. These figures quantify what many editors have sensed for a long time: massive content extraction is not translating into a return.

Thus, “Pay Per Crawl” does not solve all the dilemmas of the post-branch era, but points to An architecture other than digital value: Not based on user attention, but on the programmatic use of information by artificial agents. Cloudflare even raises a future in which the browsers or assistants of IA have integrated budgets to acquire automatically content in a kind of algorithmic microeconomy in real time.

This is what the owners of websites see in Pay Per Crawl.

Several large editorial groups They have already aligned with Cloudflare’s proposal to establish more strict control over automated access to its contents. Condé Nast, Time, The Associated Press, The Atlantic either Fortune They have activated the default block for the IA trackers through Cloudflare, thus supporting an explicit permissions -based approach. Although their direct participation in the micropagos marketplace (“Pay per crawl”) has not been confirmed, their adhesion to these policies anticipates a possible future adoption of monetization models more structured against the massive use of its contents by artificial intelligence systems.

“What if a payment wall for agents could operate on the perimeter of the network, completely programmatic?”Cloudflare asks in his official announcement. The company anticipates a scenario in which automated systems pay for accessing scientific articles, legal documents or local reviews, not being behind a Paywall Traditional editorial, but for accessing the specific data required at the exact moment.

To participate, both editors and AI companies must have accounts in Cloudflare. The platform acts as an intermediary and manages the collection and distribution of micropagues. Although for now the system does not use cryptocurrencies, its CEO Matthew Prince has left the door open to explore options such as stablcoins, own or third parties, to facilitate this type of transactions.

Cloudflare, which currently serves One in five websites in the worldas well as possible referee of a new digital contract is positioned. The great unknown is whether AI models developers will be willing to pay for what they get for free. Attracting a critical mass willing to operate in a different environment could change the rules.

“The new monetization strategies, such as those proposedadds Félix Barbeira (Dinahosting). “It is early to anticipate, but the debate on technological sovereignty, as well as the neutrality of the network, should always be on the table, since they are essential for all users: individuals, social groups, companies and administrations.”