# What should an AI crawler pay to read your site?

> Cloudflare blocks AI training crawlers by default from 15 September 2026. Model your serving cost, referral value, break-even pay-per-crawl price and the x402 alternative.

Source: https://tokenomy.ai/agent-access-economics
Last updated: 2026-10-22
Publisher: Tokenomy — FinOps for AI
License: free to quote with attribution and a link to the source URL.

From 15 September 2026 Cloudflare's default flips to blocking AI training crawlers, with allow, block or charge as an explicit per-crawler choice. This turns robots.txt into a P&L decision.

## Overview

From 15 September 2026 Cloudflare's default flips to blocking AI training crawlers, with allow, block or charge as an explicit per-crawler choice. This turns robots.txt into a P&L decision.

- Serving cost per 1,000 AI crawls versus referral value returned
- Break-even price per crawl for your own traffic mix
- Allow, block, charge trainers only, or charge everyone — compared
- Pay per call in USDC over x402 on the Tokenomy Pricing API

## About Tokenomy

Tokenomy is the economic runtime for AI — the system of record for AI model pricing, plus free tools, independent research and runtime rails that meter, enforce and attribute every model call.

## Related pages

- [Free tools](https://tokenomy.ai/tools)
- [Research](https://tokenomy.ai/research)
- [Pricing Data API](https://tokenomy.ai/data-api)
- [Academy](https://tokenomy.ai/academy)
- [Blog](https://tokenomy.ai/blog)
- [Pricing](https://tokenomy.ai/pricing)
- [Why FinOps for AI](https://tokenomy.ai/finops-for-ai)