What should an AI crawler pay to read your site?
From 15 September 2026 Cloudflare's default flips to blocking AI training crawlers, with allow, block or charge as an explicit per-crawler choice. This turns robots.txt into a P&L decision.
Last updated . Model pricing is refreshed twice daily.
Overview
From 15 September 2026 Cloudflare's default flips to blocking AI training crawlers, with allow, block or charge as an explicit per-crawler choice. This turns robots.txt into a P&L decision.
- Serving cost per 1,000 AI crawls versus referral value returned
- Break-even price per crawl for your own traffic mix
- Allow, block, charge trainers only, or charge everyone — compared
- Pay per call in USDC over x402 on the Tokenomy Pricing API
About Tokenomy
Tokenomy is the economic runtime for AI — the system of record for AI model pricing, plus free tools, independent research and runtime rails that meter, enforce and attribute every model call.