Observed Signal · Jul 17, 2026 · Policy Update · Source: techcrunch · Impact: 3/5 · Sentiment: Positive
Patreon blocks AI training bots with Cloudflare
Patreon is shifting from asking AI crawlers not to scrape creators’ content to actively blocking AI training bots by working with Cloudflare. The company says its prior reliance on robots.txt proved ineffective as scraping grew more sophisticated and new discovery features risked exposing protected content. Using Cloudflare’s AI Crawl Control, Patreon reports weekly training-crawler attempts fell from thousands to zero during tests. Patreon will still permit indexing bots that drive users back to the site, but will block crawlers that train AI models on creators’ work without permission. The move aligns with broader publisher efforts and recent Cloudflare policies and products aimed at restricting or charging AI bots for scraping.
Significant for publishers and creator monetization: shows an accelerating publisher response to AI training scraping by using CDN-level controls, which may reduce available training data and influence AI companies' access and costs.
Track Patreon Signals & Market Shifts in Real-Time
Polaris7 autonomous intelligence agents track regulatory filings, primary sources, executive changes, and deal flow 24/7. Create your free Explorer workspace to monitor these entities.
Key Takeaways & Evidence Grounding
- Patreon is working with Cloudflare to block AI bots that train models on creators' content without permission.
- Patreon will stop relying solely on robots.txt and will actively block AI training crawlers using Cloudflare's AI Crawl Control.
- Testing showed individual AI training crawlers' weekly access attempts dropped from "thousands of attempts to zero."
- Patreon will still allow bots that index pages and organize information that can be used to send users back to Patreon.
- Cloudflare offers tools and a marketplace (Pay Per Crawl) to restrict or charge AI bots and recently changed policies to block "mixed-use" crawlers on ad-hosting pages.
Connected Companies & Entities
4 Entities mapped“Patreon, the membership platform for creators, is cracking down on AI scraping its content for training purposes....”
“the company shared that it’s working with internet infrastructure provider Cloudflare to directly block access to AI bots designed to train ...”
“Sarah has worked as a reporter for TechCrunch since August 2011....”
“She joined the company after having previously spent over three years at ReadWriteWeb....”
Ontology Mapping & Concepts
Related Market Signals & Shifts
Recent verified developments and strategic activity across this market segment.
Cloudflare blocks mixed-use crawlers on ad pages
Cloudflare announced a policy change that, starting September 15, 2026, will by default block “mixed-use” web crawlers (those that combine search, agent use, and training) from crawling pages that host ads. The new defaults apply to new Cloudflare customers, new sites of existing customers, and all existing free customers unless site owners change their settings. Cloudflare says the change encourages AI companies to separate search crawlers from agents and training crawlers and enables new commercial opportunities for publishers, evolving its Pay Per Crawl marketplace into a Pay Per Use model. Initial partners for publisher payments are Ceramic.ai and You.com. Cloudflare also cited internal data showing over 50% of AI crawler traffic re-fetches unchanged pages, and framed the move as protecting publishers’ IP and bandwidth while reshaping access for AI model providers.
Cloudflare unveils AI-crawl controls, monetization tools
Cloudflare announced new classifications, analytics, and commercial partnerships to support an “agentic Internet” where automated agents and AI bots access web content under clearer rules. The company will test and finalize default settings over the next two months and plans to set defaults on September 15, 2026 that allow search but block training and agent use on pages with ads for new customers/sites (and for existing free customers who do not change settings). Cloudflare introduced an Attribution Business Insights dashboard, promoted Answer Engine Optimization (AEO) as a new discipline, and is evolving Pay Per Crawl into Pay Per Use to compensate publishers when their content creates value. It named partners including Ceramic.ai, You.com, beehiiv, Condé Nast and Patreon, and described prior initiatives such as AI Crawl Control and Web Bot Auth. Cloudflare says the changes aim to improve discoverability, reduce redundant crawling, and enable fairer monetization for creators.
Cloudflare introduces new controls for search crawlers, AI training, and agents.
Cloudflare is introducing new controls that let website operators separately decide whether their content can be used for traditional search, AI training, or AI agents. This aims to resolve the trade-off between being discoverable in search and protecting content from being used to train AI models. The company is replacing its 'Block AI Bots' toggle with three independent settings, including a 'Disallow AI Training' option. It is also introducing an 'Accountable' status for AI crawlers, which requires them to support independent opt-outs for AI training and search. Apple, Google, and Microsoft are already compliant or have committed to a timeline. Additionally, Cloudflare is replacing 'Managed Robots.txt' with 'Bot Preference Sync' for centralized control and is working on an open standard called 'ai-prefs' for expressing site preferences.
Track Real-Time Market Signals & Shifts
Set up custom watchlists to receive automated, evidence-grounded executive digests whenever material signals or shifts occur across your tracked landscape.