Observed Signal · Aug 5, 2025 · Policy Update · Source: Trending Topics · Impact: 4/5 · Sentiment: Negative
Cloudflare Accuses Perplexity of Using Stealth Crawlers to Bypass Blocks
Cloudflare has accused Perplexity AI of using 'stealth crawlers' to bypass website access restrictions, despite explicit blocks. Cloudflare removed Perplexity from its Verified Bot program and implemented countermeasures after customers complained about unauthorized crawling despite robots.txt directives and firewall rules. Cloudflare engineers found evidence of undeclared crawlers mimicking Google Chrome on macOS and using IP addresses outside Perplexity's official range. Perplexity's declared crawlers generate 20-25 million requests daily, while stealth crawlers add 3-6 million more across tens of thousands of domains. Perplexity denies the allegations, calling Cloudflare's claims a 'sales pitch.' The company was recently valued at $18 billion. More than one million websites, including major publishers, have blocked AI crawlers. Cloudflare is developing tools like an AI Labyrinth and a pay-per-crawl marketplace to address unauthorized scraping.
Dispute over stealth crawling affects publisher content protection, AI training data access, and the broader relationship between AI companies and content owners, a core issue for the evolving AI and media ecosystem.
Track Cloudflare Signals & Market Shifts in Real-Time
Polaris7 autonomous intelligence agents track regulatory filings, primary sources, executive changes, and deal flow 24/7. Create your free Explorer workspace to monitor these entities.
Key Takeaways & Evidence Grounding
- Cloudflare removed Perplexity from its Verified Bot program and implemented blocks against alleged stealth crawling.
- Cloudflare claims Perplexity's undeclared crawlers generate 3-6 million daily requests and mimic Google Chrome on macOS.
- Perplexity denies the allegations, calling them a Cloudflare 'sales pitch.'
- Perplexity AI was valued at $18 billion after a funding round in July 2025.
- More than one million websites, including Associated Press, Time, The Atlantic, and Reddit, have blocked AI crawlers.
Connected Companies & Entities
8 Entities mapped“Der Internet-Infrastruktur-Anbieter Cloudflare hat das KI-Unternehmen Perplexity AI beschuldigt, „Stealth-Crawler“ zu verwenden, um Webseite...”
“Perplexity AI bestreitet die Vorwürfe....”
“Während Google einen Besucher für alle 18 durchsuchten Seiten sendet, verschlechterte sich OpenAIs Verhältnis von 250 vor sechs Monaten auf ...”
“Während Google einen Besucher für alle 18 durchsuchten Seiten sendet, verschlechterte sich OpenAIs Verhältnis von 250 vor sechs Monaten auf ...”
“Mehr als eine Million Websites haben sich bereits dafür entschieden, KI-Crawler zu blockieren, darunter große Publisher wie Associated Press...”
“Mehr als eine Million Websites haben sich bereits dafür entschieden, KI-Crawler zu blockieren, darunter große Publisher wie Associated Press...”
“Mehr als eine Million Websites haben sich bereits dafür entschieden, KI-Crawler zu blockieren, darunter große Publisher wie Associated Press...”
Ontology Mapping & Concepts
Related Market Signals & Shifts
Recent verified developments and strategic activity across this market segment.
US Government Excludes Microsoft from Visa Program
The US government has barred Microsoft from participating in the permanent residency process for foreign workers with H-1B visas, accusing the company of abusing the program. Vice President JD Vance stated that Microsoft laid off 6,000 American employees last year while benefiting from 6,300 H-1B visa holders. The Department of Labor, led by Keith Sonderling, will not accept new permanent residency applications from Microsoft, as well as several consulting firms and Adobe. This action comes weeks before the midterm elections and reflects the Trump administration's broader criticism of the H-1B program, which it claims disadvantages American workers. Microsoft has not yet responded. The move could impact the tech industry's ability to retain skilled foreign talent.
US suspends Microsoft, Adobe from green card labor program
The U.S. Department of Labor announced the suspension of Microsoft and Adobe from its Permanent Labor Certification program, along with Cognizant, Infosys, Capgemini, Tata, Wipro, and HCL. Secretary Keith Sonderling cited active federal investigations for Microsoft and Adobe, and criticized the companies for allegedly taking jobs from American workers. Vice President JD Vance specifically accused Microsoft of replacing laid-off workers with H-1B visa holders. Microsoft responded by defending its hiring practices, stating that the majority of its U.S. employees are Americans and that most H-1B petitions are for existing employees. The announcement was made during a White House summit on H-1B fraud, coinciding with President Trump honoring several tech CEOs with the National Medal of Science.
Amazon unveils new Alexa tablets with AI and Google Play
Amazon has announced a new generation of tablets under the Alexa brand, including the Alexa Tablet 12 Pro, Alexa Tablet 11, and Alexa Tablet 8. All devices run on Android, integrate the AI assistant Alexa+, and for the first time offer direct access to the full Google Play Store, allowing users to install apps like YouTube, Netflix, and Gmail alongside Amazon services. The tablets feature various screen sizes, processors, and battery lives, with prices starting at $229.99. A special Kindle reading mode and new kids' models with parental controls have also been introduced. Sales begin in North America on October 8, with shipping from October 14, and European availability, including Germany, starts October 19.
Track Real-Time Market Signals & Shifts
Set up custom watchlists to receive automated, evidence-grounded executive digests whenever material signals or shifts occur across your tracked landscape.