Observed Signal · Sep 8, 2026 · Research · Source: The Drum · Impact: 3/5 · Sentiment: Neutral
AI in Advertising Market: AI Can't Spot AI Ads but Can Judge Human Creative Quality
Andrew Tindall, a senior leader at System1, explores whether AI can effectively evaluate human-made advertising, given that humans cannot reliably identify AI-generated ads. He cites four major studies over ten months, including NYU Stern's 'AI Advertising Paradox' (AI ads outperformed human ads by up to 19% without disclosure, but performance dropped 31.5% when disclosed) and a Taboola study with 500M+ impressions finding similar results for short-term metrics like CTR. In his own experiment, he ran ten well-known human-made ads through System1's AI testing tool, comparing its predictions to human-based ratings. Results show the AI predicted the Fluency Rating correctly 10 out of 10 times and the Star Rating 9 out of 10 times, with one refusal to score. AI performed best at extreme high and low performers, struggled with mid-table ads, and highlighted the importance of acknowledging uncertainty. Tindall concludes that AI is a probabilistic prediction machine, better used to supplement rather than replace human judgment in creative testing.
Highlights the growing role of AI in creative testing and its limitations, relevant to AdTech and marketing effectiveness.
Wichtigste Kernpunkte & Evidenz
- NYU Stern and Emory study found AI ads outperformed human ads by up to 19% without disclosure, but performance dropped 31.5% when AI involvement was disclosed.
- Taboola, Columbia, Harvard, TUM, and Carnegie Mellon study used 500M+ impressions and found 45% of AI ads were rated as likely human-made.
- System1's AI testing tool correctly predicted Fluency Rating 10/10 times and Star Rating 9/10 times on ten human-made ads.
- The AI declined to score Claude's Super Bowl ad, which received the lowest human testing score.
- In both human and AI testing, Coca-Cola's AI Christmas ad scored 5-Stars, indicating high performance.
Verknüpfte Unternehmen
10 verknüpfte UnternehmenMeta
Konsumentenorientierte Internet-Plattformen, die durch digitale Werbung, Apps, Abonnements und Virtual Reality monetarisiert werden.
“Meta's Ray-Ban campaign was correctly pegged as low-performing by AI....”
Anthropic
Anbieter von KI-Basismodellen, der intelligente KI-Assistenten und Modell-APIs für Entwickler und Unternehmen bereitstellt.
“Claude, made by Anthropic, had a Super Bowl ad that the AI refused to score....”
Samsung Electronics
Globaler Elektronikhersteller, der Hardware, Streaming, Werbung und digitale Dienste über ein vernetztes Ökosystem monetarisiert.
“Samsung's Galaxy S26 launch ad was rated 4-Star by humans, but AI could not narrow it beyond 'not a 1-Star'....”
Apple
Globaler Technologiekonzern mit integriertem Betriebssystem-Ökosystem, proprietärer Consumer-Hardware und einem hochskalierbaren First-Party-Advertising- und Services-Netzwerk.
“Apple's email-rewriting ad scored 1-Star in both human and AI testing....”
System1
Performance-Marketing-Plattform mit eigenen Medien und absichtsgesteuerter Monetarisierung.
“Andrew Tindall leads growth at System1, and the AI testing tool, Test Your Ad, is a System1 product....”
Taboola
Eine führende Performance-Advertising- und Publisher-Monetarisierungsplattform für das Open Web.
“Taboola's study found 45% of AI-generated ads were rated as likely human-made....”
Coca‑Cola
Globaler Markeninhaber und Plattform-Anbieter für alkoholfreie Getränke mit einem hochskalierten B2B-Franchise- und Distributionsökosystem.
“Coca-Cola's AI Christmas ad scored 5-Stars in both human and AI testing....”
OpenAI
Anbieter von Foundation-Modellen, der KI-Software, APIs und Abonnements für Entwickler, Unternehmen und Endverbraucher vertreibt.
“ChatGPT, made by OpenAI, had a pre-pivot Super Bowl ad that scored 1-Star in both human and AI testing....”
Harvard Business Review
Harvard Business Review bietet erstklassige Management-Inhalte, Executive Research und Abonnements für globale Führungskräfte.
“HBR study of 20 ads found AI underperforms compared to human-made ads....”
Suchmaschinen-, Video-, AdTech- und Cloud-Gigant innerhalb des Alphabet-Konzerns.
“Google's Gemini 'Dream Job' ad scored 3.1-Star in human testing and was correctly pegged as high performing by AI....”
Ontology Mapping & Concepts
Track Real-Time Market Signals & Shifts
Set up custom watchlists to receive automated, evidence-grounded executive digests whenever material signals or shifts occur across your tracked landscape.