Observed Signal · Aug 5, 2026 · Technical Release · Source: DEV Community · Impact: 3/5 · Sentiment: Neutral
Large Language Models (LLM) & AI Market: LLM Invented a Detailed, Nonexistent Company Website
A measurement study of six Chinese LLM APIs found a model confidently describing a nonexistent localized corporate website (airtable.cn), including pricing in RMB and a China-specific privacy policy. The author logged 4,023 valid responses across the corpus, discovered the domain was registered to a private individual and returned HTTP 502, and observed that seven of eight tested brand .cn domains were not owned by the brands. To detect these operationally convincing hallucinations the author recommends lightweight predicate checks on extracted URLs, simple WHOIS/DNS/HTTP lookups, repeated phrasing checks (ask the same factual question multiple ways) and strict provenance metadata for every row. The harness and validation scripts are published under CC BY 4.0 on GitHub.
Demonstrates a practical, high-risk failure mode where LLM hallucinations generate operationally convincing but false artifacts that can corrupt automated extraction/enrichment pipelines; provides simple, generalizable detection and provenance practices relevant to any system using LLM outputs as evidence.
Wichtigste Kernpunkte & Evidenz
- The author ran a measurement harness against six Chinese LLM APIs and recorded 4,023 valid responses.
- GLM produced a confident, structured description claiming https://www.airtable.cn/ was Airtable's official China website.
- WHOIS and HTTP checks showed airtable.cn was registered to a private individual (since 2016) and the domain returned HTTP 502.
- In the author's sample of eight brand .cn domains, seven were registered to entities other than the brands themselves.
- The harness, labelled validation samples, and re-scoring scripts are published under CC BY 4.0 on GitHub (github.com/David88666/china-ai-visibility-benchmark).
Verknüpfte Unternehmen
9 verknüpfte Unternehmenmonday.com
Eine hochgradig anpassbare B2B-Work-Management- und Business-Workflow-Plattform zur teamübergreifenden Orchestrierung komplexer Geschäftsprozesse.
“Table row: monday.cn | **the same** domain-holding company | 403...”
Airtable
Eine No-Code-Plattform für den Aufbau von Enterprise-Anwendungen und die Automatisierung von Workflows.
“**Airtable China Official Website (Airtable中国官网)** URL: `https://www.airtable.cn/`...”
Wrike
Enterprise-Work-Management-Software mit wiederkehrenden Abonnement-Einnahmen und kostenpflichtigen Add-ons.
“Table row: airtable.cn | private individual | 502 Table row: wrike.cn | private individual | 502...”
ClickUp
Eine kollaborative B2B-Work-Management-Plattform, die Aufgaben, Dokumente, Team-Chat und generative KI-Assistenten in einem einheitlichen Workspace konsolidiert.
“Table row: clickup.cn | the brand | nothing (parked)...”
GoDaddy
Führender Anbieter von Domainregistrierung, Webhosting und Webpräsenz-Software für kleine und mittlere Unternehmen.
“For contrast, the one brand in my sample that does own its `.cn`: Registrant: BRIAN TYLER EVANS Registrant Contact Email: help@clickup.com S...”
GitHub
GitHub ist die führende cloudbasierte Entwicklungsplattform für kollaborative Softwareentwicklung, CI/CD-Automatisierung und KI-gestützte Codierung.
“Harness, labelled validation samples, and the re-scoring scripts are public under CC BY 4.0: github.com/David88666/china-ai-visibility-bench...”
Asana
Eine führende Work-Management-Plattform für Teams, Unternehmen und Regierungsbehörden zur effizienten Koordination von Aufgaben und Projekten.
“Table row: asana.cn | private individual | "domain for sale"...”
Smartsheet
Enterprise-Arbeitsmanagement- und Workflow-Automatisierungssoftware für globale Unternehmen.
“Table row: smartsheet.cn | private individual, **registered 2025** | "域名转让 — The domain is on sale!"...”
Notion
Eine vereinheitlichte All-in-One-Workspace-Plattform, die Dokumentation, Wissensdatenbanken, Datenbanken und Projektmanagement in einer kollaborativen Oberfläche konsolidiert.
“Table row: notion.cn | a domain-holding company | 403...”
Ontology Mapping & Concepts
Track Real-Time Market Signals & Shifts
Set up custom watchlists to receive automated, evidence-grounded executive digests whenever material signals or shifts occur across your tracked landscape.