Observed Signal · Aug 5, 2026 · Technical Release · Source: DEV Community · Impact: 3/5 · Sentiment: Neutral
Large Language Models (LLM) & AI Market: LLM Invented a Detailed, Nonexistent Company Website
A measurement study of six Chinese LLM APIs found a model confidently describing a nonexistent localized corporate website (airtable.cn), including pricing in RMB and a China-specific privacy policy. The author logged 4,023 valid responses across the corpus, discovered the domain was registered to a private individual and returned HTTP 502, and observed that seven of eight tested brand .cn domains were not owned by the brands. To detect these operationally convincing hallucinations the author recommends lightweight predicate checks on extracted URLs, simple WHOIS/DNS/HTTP lookups, repeated phrasing checks (ask the same factual question multiple ways) and strict provenance metadata for every row. The harness and validation scripts are published under CC BY 4.0 on GitHub.
Demonstrates a practical, high-risk failure mode where LLM hallucinations generate operationally convincing but false artifacts that can corrupt automated extraction/enrichment pipelines; provides simple, generalizable detection and provenance practices relevant to any system using LLM outputs as evidence.
Key Takeaways & Evidence Grounding
- The author ran a measurement harness against six Chinese LLM APIs and recorded 4,023 valid responses.
- GLM produced a confident, structured description claiming https://www.airtable.cn/ was Airtable's official China website.
- WHOIS and HTTP checks showed airtable.cn was registered to a private individual (since 2016) and the domain returned HTTP 502.
- In the author's sample of eight brand .cn domains, seven were registered to entities other than the brands themselves.
- The harness, labelled validation samples, and re-scoring scripts are published under CC BY 4.0 on GitHub (github.com/David88666/china-ai-visibility-benchmark).
Connected Companies & Entities
9 Entities mappedmonday.com
Work management and business workflow software for teams and enterprises.
“Table row: monday.cn | **the same** domain-holding company | 403...”
Airtable
No-code enterprise app-building and workflow automation software platform.
“**Airtable China Official Website (Airtable中国官网)** URL: `https://www.airtable.cn/`...”
Wrike
Enterprise work management software with subscription and add-on revenue.
“Table row: airtable.cn | private individual | 502 Table row: wrike.cn | private individual | 502...”
ClickUp
Work management software unifying tasks, docs, chat and AI.
“Table row: clickup.cn | the brand | nothing (parked)...”
GoDaddy
Domain, hosting and SMB web presence software provider.
“For contrast, the one brand in my sample that does own its `.cn`: Registrant: BRIAN TYLER EVANS Registrant Contact Email: help@clickup.com S...”
GitHub
Developer platform for code collaboration, automation and AI coding.
“Harness, labelled validation samples, and the re-scoring scripts are public under CC BY 4.0: github.com/David88666/china-ai-visibility-bench...”
Asana
Work management software for teams, enterprises, and government agencies.
“Table row: asana.cn | private individual | "domain for sale"...”
Smartsheet
Enterprise work management and workflow automation software for organisations.
“Table row: smartsheet.cn | private individual, **registered 2025** | "域名转让 — The domain is on sale!"...”
Notion
Unified workspace software for docs, knowledge and projects.
“Table row: notion.cn | a domain-holding company | 403...”
Ontology Mapping & Concepts
Track Real-Time Market Signals & Shifts
Set up custom watchlists to receive automated, evidence-grounded executive digests whenever material signals or shifts occur across your tracked landscape.