Observed Signal · Feb 1, 2025 · Abuse Report · Source: OpenAI Blog · Impact: 3/5 · Sentiment: Negative
AI-assisted romance-baiting 'pig butchering' scam
OpenAI reports that it removed a cluster of ChatGPT accounts used to translate and generate short comments in multiple languages as part of a romance-and-investment scam (also called "pig butchering"). The activity appears to have originated in Cambodia and involved posting model-generated comments publicly on social networks (including replies on Facebook, X, and Instagram) to engage targets — commonly men over 40 in medical professions — and move conversations into private messaging apps. The operators used the models mainly for translation and to craft persona-driven conversational replies that escalated from flirtation to investment pitches (cryptocurrency, forex, gold). Some conversations referenced thousands of dollars. OpenAI says it shared disruption details with industry peers and authorities and reiterated its prohibition on using its tools for fraud.
Demonstrates concrete misuse of LLMs to facilitate targeted financial scams across major social platforms, with implications for platform safety, fraud detection, and industry collaboration on abuse mitigation.
Track OpenAI Signals & Market Shifts in Real-Time
Polaris7 autonomous intelligence agents track regulatory filings, primary sources, executive changes, and deal flow 24/7. Create your free Explorer workspace to monitor these entities.
Key Takeaways & Evidence Grounding
- OpenAI banned a cluster of ChatGPT accounts that were translating and generating short comments in Japanese, Chinese, and English used in a romance/investment scam.
- The activity appears to have originated in Cambodia and is consistent with "pig butchering" (romance-baiting) scams; Meta reported related activity originating from a scam compound in Cambodia.
- Operators posted generated comments publicly on social platforms (Facebook, X, Instagram) and targeted men often over 40, frequently in medical professions, by replying to posts about golf and other topics.
- Scammers primarily used the models for translating and generating conversational replies and persona-driven messaging to move victims from public posts to private/secure messaging and then to investment apps for cryptocurrency, forex, or gold.
- OpenAI shared disruption details with industry peers and relevant authorities and stated its policies prohibit using its tools for fraud or scams.
Connected Companies & Entities
5 Entities mapped“We banned a cluster of ChatGPT accounts that were translating and generating short comments in Japanese, Chinese, and English....”
“Meta recently identified related activity on their platform that appeared to originate from a newly stood up scam compound in Cambodia....”
“Our investigation uncovered evidence of their using tools that included ... Apple’s “hide my email” function, and cryptocurrency and foreign...”
“Our investigation uncovered evidence of their using tools that included LINE, WhatsApp, X, Facebook, Instagram, a range of other messaging s...”
“Comment generated by our models, posted by a verified account on X in reply to a tweet by an account which did not appear linked to this sca...”
Ontology Mapping & Concepts
Related Market Signals & Shifts
Recent verified developments and strategic activity across this market segment.
AWNY, Jupiter Fest Spotlight Agentic Ads and Open Web
Advertising Week New York and the inaugural Jupiter Festival Miami highlighted the industry's shift toward agentic advertising and anxieties about the open web's future. Major announcements included TikTok's off-platform ad expansion and a new AI shopping agent, Meta's AI campaign assistant testing, and OpenAI's visual ads introduction. Paramount's $110 billion acquisition of Warner Bros. Discovery closed, forming Skydance. Key themes were the threat of AI to publisher traffic, the rise of AI visibility tools, the early stage of agentic media buying, unsolved cross-platform measurement, and the booming sports and retail media sectors. Deals included PubX's acquisition of Compliant and a $5 million Series A, and OpenAI's reported $30 billion round talks with BlackRock and UAE investors.
OpenAI Used AI to Write Email About AI Hack
OpenAI reportedly used AI to help compose an email informing the Australian government about a security breach in which an OpenAI AI model accessed a government portal. Guardian Australia reports, citing an unnamed source, that the legal and security departments used AI to generate parts of the email, including wording and formatting. However, the draft was reviewed by humans before being sent. The incident, which occurred on June 18, involved unauthorized access to Medicare and three other government websites. OpenAI only became aware of the breach in August and notified the government on September 10. The revelation follows a parliamentary hearing on October 6, where OpenAI's chief strategy officer Jason Kwon admitted communication was inadequate. Critics question the credibility of AI-generated communications in such serious contexts.
ICANN Receives 1,615 New Top-Level Domain Applications
The Internet Corporation for Assigned Names and Numbers (ICANN) has accepted applications for new generic top-level domains (gTLDs) for the first time since 2012. A total of 1,615 applications were submitted by 481 applicants, with a strong focus on AI-related domains. Ten companies, including Meta and OpenAI, applied for .agent, seven for .agi, and six for .asi. Meta filed 21 applications, including .instagram and .threads, while OpenAI filed 15, including .chatgpt and .codex. German entities like Adidas, Biontech, and Allianz also applied for brand-specific domains. The application fee can be up to $227,000 per domain. The article also highlights the financial success of country-code TLDs like .ai, which earned Anguilla about €59 million by November 2025.
Track Real-Time Market Signals & Shifts
Set up custom watchlists to receive automated, evidence-grounded executive digests whenever material signals or shifts occur across your tracked landscape.