Observed Signal · May 16, 2026 · Analysis · Source: t3n · Impact: 3/5 · Sentiment: Negative
LLMs Leak Personal Data, Raising Doxxing Risks
Generative large language models can inadvertently expose sensitive personal data by aggregating dispersed public records and user-contributed content. The article reports examples where models returned private phone numbers, past addresses, and employer links; Reddit users said Google Gemini returned a private number as a service hotline, and security researchers found chatbots suggesting manipulated support numbers placed by fraudsters. Model behaviour is inconsistent: ChatGPT, Gemini and Claude often refuse or limit sensitive outputs, while Grok (xAI) was observed to be more permissive. The piece warns that automated aggregation by LLMs lowers the bar to doxxing, highlights limited consumer options for removing third-party data (especially in German-speaking markets), and calls for stronger legal/political safeguards and technical controls over which personal data LLMs may reveal.
Highlights privacy risks from LLMs that can affect data availability, identity safety and may prompt regulatory or industry responses impacting targeting, identity products and compliance requirements.
Track Reddit Signals & Market Shifts in Real-Time
Polaris7 autonomous intelligence agents track regulatory filings, primary sources, executive changes, and deal flow 24/7. Create your free Explorer workspace to monitor these entities.
Key Takeaways & Evidence Grounding
- Generative AI systems can sometimes reveal private phone numbers, past addresses, employers and relations by aggregating scattered public sources.
- Reddit users reported Google Gemini returning a private phone number presented as a service hotline.
- Security researchers observed chatbots suggesting manipulated support numbers that fraudsters had intentionally placed online.
- Model behavior varies: ChatGPT, Gemini and Claude often refuse to provide sensitive personal data, while Grok from xAI was observed to be more permissive.
- Data-removal options are limited in the German-speaking region and the article recommends political and legal measures to control which personal data LLMs may expose.
Connected Companies & Entities
6 Entities mappedOntology Mapping & Concepts
Related Market Signals & Shifts
Recent verified developments and strategic activity across this market segment.
Researchers: LLMs May Never Be Fully Secure
An MIT Technology Review analysis by Will Douglas Heaven, republished on t3n.de in August 2026, warns that large language models (LLMs) exhibit fundamental security weaknesses that may be impossible to fully fix, potentially making them unsafe for high-risk applications. Researchers say LLMs routinely confuse user prompts, their internal chain-of-thought reasoning, and external tool use, enabling attackers to devise novel exploits that go beyond conventional prompt-injection attacks. The analysis cautions these intrinsic vulnerabilities have wide-reaching implications for organizations deploying AI across business, government, military, and healthcare settings. It emphasizes the problem arises from model architecture and internal reasoning processes rather than solely from poor prompt design, suggesting limits to software, policy, or monitoring mitigations for critical systems.
AI Deanonymizes Anonymous Accounts
A study titled Large-scale online deanonymization with LLM agents, led by researchers at ETH Zürich, examines whether large language models can identify real people behind pseudonymous online accounts. The researchers analyze publicly available data from Reddit, Hacker News, LinkedIn, and interview transcripts using LLM agents to extract signals such as writing style, interests, and biographical details, then cross-link profiles across platforms. In tests, the system could map anonymous accounts to the underlying individuals with a 68% hit rate at 90% precision. The work was conducted primarily at ETH Zürich, with Nicholas Carlini of Anthropic serving as scientific advisor. Analysis costs are estimated at $1–$4 per profile. The study uses curated datasets and has not yet been peer-reviewed or tested on real anonymous accounts. While such technology could aid moderation and fraud detection, it raises privacy concerns, including risks for whistleblowers and potential for misattribution, spear-phishing, and surveillance. The study also discusses countermeasures like varying writing styles, truly separating accounts, and avoiding sharing identifying biographical details.
Study Shows LLMs Can Discover Legal Loopholes
A newly posted preprint demonstrates that large language models can be trained via reinforcement learning to find loopholes in regulations, contracts and rules — a technique the researchers call “Society Hacking.” In experiments the team used Alibaba’s Qwen3 as the agent and Google’s Gemini-3-Flash as an evaluator, testing 72 simulated regulatory scenarios (about half based on real laws). The agent rediscovered over 60% of known loopholes and in some cases identified previously undocumented vulnerabilities (authors withheld specifics for safety). The researchers published code (SocioHack) on GitHub and warn that stronger, widely deployed LLMs could find more and risk misuse, prompting calls for policymakers and defenders to prioritise mitigations.
Track Real-Time Market Signals & Shifts
Set up custom watchlists to receive automated, evidence-grounded executive digests whenever material signals or shifts occur across your tracked landscape.