Observed Signal · Feb 15, 2024 · Threat Intelligence Report · Source: Trending Topics · Impact: 2/5 · Sentiment: Negative
State-Backed Hackers Use ChatGPT for Cyber Attacks
Microsoft and OpenAI published a threat intelligence report showing that state-backed hacking groups from Russia, North Korea, Iran and China are experimenting with large language models such as ChatGPT to improve their cyber operations. Observed uses include target research, malware refinement, social engineering and vulnerability research. Microsoft identified the Russian-linked group Strontium using LLMs to study satellite communications and radar imaging technologies, North Korea's Thallium researching public vulnerabilities and scripting, and Iran's Curium generating phishing emails and antivirus-evading code. The companies said they have not yet confirmed any significant attacks using LLMs, but they have closed accounts and resources linked to the groups. Microsoft also warned about AI-driven voice-cloning fraud and is developing 'Security Copilot', an AI assistant to help cybersecurity professionals detect breaches and manage security data.
High-profile warning from Microsoft/OpenAI about nation-state misuse of LLMs; relevant to AI security and enterprise trust but not directly impacting AdTech operations.
Track Microsoft Signals & Market Shifts in Real-Time
Polaris7 autonomous intelligence agents track regulatory filings, primary sources, executive changes, and deal flow 24/7. Create your free Explorer workspace to monitor these entities.
Key Takeaways & Evidence Grounding
- Microsoft and OpenAI released research on state-affiliated hackers from Russia, North Korea, Iran and China using LLMs such as ChatGPT.
- Microsoft named hacker groups Strontium, Thallium and Curium as users of LLMs for reconnaissance, phishing, and malware refinement.
- The companies said they have not observed significant attacks using LLMs yet.
- Microsoft and OpenAI have shut down accounts and resources associated with the identified hacker groups.
- Microsoft is developing 'Security Copilot' to help cybersecurity experts identify breaches and manage security data.
Connected Companies & Entities
2 Entities mapped“Microsoft und OpenAI warnen nun davor und präsentieren Einblicke in ihre Untersuchungen hierzu....”
“Microsoft und OpenAI warnen nun davor und präsentieren Einblicke in ihre Untersuchungen hierzu....”
Ontology Mapping & Concepts
Related Market Signals & Shifts
Recent verified developments and strategic activity across this market segment.
Fired OpenAI Researchers Dispute Misconduct Claims, Warn of Chilling Effect
Three OpenAI safety researchers, Jasmine Wang, Tomek Korbak, and Mikita Balesni, who were fired last week, have published an open letter denying allegations of mishandling sensitive information. They warn that their dismissal creates a chilling effect that stifles AI safety work and open dialogue within the company. The researchers say they acted in good faith and within company norms, and that the reasons for their firing are unclear. They urge OpenAI to uphold its commitments to third-party safety auditors and maintain a transparent culture. OpenAI responded with an internal memo denying retaliation and stating that employees are not terminated for raising concerns, but did not address specific policy violations or circumstances of the dismissal. The dispute highlights tensions between internal safety research and company communication policies at a time when OpenAI faces scrutiny over safety incidents.
Ben Affleck's AI Knowledge Goes Viral
Ben Affleck, the actor who sold his AI filmmaking startup to Netflix for a reported $587 million, has gone viral for demonstrating deep understanding of AI technology in recent interviews. He discussed machine learning, neural networks, and even admitted to writing Python scripts. Affleck detailed his journey from analog to digital film, his use of AI in visual effects, and his creation of a proprietary dataset for ethical AI filmmaking. He also visited OpenAI and used his celebrity status to access emerging tech. Affleck addressed AI's potential, expressing concerns about its effect on education and learned helplessness rather than existential threats. He used AI in his movie 'Animals' and emphasized the additive nature of AI in filmmaking.
AI Leaderboard Arena Raises $200M at $3.1B Valuation
Arena, the AI leaderboard platform that originated as a UC Berkeley research project, has raised a $200 million Series B round at a $3.1 billion valuation. The round was led by Lightspeed Venture Partners and Khosla Ventures, with participation from Salesforce Ventures, 01 Advisors, Dell Technologies Capital, Endeavor Catalyst, a16z, Felicis, and others. This follows the company's announcement in June that it reached $100 million in annualized run-rate revenue. Arena provides a crowdsourced platform where users rate AI model outputs, and it has introduced a commercial product called AI Evaluations to offer detailed performance analytics. The company has also added a new 'alignment' category to its leaderboard, ranking models on issues like unauthorized actions and deceptive completion. Arena's valuation has nearly doubled in about 10 months, from $1.7 billion post-money in January to $3.1 billion now.
Track Real-Time Market Signals & Shifts
Set up custom watchlists to receive automated, evidence-grounded executive digests whenever material signals or shifts occur across your tracked landscape.