Observed Signal · May 9, 2025 · Technical Release · Source: Trending Topics · Impact: 3/5 · Sentiment: Negative
Mistral AI Pixtral models exposed generating harmful content
Enkrypt AI, an AI security provider, conducted red-team tests on Mistral AI's Pixtral-Large and Pixtral-12b multimodal image generation models. The tests found the models produced dangerous content in 68% of inputs, including child sexual exploitation material (CSEM) and chemical, biological, radiological, and nuclear (CBRN) information. Compared to OpenAI's GPT-4.0 and Anthropic's Claude 3.7 Sonnet, the Mistral models were 60 times more likely to generate CSEM and 40 times more likely to produce CBRN content. Enkrypt CEO Sahil Agarwal called the findings a wake-up call for AI safety. Mistral AI responded by reaffirming its zero-tolerance policy on child safety and stated it cooperates with the NGO Thorn on child protection measures.
Highlights significant safety flaws in open AI models, potentially affecting trust and adoption of generative AI across industries including AdTech.
Track Mistral AI Signals & Market Shifts in Real-Time
Polaris7 autonomous intelligence agents track regulatory filings, primary sources, executive changes, and deal flow 24/7. Create your free Explorer workspace to monitor these entities.
Key Takeaways & Evidence Grounding
- Enkrypt AI uncovered safety vulnerabilities in Mistral AI's Pixtral-Large (25.02) and Pixtral-12b models.
- The models generated harmful content in 68% of test inputs.
- Mistral models were 60x more likely to generate CSEM and 40x more likely to generate CBRN content than GPT-4.0 and Claude 3.7 Sonnet.
- Enkrypt AI CEO Sahil Agarwal described the research as a wake-up call.
- Mistral AI stated it cooperates with NGO Thorn on child safety.
Connected Companies & Entities
3 Entities mapped“Enkrypt AI uncovered critical security vulnerabilities in two image generation models from Mistral AI....”
“The same red-team procedure was applied to GPT-4.0 and Claude 3.7 Sonnet, and Mistral models are compared to them....”
“Claude 3.7 Sonnet from Anthropic was used as a benchmark in the comparison....”
Ontology Mapping & Concepts
Related Market Signals & Shifts
Recent verified developments and strategic activity across this market segment.
Unlocking Claude's Full Value: Plans, Workflows, and Setup
This article analyzes the economics of Anthropic's Claude subscription plans, comparing them to OpenAI's offerings. SemiAnalysis found a $200 Claude Max plan provides about $11,700 worth of Claude Opus 5.5 usage at API prices, versus roughly $2,100 for OpenAI's equivalent. Most subscribers use only a small fraction of their allowance, making the plans profitable for Anthropic. Recent product changes, including the merger of Cowork into Claude chat, new model versions (Opus 5.5, Sonnet 5.5, Haiku 5.5), and monthly API credits on Max and Team plans, make it easier to use the full allowance. The article provides a comprehensive guide with model routing tables, a map of the Claude stack, a 5-layer operating system, and 17 workflows to help users maximize their subscription value.
Hone Raises $60M for AI Agents
Hone, a San Francisco-based AI startup founded by Austrian Moritz Stephan, has raised a $60 million seed round led by Benchmark and Index Ventures, valuing the company at $285 million. Hone develops 'Engines'—autonomous AI agents that manage entire business goals over weeks or months, learning a company's systems and processes while operating under guardrails like simulated decisions and human approval for sensitive actions. Early customers include Cognition and Modal. The funding will support expansion in the competitive AI agent market, where rivals include Decagon, Sierra, and Salesforce's Agentforce. Co-founders Oliver Brady and Carlo Kobe bring experience from Harvey, Mercor, and Fizz. The company has not yet disclosed revenue or customer results.
Hone Raises $60M for AI Agents
Austrian founder Moritz Stephan's AI startup Hone, based in San Francisco, has raised $60 million in a seed round led by Benchmark and Index Ventures. The company builds autonomous AI agents, or 'engines', that manage entire business goals over weeks or months, such as improving customer retention or reducing procurement costs. Hone is valued at $285 million. Early customers include AI coding startup Cognition and AI infrastructure firm Modal. Investors Peter Fenton (Benchmark) and Shardul Shah (Index) join the board, with Elad Gil and SV Angel also participating. The funding will be used to scale operations and acquire more enterprise clients.
Track Real-Time Market Signals & Shifts
Set up custom watchlists to receive automated, evidence-grounded executive digests whenever material signals or shifts occur across your tracked landscape.