Baseten vs Reflection

Goodfire Launches Internal AI Agent Monitors

Goodfire, a startup specializing in AI interpretability, launched on Thursday a new type of AI agent monitor that inspects a model's internal signals rather than reading its output, aiming to detect rogue behaviors more efficiently and at a fraction of the cost. The monitors are available to customers of Baseten, an AI model hosting platform. Baseten's Base Labs had previously announced a safety partnership with Goodfire and Hugging Face. Goodfire's approach uses small probes that scan a model's internal activations at each step, triggering a closer AI review only when flagged. In tests on the Kimi K3 model, Goodfire's monitors caught 94% of malicious hacking sessions and cost about $51 for 1,500 sessions, compared to $233 for a cheaper model and $10,000 for a top-tier one. The company positions the solution for open models, which can be stripped of safeguards, and sees it as critical for inference-time guardrails.

• Goodfire launched internal activation monitors for AI agents on October 8, 2026.
• Monitors are available to Baseten customers.
• In tests on Kimi K3, monitors caught 94% of malicious hacking sessions.

Announcing our partnership with OpenAI

Baseten announces a partnership with OpenAI, as featured on their blog.

Baseten, Hugging Face, Goodfire Partner for AI Safety

Baseten's research arm, Base Labs, announced a partnership with Hugging Face and Goodfire AI to establish a safety standard for open-weight AI models. The collaboration aims to develop and publish methods for training and monitoring these models, making safety an integrated feature rather than an afterthought. This comes amid rising concern over 'abliteration,' a technique that removes safeguards from open models, with Hugging Face listing over 6,000 such models. The companies have not detailed technical specifics, but Goodfire's expertise in AI interpretability is expected to play a key role. This initiative seeks to leverage openness as an advantage for safety, providing transparent controls and encouraging community contributions.

• Baseten launched a safety infrastructure standard via Base Labs.
• Partnership with Hugging Face and Goodfire AI announced.
• Hugging Face hosts over 6,000 abliterated models.

Three AI Models Tackle Different Bottlenecks

The article analyzes three recent AI releases, each addressing a distinct constraint: Reflection's Beam focuses on efficient agent reasoning, Google's EmbeddingGemma 2 enables cross-modal search, and Mistral Large 4 combines sparse scale with visual understanding. The author suggests viewing these as complementary components in a system architecture rather than competing on parameter counts. The piece implies a practical design: retrieve relevant evidence, reason economically, and inspect the world visually when needed. It uses a software deployment debugging scenario to illustrate how these models could work together, highlighting the importance of bottleneck-specific computation allocation.

• Reflection released Beam, a model focused on agent reasoning efficiency.
• Google released EmbeddingGemma 2, enabling search across different media types.
• Mistral released Large 4, combining sparse scale with visual understanding.

Reflection AI launches open-weight model Beam at lower compute cost

This update covers recent AI advancements. Elorian and Scale AI released 'Humanity's Sixth Sense', a benchmark for intuitive visual reasoning, where frontier models like GPT-6 Astra scored 53.6% versus a 93.1% human baseline. In open-weight models, Reflection unveiled Beam, a 501B-parameter MoE model claiming to match Z.ai's GLM-5.2 while using less compute, though independent analyses place it below DeepSeek V4 Flash. Mistral introduced Mistral Large 4, a 1T-parameter multimodal model. Additionally, P-Zero Research's TasteVal benchmark suggests AI research taste is doubling every three months, potentially accelerating recursive self-improvement. The issue also touches on AI in space industrialization and US government federated training. In consumer AI, a16z's Olivia Moore sees growth opportunities in alternative monetization, noting only 2.2% of US households currently pay for AI.

• Reflection AI launched Beam, a 501B-parameter open-weight MoE model, with weights and details due this month.
• Elorian and Scale AI released 'Humanity's Sixth Sense' benchmark; GPT-6 Astra scored 53.6% vs. 93.1% human baseline.
• Mistral released Mistral Large 4, a 1T-parameter multimodal model, while Beam is claimed to match GLM-5.2 in reasoning with less compute.