Baseten vs Langfuse

Goodfire Launches Internal AI Agent Monitors

Goodfire, a startup specializing in AI interpretability, launched on Thursday a new type of AI agent monitor that inspects a model's internal signals rather than reading its output, aiming to detect rogue behaviors more efficiently and at a fraction of the cost. The monitors are available to customers of Baseten, an AI model hosting platform. Baseten's Base Labs had previously announced a safety partnership with Goodfire and Hugging Face. Goodfire's approach uses small probes that scan a model's internal activations at each step, triggering a closer AI review only when flagged. In tests on the Kimi K3 model, Goodfire's monitors caught 94% of malicious hacking sessions and cost about $51 for 1,500 sessions, compared to $233 for a cheaper model and $10,000 for a top-tier one. The company positions the solution for open models, which can be stripped of safeguards, and sees it as critical for inference-time guardrails.

• Goodfire launched internal activation monitors for AI agents on October 8, 2026.
• Monitors are available to Baseten customers.
• In tests on Kimi K3, monitors caught 94% of malicious hacking sessions.

Announcing our partnership with OpenAI

Baseten announces a partnership with OpenAI, as featured on their blog.

Baseten, Hugging Face, Goodfire Partner for AI Safety

Baseten's research arm, Base Labs, announced a partnership with Hugging Face and Goodfire AI to establish a safety standard for open-weight AI models. The collaboration aims to develop and publish methods for training and monitoring these models, making safety an integrated feature rather than an afterthought. This comes amid rising concern over 'abliteration,' a technique that removes safeguards from open models, with Hugging Face listing over 6,000 such models. The companies have not detailed technical specifics, but Goodfire's expertise in AI interpretability is expected to play a key role. This initiative seeks to leverage openness as an advantage for safety, providing transparent controls and encouraging community contributions.

• Baseten launched a safety infrastructure standard via Base Labs.
• Partnership with Hugging Face and Goodfire AI announced.
• Hugging Face hosts over 6,000 abliterated models.

See which projects drive your usage

A new chart shows your organization's units over time, grouped by project or type, with a CSV export. On Langfuse Cloud it is on the Billing page; self-hosted deployments get a new Usage page.

Langfuse CLI 1.0 and new evaluator features

Langfuse CLI 1.0 released, along with new evaluator template gallery and reusable evaluators for production evaluations.

Deploying Langfuse Open-Source LLM Observability

This technical guide explains how to deploy Langfuse, an open-source observability platform for LLM applications, using Docker Compose. The deployment uses PostgreSQL for metadata, ClickHouse for trace and metrics analytics, Redis for cache/queueing, and S3-compatible object storage for media/exports, with Traefik and Let's Encrypt providing TLS. The article includes required prerequisites (Linux server 4 vCPU / 16GB RAM, Docker + Docker Compose, domain A record), step-by-step environment and docker-compose configuration, first-run setup (create organization/project and API keys), and a test-trace example using the Langfuse SDK and an OpenAI-compatible client. Publication date: 2026-08-12.

• Langfuse is an open-source observability platform for LLM applications that traces prompts/responses, tracks token usage and cost, and provides debugging analytics.
• The guide deploys Langfuse via Docker Compose using Traefik (TLS), PostgreSQL (metadata), ClickHouse (trace/metrics analytics), Redis (cache/queue), and S3-compatible object storage.
• Container images and versions shown include traefik:v3.7.0, postgres:17, clickhouse/clickhouse-server:26.5.1-alpine, and redis:7-alpine; Langfuse images used are langfuse/langfuse:3 and langfuse/langfuse-worker:3.