OpenProject vs Prometheus

OpenProject 17.8: Create and update with AI in OpenProject (Enterprise add-on)

OpenProject 17.8 takes the next step in connecting AI assistants with your project work. The MCP Server introduced in OpenProject 17.2 can now create and update work packages, add comments, and manage...

News from the Product Desk: The future of agile reporting in OpenProject

High-performing agile teams do not just deliver work, they reflect on it. That habit of stopping after every sprint to ask what went well, what did not, and what should we change is the heartbeat of continuous…

RAG Optimization Cuts Latency 40% with Bayesian Search

This six-month production case study describes scaling Retrieval-Augmented Generation by replacing naive fixed-token chunking with document-aware strategies (recursive clause/function splitting for contracts and API reference, semantic chunking for support tickets, and agentic LLM chunking for internal wiki), deploying a hybrid retrieval stack (BM25 + vector fused via Reciprocal Rank Fusion, then cross-encoder rerank top 50 → top 5), adding query transformation/expansion (3–5 generated queries), and automating Bayesian hyperparameter optimization with Optuna on a stratified ~200-query golden set. Observability (Prometheus, sampled golden-set evaluation, query telemetry) and A/B feature flags enabled continuous evaluation. Optuna produced a recall–latency Pareto frontier and selected a Balanced production configuration (recall@10 95%, p95 latency ≈320ms). Over six months recall@10 rose 78%→95%, p95 latency fell 850ms→320ms, hallucination dropped 12%→3%, and cost/query fell $0.008→$0.005.

• Six-month impact: recall@10 78% → 95% (+17 pp); p95 latency 850ms → 320ms (−62%); hallucination rate 12% → 3% (−75%); cost/query $0.008 → $0.005 (−38%).
• Document-aware chunking with per-type configs and example recall@10: contracts (recursive, chunk_size=1024, overlap=100) 94%; API reference (recursive, 768 tokens) 96%; support tickets (semantic, 512 tokens) 91%; internal wiki (agentic LLM chunking, 1500 tokens) 97%.
• Hybrid retrieval pipeline: BM25 + vector search fused via Reciprocal Rank Fusion, then cross-encoder rerank (top 50 → top 5); reranker adds ~50ms and yields ≈+15 percentage points recall in the rerank stage.

Practical Observability with OpenTelemetry and Prometheus

This technical guide explains how to implement production-grade observability for a Node.js microservice using OpenTelemetry, Prometheus, Grafana, and automated CI/CD validation with GitHub Actions. The article provides a complete, production-ready checkout endpoint example that instruments counters and histograms to capture throughput, status dimensions, and latency distributions with high-cardinality attributes. It advocates writing against the vendor-neutral OpenTelemetry API to avoid vendor lock-in, using the Prometheus exporter to expose metrics (port 9464), and visualizing percentiles (p95/p99) in Grafana. The repo layout includes Prometheus/Grafana docker-compose manifests, unit tests, and a GitHub Actions pipeline (checkout, Node setup, linting, tests) to validate telemetry and deployment. The post emphasizes multidimensional metrics over flat metric names and records best practices for structured logging and CI-driven telemetry validation.

• Article provides a production-ready Node.js microservice example instrumenting a checkout endpoint with OpenTelemetry.
• Uses OpenTelemetry PrometheusExporter to expose metrics (noted as running at http://localhost:9464/metrics).
• Defines a payment_requests_total counter and payment_processing_duration_ms histogram to capture throughput, status, and latency.