Research Scientist, Open Benchmarks Red Team
Ort: New York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote) · Bereich: Data, AI & Analytics · Level: Senior · USD200,000 – USD340,000 / yearly · Veröffentlicht: 13. November 2026 · Geprüft: 16. Nov. 2026
Rollenübersicht & Beschreibung
Team-Wachstum & Marktbewegung von Snorkel AI beobachten
Polaris7 erfasst offene Vakanzen, strategische Marktbewegungen und M&A-Signale aus verifizierten Primärquellen. Erhalte strukturierte Watchlist-Briefings zu Snorkel AI und vergleiche das Ökosystem mit direkten Wettbewerbern.
Snorkel AI
snorkel.aiUnternehmensplattform für datenzentrierte KI-Entwicklung und -Bereitstellung.
Snorkel AI
Analysiere Geschäftsmodelle, operative Einheiten, Wettbewerber und aktuelle Signale der Arbeitgeber.
Ähnliche Positionen im DACH-Ökosystem
Verwandte Rollen und Profile aus dem AdTech-, Media- und Datenmarkt
This research-first role designs rubrics, benchmarks, and evaluation methods to measure whether AI works for real people over long horizons. The AI Research Engineer will build Dscout's first real-user benchmark, study human judgment as a training signal, and publish findings to the research community. Requires a PhD or MS with strong research experience in evals, preference learning, or human-AI interaction, plus strong Python and applied statistics skills.
This role builds and runs rigorous, automated, public benchmarks of data providers, publishing weekly results that rank providers on accuracy, coverage, freshness, speed, and cost. The engineer owns the test datasets, ground truth, scoring methodology, and automated harness, and feeds results back into Alexandria's provider selection. Requires 4+ years in ML or data engineering with shipped evaluation or benchmark work, strong Python skills, and experience with messy vendor APIs.
This researcher role focuses on ensuring that increasingly capable AI agents act safely and remain aligned with user intent, spanning training, measurements, and oversight. The researcher will train and evaluate frontier models, mine incidents, and build scalable measurement and evaluation systems. The role requires strong research engineering, ML engineering, or applied model research experience, with the ability to own ambiguous projects end to end.
This applied research role focuses on post-training open-source models for customers, building reward functions, training environments, and eval harnesses to outperform frontier closed models on specialized tasks. The researcher will design and run pipelines including SFT, GRPO, DPO, and RLVR, and work directly with customers to translate production data into training signal. Requires hands-on LLM fine-tuning and reinforcement learning experience, with strong intuition for reward engineering and multi-turn agent environments.
Weitere Positionen bei Snorkel AI
3 weitere offene Stellen
This research lead role heads the Open Benchmarks Grants program, providing technical direction and oversight for the development of open benchmarks. The lead will define research priorities, guide grant recipients, and ensure the benchmarks are rigorous, relevant, and impactful for the AI field.
This role focuses on building backend product capabilities for Snorkel's AI data platform, including data cataloging, agent benchmarking, and workflow automation. The engineer will own features from concept to production, working closely with Product and Design teams. Strong backend engineering fundamentals are required, with experience in Python or other languages like Java, Go, or Rust.
This engineering management role leads the team responsible for building and maintaining infrastructure for federal and regulated industry clients. The manager will oversee the development of secure, compliant, and scalable systems, ensuring they meet strict government and industry standards.
Starte mit einem Unternehmen oder Markt. Verfolge, was sich ändert.
Erstelle deinen Polaris7 Workspace, um erweiterte Company Profiles zu nutzen, relevante Akteure in Watchlists zu strukturieren und fokussierte Briefings bei Veränderungen zu erhalten.
Arbeitgeber im Überblick
Analysiere Geschäftsmodelle, operative Einheiten, Wettbewerber und aktuelle Signale der Arbeitgeber.
