Snorkel AI Logo
Snorkel AI· Hauptsitz in Redwood City, California

Research Scientist, Open Benchmarks Red Team

Ort: New York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote) · Bereich: Data, AI & Analytics · Level: Senior · USD200,000 – USD340,000 / yearly · Veröffentlicht: 13. November 2026 · Geprüft: 16. Nov. 2026

Rollenübersicht & Beschreibung

This role focuses on red-teaming frontier AI benchmarks to identify weaknesses such as reward hacking, grader failures, and task ambiguity. The researcher will develop and validate fixes, create reusable methods for benchmark quality improvement, and collaborate with benchmark authors to publish improved versions. Requires strong Python skills, experience with LLM/agent evaluation, and a research or engineering background in machine learning.
Hiring Telemetrie · Expansions-Signal

Team-Wachstum & Marktbewegung von Snorkel AI beobachten

Polaris7 erfasst offene Vakanzen, strategische Marktbewegungen und M&A-Signale aus verifizierten Primärquellen. Erhalte strukturierte Watchlist-Briefings zu Snorkel AI und vergleiche das Ökosystem mit direkten Wettbewerbern.

Quellenhinweis & Transparenz: Diese Position wurde direkt über das öffentlich zugängliche Karriereportal von Snorkel AI erfasst. Maßgeblich sind die Angaben auf der Original-Stellenausschreibung des Arbeitgebers. Polaris7 erhebt keine Vermittlungsgebühren und führt kein Bewerber-Screening durch.
UnternehmensanalyseProfil aktiv
Snorkel AI Logo

Snorkel AI

snorkel.ai

Unternehmensplattform für datenzentrierte KI-Entwicklung und -Bereitstellung.

Hauptsitz: Redwood City, California

Ähnliche Positionen im DACH-Ökosystem

Verwandte Rollen und Profile aus dem AdTech-, Media- und Datenmarkt

Vor 3 Wochen verifiziertSan Francisco, CAData, AI & AnalyticsSenior

This research-first role designs rubrics, benchmarks, and evaluation methods to measure whether AI works for real people over long horizons. The AI Research Engineer will build Dscout's first real-user benchmark, study human judgment as a training signal, and publish findings to the research community. Requires a PhD or MS with strong research experience in evals, preference learning, or human-AI interaction, plus strong Python and applied statistics skills.

Veröffentlicht 29. Okt. 2026
Prüfung geplantSan Francisco HQ; Toronto HubData, AI & AnalyticsSenior

This role builds and runs rigorous, automated, public benchmarks of data providers, publishing weekly results that rank providers on accuracy, coverage, freshness, speed, and cost. The engineer owns the test datasets, ground truth, scoring methodology, and automated harness, and feeds results back into Alexandria's provider selection. Requires 4+ years in ML or data engineering with shipped evaluation or benchmark work, strong Python skills, and experience with messy vendor APIs.

Veröffentlicht 29. Sept. 2026
Prüfung geplantSan FranciscoData, AI & AnalyticsSenior

This researcher role focuses on ensuring that increasingly capable AI agents act safely and remain aligned with user intent, spanning training, measurements, and oversight. The researcher will train and evaluate frontier models, mine incidents, and build scalable measurement and evaluation systems. The role requires strong research engineering, ML engineering, or applied model research experience, with the ability to own ambiguous projects end to end.

Veröffentlicht 3. Sept. 2026
Prüfung geplantSan FranciscoData, AI & AnalyticsSenior

This applied research role focuses on post-training open-source models for customers, building reward functions, training environments, and eval harnesses to outperform frontier closed models on specialized tasks. The researcher will design and run pipelines including SFT, GRPO, DPO, and RLVR, and work directly with customers to translate production data into training signal. Requires hands-on LLM fine-tuning and reinforcement learning experience, with strong intuition for reward engineering and multi-turn agent environments.

Veröffentlicht 7. Okt. 2026

Weitere Positionen bei Snorkel AI

3 weitere offene Stellen

Vor 2 Tagen verifiziertNew York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote)RemoteData, AI & AnalyticsLead

This research lead role heads the Open Benchmarks Grants program, providing technical direction and oversight for the development of open benchmarks. The lead will define research priorities, guide grant recipients, and ensure the benchmarks are rigorous, relevant, and impactful for the AI field.

Veröffentlicht 2. Nov. 2026
Vor 2 Tagen verifiziertSan Francisco, CA (Hybrid)Engineering & SoftwareentwicklungSeniorUSD208,000 – USD315,000

This role focuses on building backend product capabilities for Snorkel's AI data platform, including data cataloging, agent benchmarking, and workflow automation. The engineer will own features from concept to production, working closely with Product and Design teams. Strong backend engineering fundamentals are required, with experience in Python or other languages like Java, Go, or Rust.

Veröffentlicht 27. Okt. 2026
Vor 2 Tagen verifiziertSan Francisco, CA (Hybrid); United States (Remote)RemoteEngineering & SoftwareentwicklungSenior

This engineering management role leads the team responsible for building and maintaining infrastructure for federal and regulated industry clients. The manager will oversee the development of secure, compliant, and scalable systems, ensuring they meet strict government and industry standards.

Veröffentlicht 20. Okt. 2026

Starte mit einem Unternehmen oder Markt. Verfolge, was sich ändert.

Erstelle deinen Polaris7 Workspace, um erweiterte Company Profiles zu nutzen, relevante Akteure in Watchlists zu strukturieren und fokussierte Briefings bei Veränderungen zu erhalten.