DS
Dscout· HQ in 222 N LaSalle St Suite 650 Chicago, IL 60601, US

AI Research Engineer

Location: San Francisco, CA · Category: Data, AI & Analytics · Seniority: Senior · Posted: October 29, 2026 · Verified: Oct 30, 2026

Role Overview & Description

This research-first role focuses on designing rubrics, benchmarks, and evaluation methods to measure whether AI models work for real people over long horizons. The engineer will build quality signals, calibrate AI judges against human judgment, and publish methods and benchmarks to the research community. Requires a PhD or MS with strong research experience in evals, preference learning, or human-AI interaction, plus strong Python and applied statistics skills.
Hiring Telemetry · Expansion Signal

Track team expansion and market signals for Dscout

Polaris7 monitors open roles, strategic market movements, and M&A developments in real time. Get automated intelligence briefings on Dscout and benchmark against direct competitors.

Source & Transparency: This position was structured directly from the publicly accessible career portal of Dscout. Details on the employer’s original job posting are authoritative. Polaris7 charges no placement fees and conducts no candidate screening.
Company IntelligenceVerified Profile
DS

Qualitative research software for remote user and market insight studies.

Headquarters: 222 N LaSalle St Suite 650 Chicago, IL 60601, US

Similar Positions in DACH

Related roles across advertising, media, and data

Re-check scheduledSan FranciscoData, AI & AnalyticsSenior

Designs evaluation methodologies for frontier AI models, assessing capabilities and safety. Requires deep expertise in AI research and model evaluation.

Re-check scheduledSan FranciscoData, AI & AnalyticsSenior

Conducts independent research in AI training data and evaluation, focusing on advancing the field and publishing findings. Requires deep expertise in machine learning and research methodologies.

Re-check scheduledNew York City, USAData, AI & AnalyticsMid-Level

This role focuses on designing and implementing evaluation systems for frontier AI models, including building datasets, benchmarks, and automated evaluation pipelines. It requires strong ML engineering skills and experience with large-scale data processing to assess model capabilities and safety.

Re-check scheduledSan FranciscoData, AI & AnalyticsSenior

Conducts advanced research in AI training data and evaluation, contributing to publications and advancing the field. Requires deep expertise in machine learning and research methodologies.

More Positions at Dscout

3 more open roles

Verified 5d agoRemote - USRemoteEngineering & DevelopmentSenior

This forward deployed engineer role partners with Strategic Project Leads to scope and build custom technical solutions for AI labs and product teams, turning fuzzy customer briefs into technical plans. The engineer will build capture flows, data pipelines, and delivery systems across web, mobile, and backend, while owning technical decisions and moving repeat builds into the core platform. Requires 7+ years of full-stack production experience, direct customer-facing work, and hands-on experience with AI coding agents and LLMs.

Verified 5d agoRemote - USRemoteCustomer Success & Client OperationsMid-Level

This role acts as a Dscout expert, training and educating clients on platform features while providing recommendations for research design and assisting in running research projects. The advisor will support clients in planning, designing, recruiting, fielding, and analyzing research, while also acting as a customer advocate to improve the product. Requires 1-4 years of client-facing experience and a background in design research, psychology, or a related field.

Verified 5d agoRemoteRemoteEngineering & DevelopmentMid-Level

This Cybersecurity Engineer role builds security into the Dscout SaaS environment, applying controls throughout the software development lifecycle and securing AWS resources. The engineer will enhance security monitoring with SIEM, respond to cyber incidents, and provide threat intelligence reports. Requires 3+ years of security experience with AWS and infrastructure-as-code expertise.