ASAPP Logo
ASAPP· HQ in ONE WORLD TRADE CENTER, 80TH FLOOR, NEW YORK, NY 10007

Lead Machine Learning Engineer, Evaluations

Location: Mountain View · Category: Data, AI & Analytics · Seniority: Lead · Posted: September 11, 2026 · Verified: Sep 24, 2026

Role Overview & Description

This Lead Machine Learning Engineer role owns and grows the evaluation platform for ASAPP's agentic AI systems, designing frameworks to measure quality, safety, and performance. The role involves working closely with research and modeling teams to build state-of-the-art NLP models and deploy them in production, ensuring that model changes are validated before reaching customers.
Hiring Telemetry · Expansion Signal

Track team expansion and market signals for ASAPP

Polaris7 tracks open roles, strategic market movements, and M&A developments from verified primary sources. Receive structured Watchlist briefings on ASAPP and benchmark against direct competitors.

Source & Transparency: This position was structured directly from the publicly accessible career portal of ASAPP. Details on the employer’s original job posting are authoritative. Polaris7 charges no placement fees and conducts no candidate screening.
Company IntelligenceVerified Profile

AI-native customer experience software for enterprise contact centres.

Headquarters: ONE WORLD TRADE CENTER, 80TH FLOOR, NEW YORK, NY 10007

Similar Positions in DACH

Related roles across advertising, media, and data

Re-check scheduledTaipei, TaiwanData, AI & AnalyticsMid-Level

This role focuses on end-to-end development of ML models and evaluation methods for enterprise solutions, from problem definition to production deployment. The scientist will design and deploy optimization solutions, build reliable evaluation methods for LLM output, and validate hypotheses through A/B tests. Requires a Master's or PhD in a technical field, at least 2 years of ML experience (5+ preferred), hands-on experience with ML models and quality evaluation, and an AI-native development approach using coding agents.

Re-check scheduledPalo Alto, CAEngineering & DevelopmentMid-Level

This role designs and builds evaluation infrastructure for AI models, creating tools for dataset cleaning, experiment feedback, and tracking model growth during training. The engineer will diagnose agent failures and translate quality and safety metrics into concrete criteria, requiring strong software engineering skills and attention to detail.

Re-check scheduledTaipei, TaiwanData, AI & AnalyticsMid-Level

This role focuses on designing, developing, and productionizing enterprise AI agents (Marketing, Strategy, Data Analysis, Sales & Service) for marketing applications. The scientist will own agent features end-to-end, build reusable skills and MCP tools, integrate predictive models, and design evaluation frameworks using LLM-as-a-judge and production trace review. Requires strong Python, SQL, and experience with agent harnesses and context engineering to optimize latency and cost.

Verified 1d agoRemoteRemoteEngineering & DevelopmentMid-Level

This role builds eval infrastructure, benchmarks, and judge calibration for agent capabilities at Nous Research. The engineer will focus on measuring and improving AI agent performance through rigorous evaluation frameworks. This position requires strong machine learning engineering skills and experience with LLM evaluation methodologies.

More Positions at ASAPP

3 more open roles

Re-check scheduledNew YorkProduct & DesignExecutive

This Chief Product Officer role at ASAPP is responsible for leading the overall product vision, strategy, and execution for the company's AI-powered customer experience platform. The role involves overseeing the product organization, driving innovation, and ensuring alignment with business goals.

Re-check scheduledNew YorkEngineering & DevelopmentLead

This role leads and builds the Agent Developer team within ASAPP's Delivery organization, designing frameworks, standards, and playbooks for developing and maintaining AI agents deployed for customers. It is a player-coach role requiring hands-on technical work, close partnership with Project Managers and Forward Deployed Engineers, and direct customer engagement to continuously improve agent development practices.

Re-check scheduledNew YorkProduct & DesignSenior

This Senior AI Project Manager role manages customer-facing software and AI delivery projects from initiation through closure, coordinating across technical and business teams to ensure clear communication and predictable execution. It is a player-coach role that involves hands-on project management, mentoring team members, and driving delivery discipline across strategic enterprise engagements.

Start with a company or market. Track what changes.

Create your Polaris7 workspace to explore extended company profiles, organize relevant players into Watchlists, and receive focused briefings when material changes occur.