X
X· HQ in United States

Software Engineer, Evals

Location: Palo Alto, CA · Category: Engineering & Development · Seniority: Mid-Level · Posted: August 29, 2026 · Verified: Nov 16, 2026

Role Overview & Description

This role designs and builds evaluation infrastructure for AI models, creating tools for dataset cleaning, experiment feedback, and tracking model growth during training. The engineer will diagnose agent failures and translate quality and safety metrics into concrete criteria, requiring strong software engineering skills and attention to detail.
Hiring Telemetry · Expansion Signal

Track team expansion and market signals for X

Polaris7 monitors open roles, strategic market movements, and M&A developments in real time. Get automated intelligence briefings on X and benchmark against direct competitors.

Source & Transparency: This position was structured directly from the publicly accessible career portal of X. Details on the employer’s original job posting are authoritative. Polaris7 charges no placement fees and conducts no candidate screening.
Company IntelligenceVerified Profile

Operator of X, a social platform monetised through ads, subscriptions and API access.

Headquarters: United States

Similar Positions in DACH

Related roles across advertising, media, and data

Re-check scheduledPalo Alto, CAEngineering & DevelopmentMid-Level

This role focuses on building the infrastructure and tooling for evaluating AI models at scale. The engineer will develop automated evaluation pipelines, manage test environments, and create dashboards for tracking model performance. Key responsibilities include integrating evaluation frameworks into CI/CD workflows and ensuring reproducibility of results.

Re-check scheduledPalo Alto, CAEngineering & DevelopmentMid-Level

This role focuses on building and maintaining evaluation frameworks for AI models at SpaceX. The engineer will design automated test suites, benchmark model performance, and develop tooling to assess model capabilities and safety. Key responsibilities include writing robust evaluation pipelines and collaborating with ML researchers to improve model quality.

Re-check scheduledNew York City, USAData, AI & AnalyticsMid-Level

This role focuses on designing and implementing evaluation systems for frontier AI models, including building datasets, benchmarks, and automated evaluation pipelines. It requires strong ML engineering skills and experience with large-scale data processing to assess model capabilities and safety.

Verified 5d agoSan FranciscoData, AI & AnalyticsSenior

This Member of Technical Staff role on the Evals team focuses on measuring the performance and capabilities of internal and external models, developing new benchmarks and evaluation methodologies. The role involves running data ablations, assessing dataset quality, and investigating whether measurements accurately reflect model performance. Strong programming skills, experience with machine learning systems, and a commitment to rigor in AI evaluations are required.

More Positions at X

3 more open roles

Verified todayAustin, TX; New York, NY; Palo Alto, CA; Washington, DCEngineering & DevelopmentMid-LevelUSD100,000 – USD198,000

This role designs, implements, and maintains security controls for Federal and DoD cloud environments, ensuring compliance with FedRAMP High, DoD IL5/IL6, and NIST SP 800-53. The engineer will operate security tooling (SIEM, EDR, vulnerability scanners), secure Kubernetes and Linux environments, and implement Zero Trust principles. Responsibilities include managing ATO packages, continuous monitoring, incident response, and collaborating with DevOps to build secure CI/CD pipelines.

Verified todayPalo Alto, CAEngineering & DevelopmentMid-LevelUSD140,000 – USD225,000

This role builds the end-to-end billing and monetization infrastructure for consumer subscriptions like X Premium and SuperGrok. The engineer will design promotional offer systems, global payment methods, and intelligent communication systems to drive engagement and revenue. This position requires experience with large-scale backend systems, distributed systems, and a passion for revenue-generating products.

Verified todaySouthaven, MS; Memphis, TNEngineering & DevelopmentJunior

This role designs, programs, and commissions facility automation controls for a data center plant. Responsibilities include writing PLC code, building HMI/SCADA interfaces, integrating with BMS/EPMS systems, and ensuring safety compliance with NEC/NFPA standards. Requires 1+ years of experience in industrial controls or building automation, with proficiency in PLC programming and industrial protocols.