Software Engineer, Evals
Location: Palo Alto, CA · Category: Engineering & Development · Seniority: Mid-Level · Posted: August 29, 2026 · Verified: Nov 16, 2026
Role Overview & Description
Track team expansion and market signals for X
Polaris7 monitors open roles, strategic market movements, and M&A developments in real time. Get automated intelligence briefings on X and benchmark against direct competitors.
Operator of X, a social platform monetised through ads, subscriptions and API access.
Unlock full company profile, competitors & live market signals for X
Similar Positions in DACH
Related roles across advertising, media, and data
This role focuses on building the infrastructure and tooling for evaluating AI models at scale. The engineer will develop automated evaluation pipelines, manage test environments, and create dashboards for tracking model performance. Key responsibilities include integrating evaluation frameworks into CI/CD workflows and ensuring reproducibility of results.
This role focuses on building and maintaining evaluation frameworks for AI models at SpaceX. The engineer will design automated test suites, benchmark model performance, and develop tooling to assess model capabilities and safety. Key responsibilities include writing robust evaluation pipelines and collaborating with ML researchers to improve model quality.
This role focuses on designing and implementing evaluation systems for frontier AI models, including building datasets, benchmarks, and automated evaluation pipelines. It requires strong ML engineering skills and experience with large-scale data processing to assess model capabilities and safety.
This Member of Technical Staff role on the Evals team focuses on measuring the performance and capabilities of internal and external models, developing new benchmarks and evaluation methodologies. The role involves running data ablations, assessing dataset quality, and investigating whether measurements accurately reflect model performance. Strong programming skills, experience with machine learning systems, and a commitment to rigor in AI evaluations are required.
More Positions at X
3 more open roles
This role designs, implements, and maintains security controls for Federal and DoD cloud environments, ensuring compliance with FedRAMP High, DoD IL5/IL6, and NIST SP 800-53. The engineer will operate security tooling (SIEM, EDR, vulnerability scanners), secure Kubernetes and Linux environments, and implement Zero Trust principles. Responsibilities include managing ATO packages, continuous monitoring, incident response, and collaborating with DevOps to build secure CI/CD pipelines.
This role builds the end-to-end billing and monetization infrastructure for consumer subscriptions like X Premium and SuperGrok. The engineer will design promotional offer systems, global payment methods, and intelligent communication systems to drive engagement and revenue. This position requires experience with large-scale backend systems, distributed systems, and a passion for revenue-generating products.
This role designs, programs, and commissions facility automation controls for a data center plant. Responsibilities include writing PLC code, building HMI/SCADA interfaces, integrating with BMS/EPMS systems, and ensuring safety compliance with NEC/NFPA standards. Requires 1+ years of experience in industrial controls or building automation, with proficiency in PLC programming and industrial protocols.
