Strategic Project Lead – Software Engineering

Job Summary

Own end-to-end delivery of production software engineering data and evaluation programs supporting frontier AI models. Oversee coding data, coding RLHF and preference data, software engineering benchmarks, model evaluations, agentic coding, code generation, and code repair. Balance technical quality, contributor performance, throughput, cost, and timelines, making informed release or rejection decisions based on code and test reviews.

Key Responsibilities

• Operate active software engineering data and evaluation programs from contributor onboarding through final delivery.
• Manage contributor sourcing, calibration, onboarding, reviewer capacity, and performance across distributed teams.
• Monitor throughput, technical quality, rework, defects, costs, and delivery timelines; provide operational reporting.
• Review code, tests, task metadata, and final artifacts to assess technical correctness and make release or rejection decisions.
• Diagnose quality issues and improve task design, rubrics, instructions, and review processes.
• Develop and lead recovery plans when quality, throughput, cost, or timelines are at risk.
• Coordinate software engineers, reviewers, team leads, customer research teams, and program stakeholders, communicating progress, risks, and corrective actions.

Qualifications

• Skills: Strong software engineering judgment; ability to read and review code and tests; experience with production coding-data or AI evaluation programs; operational program ownership; contributor and reviewer management; and quality analysis and reporting using Python, SQL, or similar tools.
• Education: A degree in computer science, software engineering, or a related field is helpful. Equivalent practical software engineering and program experience may be suitable.
• Attributes: Technically discerning, decisive, highly organized, proactive, comfortable taking over active programs, and effective at communicating with demanding stakeholders.

Compensation and Benefits

• Remote work with global technology companies and AI labs.
• Flexible engagement options based on project requirements and availability.
• Opportunity to contribute to high-impact AI training, evaluation, and data-generation programs.
• Three-month contractor engagement requiring eight hours per day, including at least four hours of overlap with Pacific Time. Medical benefits and paid leave are not included.

How to Apply

Apply using https://work.turing.com/r/NdS6pngxg_. The engagement is a three-month contract, with an expected start date next week.