Quality Lead

Quality Lead

Role type: Generic
Engagement: Short-term, project-based contract for 16 weeks
Positions: 15
Start: Immediately
Rate: $20 USD per hour
Work schedule: Five days per week, including weekends as required, with two weekdays off. Hours are 7 a.m.–4 p.m. PST.

Role overview

Lead QA reviewers to ensure annotated data is accurate, consistent, and delivered on time. Manage review queues, identify errors, provide feedback, and support annotators in a fast-paced environment with tight turnaround times.

Key responsibilities

• Lead QA reviewers and manage audit and review queues.
• Spot-check annotated data and reviewer decisions.
• Provide clear, actionable, and consistent feedback.
• Conduct office hours and clarify guidelines for annotators.
• Track quality scores, error trends, and reviewer performance.
• Train new reviewers on guidelines, tools, and review processes.
• Escalate recurring issues and unclear guidelines to the Senior QA Lead.

Required qualifications

• 3–5 years of overall experience, including at least 1 year leading or mentoring reviewers.
• Strong attention to detail and ability to follow complex guidelines.
• Clear communication and feedback skills.
• Experience in QA, annotation, data labeling, or AI training data is preferred.

Vetting and availability

Vetting includes an interest-check form, Vetsmith Assessment, and delivery interview. Availability is required five days per week, with weekend work as needed.

Additional role details

The role involves a defined number of evaluation tasks, comparing multiple chatbots, and providing a final assessment. The work is fully remote and flexible, with opportunities to collaborate on high-impact projects with global reach. Geographic guidance references Colombia, India, and Brazil.