Text Situated Alignment Specialist

Role overview

We are seeking subject matter experts (SMEs) in psychology, social work, counseling, qualitative research, HCI, communication, conflict resolution, coaching, and related advisory fields to support AI conversation evaluation research. Specialists review conversations between people and AI models, assess whether enough context was gathered before recommendations were made, identify missed clarification opportunities, and provide structured feedback to improve conversational quality.

Responsibilities

• Review AI conversations involving interpersonal and everyday decision-making scenarios.
• Identify missing context and recommend relevant follow-up questions.
• Assess whether additional information could have changed an AI recommendation.
• Distinguish critical, recommendation-relevant information from non-essential details.
• Conduct qualitative reviews and document findings using structured evaluation guidelines.
• Collaborate with research teams to ensure consistent, high-quality assessments.

Qualifications

Candidates need 3–5 years of relevant direct practice and expertise in at least one of these areas:

• Social work: MSW or equivalent graduate qualification, with LCSW, LICSW, LMSW, or an equivalent credential; experience in client assessment, case review, interviewing, or counseling.
• Counseling, therapy, or psychology: Relevant MA/MS and counseling or therapy credential, such as LMFT, LPC, or LCPC, or a PhD/PsyD in clinical, counseling, social, or industrial-organizational psychology; relevant client-facing experience.
• Qualitative research, HCI, or communication: Advanced expertise in a related discipline and experience with qualitative research, interviews, user research, conversation analysis, thematic analysis, or qualitative coding.
• Mediation, coaching, student services, organizational consulting, or related advisory work: Relevant qualification or demonstrated expertise, with substantial direct client-facing or advisory experience.

Preferred experience includes eliciting context when information is incomplete; considering relational, work, education, family, wellbeing, financial, and practical factors; conducting qualitative coding or structured case reviews; and identifying missed opportunities to clarify information.

Assignment details

• Engagement: Contractor assignment; no medical or paid leave.
• Duration: 3 weeks, with an estimated start date of October 1.
• Workload: 40 hours per week in the United States and Saudi Arabia; 20 hours per week in other listed eligible regions, with 4 hours of PST overlap. Full-time or part-time commitment is indicated.
• Compensation: Pay per task. The stated task rate is $40, with an estimated average handling time of 75 minutes. A $175 flat partner fee is also listed.
• Eligibility: Must be based in the USA, Canada (excluding Quebec), or listed Western European countries; Australia and New Zealand are also listed as eligible locations.
• Openings: 35 positions in high-cost geographies. The project sample also describes 70 professionals overall, divided between high- and mid-cost geographies.