AI Data Analyst

Role Overview

We are looking for an analytical, detail-oriented AI Data Analyst to evaluate, benchmark, and fine-tune large language models (LLMs), such as GPT. You will use analytical reasoning and strong English comprehension to help train AI systems on complex problem-solving, fact-checking, and nuanced logic.

You will read, summarize, and break down information into clear logical blocks, conduct independent web research to fact-check model assertions, and guide models through analytical challenges.

Job Requirements

• English comprehension and writing: Strong reading comprehension and written English skills, with the ability to explain complex reasoning clearly and unambiguously.
• Analytical and critical thinking: Strong deductive reasoning and lateral thinking, with the ability to break down multi-variable problems systematically.
• Research rigor: Ability to conduct reliable online research, cross-reference claims, locate primary sources, and verify evidence.
• Constructive feedback and annotation: Ability to write precise, actionable critique notes, tag errors according to rubrics, and explain logical flaws.
• Independence and remote readiness: Self-directed work habits and the ability to maintain productivity and accuracy in an asynchronous remote environment.
• Technical setup: A personal desktop or laptop with updated software and a stable, high-speed internet connection.

Job Responsibilities

• Scenario and task authoring: Create, solve, and annotate analytical challenges, logic problems, and realistic decision scenarios.
• Solution generation: Write step-by-step rationales, logical proofs, and clear explanations that show how to reach a correct answer.
• Fact-checking and source verification: Research external sources to validate claims, assess numerical accuracy, and identify hallucinations or flawed assumptions in model outputs.
• Error analysis and annotation: Review incorrect or suboptimal AI responses and provide detailed rubrics, corrections, and constructive feedback.

Education and Experience

• A bachelor's degree or higher in a relevant engineering discipline is required.
• Experience in AI evaluation, data annotation, content review, quality assurance, or a related analytical role is a plus.

Offer Details

• Up to 40 hours per week, with 4 hours of overlap with Pacific Time (PT).
• Pay: $9 per hour. Average handling time per task: 90 seconds.
• Engagement type: Contractor.
• Engagement length: Up to 1 week.

Evaluation Process

• Candidates must submit a job interest form and complete an assessment.
• Candidates selected based on the assessment will be invited to onboarding.

Open positions: 150