Python Code Reviewer for AI-Generated Code

Python Code Reviewer for AI-Generated Code

Role type: Short-term contract (approximately 2–4 weeks)
Start: Immediate
Commitment: Minimum 40 hours per week, with 4 hours of overlap with PST
Rate: $25 per approved task; typical handling time is 45–60 minutes per task

About the role

We are seeking experienced software engineers, ideally at a tech lead level, to contribute to a project involving high-quality public GitHub repositories. The work includes hands-on software engineering, development environment automation, issue triage, and evaluation of test coverage and quality.

Responsibilities

• Analyze and triage GitHub issues across trending open-source libraries.
• Set up and configure code repositories, including Dockerization and development environment setup.
• Evaluate unit test coverage and quality.
• Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
• Collaborate with researchers to identify repositories and issues that are challenging for LLMs.

Requirements

• At least 2 years of overall experience.
• Strong experience with Python.
• Proficiency with Git, Docker, and basic software pipeline setup.
• Ability to understand and navigate complex codebases.
• Comfortable running, modifying, and testing real-world projects locally.
• Experience contributing to or evaluating open-source projects is a plus.

Nice to have

• Previous participation in LLM research or evaluation projects.
• Experience building or testing developer tools or automation agents.

Other details

• Fully remote freelance opportunity working on AI projects.
• Eligible countries: India, Pakistan, Nigeria, Egypt, Ghana, Bangladesh, Turkey, Mexico, Argentina, Brazil, Chile, Colombia, and Peru. Please confirm eligibility before applying.
• This is a contractor assignment with no medical or paid leave.
• The selection process includes an assessment-based review of approximately 75 minutes.
• Positions available: 40