Code Reviewer – Java

About the Role

We are looking for experienced software engineers at a tech-lead level who are familiar with high-quality public GitHub repositories. This short-term contract involves hands-on software engineering work, including development environment automation, issue triaging, and evaluating test coverage and quality.

Responsibilities

• Analyze and triage GitHub issues across trending open-source libraries.
• Set up and configure code repositories, including Dockerization and environment setup.
• Evaluate unit test coverage and quality.
• Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
• Collaborate with researchers to identify repositories and issues that challenge LLMs.

Requirements

• At least 3 years of overall experience.
• Strong experience with Java.
• Proficiency with Git, Docker, and basic software pipeline setup.
• Ability to understand and navigate complex codebases.
• Comfortable running, modifying, and testing real-world projects locally.
• Experience contributing to or evaluating open-source projects is a plus.

Nice to Have

• Previous participation in LLM research or evaluation projects.
• Experience building or testing developer tools or automation agents.

Work Arrangement and Commitment

• Fully remote.
• Short-term contractor assignment. The posting describes a 4-week engagement and elsewhere states 2–3 weeks.
• Requires at least 40 hours per week, with 4 hours of overlap with PST. The posting also mentions 8 hours per day and at least 4 hours per day.
• Immediate start.

Compensation

$25 per approved task; average handling time is 45–60 minutes per task. The equivalent estimate of $25 per hour is approximately 625,000 VND, using an approximate exchange rate of 25,000 VND per USD. Actual payment is task-based.

Positions: 10

Partner Fee: $150

Evaluation

Assessment-based review, approximately 75 minutes.