We are looking for experienced software engineers (tech lead level) who are familiar with high-quality public GitHub repositories and can contribute to this project. This role involves hands-on software engineering work, including development environment automation, issue triaging, and evaluating test coverage and quality
What does day-to-day look like
- Analyze and triage GitHub issues across trending open-source libraries.
- Set up and configure code repositories, including Dockerization and environment setup.
- Evaluating unit test coverage and quality.
- Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
- Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
Required Skills:
- Minimum 2+ years of overall experience
- Strong experience with at least one of the following languages: Javascript
- Proficiency with Git, Docker, and basic software pipeline setup.
- Ability to understand and navigate complex codebases.
- Comfortable running, modifying, and testing real-world projects locally.
- Experience contributing to or evaluating open-source projects is a plus.
Nice to Have
- Previous participation in LLM research or evaluation projects.
- Experience building or testing developer tools or automation agents.
Offer Details
- 40 hours per week with overlap of 4 hours with PST.
- Employment type : Contractor assignment
- Duration of contract : 2-3 weeks
Location : India, Nigeria, Egypt, Ghana, Bangladesh, Turkey, Mexico
Please note: This position is paid on a task based model. The hourly rate listed in this form is only an estimated average to provide compensation context. The final payment will depend on the tasks completed.
Important note: Due to the high volume of applications, we are unable to provide individual feedback at this stage. Only candidates shortlisted for the next steps will be contacted by our team.