Software Development Expert Wanted
We are seeking an experienced software engineer to contribute to our project building large language model evaluation and training datasets. The ideal candidate will have strong experience with software development, GitHub, and related technologies.
About the Project
The goal of this project is to create verifiable software development tasks based on public repository histories. We use a synthetic approach with human-in-the-loop to expand dataset coverage to different types of tasks. The ideal candidate will work closely with researchers to design and identify challenging repositories and issues for large language models.
Key Responsibilities
* Work with high-quality public GitHub repositories.
* Contribute to the development of our project, including software engineering, automation, and quality assurance.
* Collaborate with researchers to identify challenging repositories and issues for large language models.
Requirements
* Strong experience with software development, GitHub, and related technologies.
* Experience working with well-maintained, widely-used repositories with 500+ stars.
* Proficiency with Git, Docker, and basic software pipeline setup.
* Ability to understand and navigate complex codebases.
* Comfortable running, modifying, and testing real-world projects locally.