Senior Software Developer - Code Analysis and Improvement
We are developing methods to improve the accuracy and efficiency of large language models (LLMs) by analyzing and refining their performance on realistic software engineering tasks. This involves collaborating with a team of researchers to design and implement new techniques for evaluating and improving LLMs.
About the Role:
We are seeking experienced software developers who can contribute to this project by analyzing and refining the performance of LLMs on software engineering tasks. You should have experience working with high-quality public GitHub repositories and be proficient in at least one programming language.
The ideal candidate will have a strong understanding of software engineering principles and be able to communicate effectively with the research team.
Responsibilities will include:
* Analyzing and refining the performance of LLMs on software engineering tasks.
* Collaborating with researchers to design and implement new techniques for evaluating and improving LLMs.
* Developing and maintaining software tools and pipelines to support the analysis and refinement of LLMs.
Requirements:
* Strong experience with at least one programming language.
* Experience working with high-quality public GitHub repositories.
* Proficiency with Git, Docker, and basic software pipeline setup.
Nice to Have:
* Previous participation in LLM research or evaluation projects.
* Experience building or testing developer tools or automation agents.
Work Arrangements:
* Fully remote work environment.
* 20 hours per week commitment.