Remote C# Developer (AI/LLM Evaluation)

About the role

We are building datasets to evaluate and train large language models on realistic software engineering problems. As a senior C# developer you will help create verifiable software engineering tasks from public repositories and assess LLM performance.

Key responsibilities

• Analyze and triage GitHub issues across trending open‑source libraries.
• Set up and configure code repositories, including Dockerization and environment setup.
• Evaluate unit‑test coverage and quality.
• Modify and run codebases locally to assess LLM bug‑fixing performance.
• Collaborate with researchers to select challenging repositories and issues.
• Lead and mentor junior engineers on project tasks.

Required profile

• Minimum 3 + years of professional software development experience.
• Strong experience with C#.
• Proficiency with Git, Docker and basic software pipeline setup.
• Ability to understand and navigate complex codebases and run them locally.
• Experience contributing to or evaluating open‑source projects is a plus.

Required skills

• C#
• Git
• Docker

What we offer

• Fully remote work.
• Opportunity to work on cutting‑edge AI/LLM projects.
• Flexible commitment of 20–40 hours per week.
• Freelance contract (no paid leave).