Job Details

1. Role Overview

Mercor is collaborating with a leading AI lab on the Git Environments project, a large-scale initiative designed to evaluate and train frontier language models on advanced Git workflows. We are seeking experienced software engineers and Git experts to create and quality-assure high-difficulty Git tasks across curated repositories. Contributors will design realistic version control scenarios-such as merge conflicts, rebases, recovery states, and history investigations-to help models develop safe, efficient, and technically sound Git practices. This is a project-based opportunity with potential for ongoing contributions based on performance and project needs.

⸻

2. Key Responsibilities

• Design complex, realistic Git scenarios across multiple task categories (merge conflicts, interactive rebases, recovery, search, iterative committing)

• Author clear, deterministic task prompts with fully testable and verifiable success criteria

• Implement automated test suites (pytest) to validate repository state, commit history, and workflow correctness

• Develop and document oracle (reference) solutions using reproducible Git commands

• Define grading rubrics that properly separate deterministic checks from qualitative evaluation

• Conduct peer QA reviews of submitted tasks and refine artifacts to meet project standards

• Record task creation and QA workflows in accordance with project guidelines

⸻

3. Ideal Qualifications

• 3+ years of professional experience working extensively with Git in production environments

• Advanced knowledge of Git internals and workflows (merging strategies, interactive rebase, reflog, bisect, branch manipulation, recovery techniques)

• Experience designing technical assessments, benchmarking frameworks, or engineering challenges

• Proficiency in Python and shell scripting for automation and test creation

• Strong attention to detail with the ability to write precise, unambiguous technical specifications

• Familiarity with Docker and reproducible development environments preferred

⸻

4. More About the Opportunity

• Access to structured documentation, tooling, and curated repositories

• Clear QA framework with deterministic testing and rubric-based evaluation

• Opportunity to contribute to large-scale AI model benchmarking and reinforcement learning initiatives

• Dedicated Slack channel for technical questions and project support

⸻

5. Application Process

• Submit your resume highlighting relevant Git and software engineering experience

• Qualified applicants may complete a brief skills-based assessment

• Approved contributors receive onboarding documentation and access to project tooling

• Initial contributions will be reviewed to ensure alignment with quality standards

⸻

6. About Mercor

• Mercor is a talent marketplace that connects top experts with leading AI labs and research organizations.

• Our investors include Benchmark, General Catalyst, Adam D'Angelo, Larry Summers, and Jack Dorsey.

• Thousands of professionals across domains like law, creatives, engineering, and research collaborate through Mercor on frontier AI initiatives.