Software Engineer, Python
Posted 8hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Python engineers building difficult repository-exploration tasks for Mercor’s AI training datasets. Investigating production codebases, validating rubrics, and documenting runtime reasoning.
Responsibilities:
- Select tasks from a pre-validated pool of Python repositories pinned to specific git commits
- Explore repositories and relevant PR or issue history to understand the subsystem
- Rewrite engineering questions to challenge frontier coding agents while remaining well-defined
- Adjust rubrics and foils to reward correct reasoning and reject plausible but incorrect answers
- Run the Check, Golden, Run, and Analyze validation loop in Mercor Studio
- Iterate until every validation stage passes
- Document work in the task README
- Submit tasks for expert review and address reviewer feedback
- Build datasets for AI agents to reason about real Python codebases
Requirements:
- 3+ years of professional software engineering experience
- Substantial production Python experience
- Ability to navigate large, unfamiliar Python codebases and explain runtime behavior
- Fluency in Python internals, including import machinery, descriptors and metaclasses, async and event loops, packaging, and C-extension boundaries
- Experience with web frameworks, developer tooling, type checkers, or scientific/numeric libraries is highly relevant
- Precise written English
- Comfortable with git at commit level, containerized environments, and command-line tooling
- Identity verification and background check
- Signed Terms of Work and CIIAA
- Tax form completion
- Passing a short calibration quiz before task access
- Qualified applicants may be asked to complete a brief technical assessment or provide additional information
Benefits:
- Fully remote and asynchronous work
- Payment of $130 per approved task
- Work performed in Mercor Studio
- Expert team leads across US, India, and Nigeria time zones
- Identity verification, background check, signed Terms of Work and CIIAA, tax form, and calibration quiz required for onboarding
- Referral opportunity to earn up to $250 per successful referral
- Reasonable accommodations upon request













