Software Engineer, Python
Posted 8hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Python engineer creating runtime-based codebase Q&A tasks for Mercor’s AI agent training datasets. Exploring production repositories, refining rubrics, and validating tasks remotely.
Responsibilities:
- Select tasks from a pre-validated pool of Python repositories pinned to specific git commits
- Explore repositories and relevant pull-request or issue history to understand subsystems
- Rewrite engineering questions to challenge frontier coding agents while remaining well-defined and answerable
- Adjust rubrics and foils to reward correct reasoning and reject plausible but incorrect answers
- Run the full validation loop in Mercor Studio: Check, Golden, Run, and Analyze
- Document work in the task README
- Submit tasks for expert review and address reviewer feedback on returned tasks
Requirements:
- 3+ years of professional software engineering experience
- Substantial production Python experience
- Ability to navigate large, unfamiliar Python codebases and explain runtime behavior
- Fluency in Python internals, including import machinery, descriptors and metaclasses, async and event loops, packaging, and C-extension boundaries
- Experience with web frameworks, developer tooling, type checkers, or scientific/numeric libraries is highly relevant
- Precise written English
- Comfortable with git at commit level, containerized environments, and command-line tooling
- Must complete identity verification and a background check
- Must sign Terms of Work and CIIAA
- Must provide a tax form
- Must pass a short calibration quiz before task access is granted
- Qualified applicants may be asked to complete a brief technical assessment or provide additional information
Benefits:
- Remote and asynchronous work
- Payment of $130 per approved task
- Expert team leads across US, India, and Nigeria time zones
- Access to Mercor Studio
- Identity verification, background check, and onboarding support
- Referral opportunity earning up to $250 per successful referral
- Reasonable accommodations upon request













