Software Engineer, Python

Posted 8hrs ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

Python engineers building difficult repository-exploration tasks for Mercor’s AI training datasets. Investigating production codebases, validating rubrics, and documenting runtime reasoning.

Responsibilities:

  • Select tasks from a pre-validated pool of Python repositories pinned to specific git commits
  • Explore repositories and relevant PR or issue history to understand the subsystem
  • Rewrite engineering questions to challenge frontier coding agents while remaining well-defined
  • Adjust rubrics and foils to reward correct reasoning and reject plausible but incorrect answers
  • Run the Check, Golden, Run, and Analyze validation loop in Mercor Studio
  • Iterate until every validation stage passes
  • Document work in the task README
  • Submit tasks for expert review and address reviewer feedback
  • Build datasets for AI agents to reason about real Python codebases

Requirements:

  • 3+ years of professional software engineering experience
  • Substantial production Python experience
  • Ability to navigate large, unfamiliar Python codebases and explain runtime behavior
  • Fluency in Python internals, including import machinery, descriptors and metaclasses, async and event loops, packaging, and C-extension boundaries
  • Experience with web frameworks, developer tooling, type checkers, or scientific/numeric libraries is highly relevant
  • Precise written English
  • Comfortable with git at commit level, containerized environments, and command-line tooling
  • Identity verification and background check
  • Signed Terms of Work and CIIAA
  • Tax form completion
  • Passing a short calibration quiz before task access
  • Qualified applicants may be asked to complete a brief technical assessment or provide additional information

Benefits:

  • Fully remote and asynchronous work
  • Payment of $130 per approved task
  • Work performed in Mercor Studio
  • Expert team leads across US, India, and Nigeria time zones
  • Identity verification, background check, signed Terms of Work and CIIAA, tax form, and calibration quiz required for onboarding
  • Referral opportunity to earn up to $250 per successful referral
  • Reasonable accommodations upon request