Software Engineer, Python

Posted 8hrs ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

Python engineer creating runtime-based codebase Q&A tasks for Mercor’s AI agent training datasets. Exploring production repositories, refining rubrics, and validating tasks remotely.

Responsibilities:

  • Select tasks from a pre-validated pool of Python repositories pinned to specific git commits
  • Explore repositories and relevant pull-request or issue history to understand subsystems
  • Rewrite engineering questions to challenge frontier coding agents while remaining well-defined and answerable
  • Adjust rubrics and foils to reward correct reasoning and reject plausible but incorrect answers
  • Run the full validation loop in Mercor Studio: Check, Golden, Run, and Analyze
  • Document work in the task README
  • Submit tasks for expert review and address reviewer feedback on returned tasks

Requirements:

  • 3+ years of professional software engineering experience
  • Substantial production Python experience
  • Ability to navigate large, unfamiliar Python codebases and explain runtime behavior
  • Fluency in Python internals, including import machinery, descriptors and metaclasses, async and event loops, packaging, and C-extension boundaries
  • Experience with web frameworks, developer tooling, type checkers, or scientific/numeric libraries is highly relevant
  • Precise written English
  • Comfortable with git at commit level, containerized environments, and command-line tooling
  • Must complete identity verification and a background check
  • Must sign Terms of Work and CIIAA
  • Must provide a tax form
  • Must pass a short calibration quiz before task access is granted
  • Qualified applicants may be asked to complete a brief technical assessment or provide additional information

Benefits:

  • Remote and asynchronous work
  • Payment of $130 per approved task
  • Expert team leads across US, India, and Nigeria time zones
  • Access to Mercor Studio
  • Identity verification, background check, and onboarding support
  • Referral opportunity earning up to $250 per successful referral
  • Reasonable accommodations upon request