Member of Technical Staff – Post-Training, Reinforcement Learning, Generalization
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Member of Technical Staff training Cohere’s enterprise foundation models with reinforcement learning. Developing generalization methods, evaluations, and production training recipes.
Responsibilities:
- Train large language models with reinforcement learning
- Develop methods that improve generalization beyond the training distribution
- Design training recipes, environments, and evaluations to assess learned skills
- Design, run, and analyze large-scale RL post-training experiments, including RLHF and RL from verifiable rewards
- Research reward design, environment and task diversity, curricula, and regularization
- Build held-out evaluations for unseen tasks, domains, and formats
- Detect reward hacking and benchmark overfitting
- Diagnose training dynamics and failure modes, including instability, reward over-optimization, and capability regressions
- Turn successful research into robust, reproducible production-model training recipes
- Collaborate with post-training data infrastructure, evaluation, and pre-training teams
Requirements:
- Strong research and software engineering skills, with hands-on experience training LLMs
- Experience applying reinforcement learning to LLMs, such as PPO, GRPO, RLHF, or RLVR, ideally at scale
- Track record of work on generalization, robustness, or distribution shift through publications or shipped models
- Rigorous experimental practice, including clean ablations, careful controls, and sound conclusions from noisy results
- Experience with distributed training, such as JAX, PyTorch, FSDP, or Megatron, is a plus
- Excellent communication skills
- Deep understanding of data quality principles and best practices
- Willingness to dive deep into data and assess dataset quality and impacts on model training outcomes
Benefits:
- Offers equity
- Weekly lunch stipend of $75/£75 or equivalent in local currency
- Full health and dental benefits
- Separate budget for mental health
- RRSP matching, 401K, Pension Scheme
- 100% parental leave top-up for up to 6 months, for either parent
- Annual arts and culture, fitness/wellness, quality time, and workspace improvement benefits
- Education and learning stipend for conferences, courses, and coaching
- 6 weeks of paid vacation (30 working days)
- Budget for traveling to other offices if remote
- Annual company offsite
- Daily lunch program, snacks, and regular community and social events for office-based employees
- Co-working benefit for employees not near an office
- $500 home office stipend
Similar Jobs
AI Algorithm Developer
Sr Data Scientist developing machine-learning and statistical analytics for GE HealthCare’s industrial and infrastructure solutions. Translating algorithms into commercially viable products with cross-disciplinary teams.
IT Operations Engineering
IT Operations Engineer supporting Windows, macOS, identity, and SaaS tools at Finom, a European fintech. Resolving employee issues and improving internal IT operations.
IT Operations Engineering
IT Operations Engineer supporting employees across devices, identity, access, and SaaS tools. Finom builds an all-in-one financial platform for entrepreneurs.
Mainframe DB2 System Programmer – SME
Mainframe DB2 System Programmer SME maintaining and optimizing IBM DB2 z/OS systems for Kyndryl’s mission-critical technology services. Supporting availability, recovery, security, performance, and DBA operations.
Mainframe DB2 System Programmer – SME
Mainframe DB2 System Programmer SME maintaining Kyndryl’s mission-critical DB2 z/OS systems. Managing availability, recovery, performance, security, and system support.
Senior JDE Developer Analyst
Senior JDE Developer building JD Edwards applications for RectorSeal, a provider of HVAC, plumbing, electrical, and construction solutions. Developing integrations, reports, orchestrations, and business functions across manufacturing operations.
Mobile Engineer
Mobile Engineer owning iOS and Android for ElevenMusic, ElevenLabs’ AI-powered music app. Building rapid, high-quality experiences for musicians and creatives.
Dot NET Developer – Contract Role
Contract .NET Developer building web applications, APIs, and worker services for NexusOne’s AI-native data platform. Supporting PostgreSQL, Azure DevOps, and customer-facing portals from Pune.
Software Engineer
Software Engineer building full-stack Generative AI, LLM, and GPT solutions for First American’s title insurance and mortgage technology platforms. Developing cloud, RAG, API, and MLOps capabilities.
Senior Programador/A, Oracle Apex
Programador Senior Oracle APEX para consultora tecnológica española. Migración de Recursos Humanos desde Oracle Forms & Reports y desarrollo de funcionalidades corporativas.
Member of Technical Staff, Compiler
Clinical AI researcher building a deterministic, evidence-traceable compiler for Canadian healthcare standards. Developing model pipelines, formal validators, and executable clinical decision logic.
Junior Mobile Developer, iOS
Junior iOS Developer building iOS ordering solutions for convenience-store supply and logistics software. Developing, testing, debugging, and maintaining code within defined architectures.
Software Engineer
Software Engineer building secure, high-performance web applications for a financial services platform. Developing React front ends, cloud-hosted solutions and lifecycle-managed engineering tools.
Senior ERP Application Developer
Senior ERP Application Developer supporting UFP Technologies’ medical-device manufacturing systems. Designing data integrations, ERP solutions, reports, and dashboards across business applications.
Medior 3D XR Developer
3D XR Developer building AI-enhanced Unity medical simulations for SyncVR Medical’s healthcare platform. Creating scalable training modules for hospitals and healthcare professionals.
Builders & Developers – AI Coding Sessions
Builders develop real projects in recorded OpenCode sessions using provided open-weight and Gemini models. Mercor studies how people build with AI coding assistants.
Software Development Instructor
Software Development Instructor teaching MERN, TypeScript, APIs, and AI integrations at Germany’s WBS CODING SCHOOL. Mentoring diverse learners through coding lessons, reviews, assessments, and projects.
Practicante de Desarrollo de Software – Avionics
Practicante de software en Collins Aerospace, empresa de tecnología aeroespacial, desarrollando aplicaciones web y soluciones DevOps. Aprendizaje práctico con mentoría en proyectos innovadores.
Global Process Engineering Authority – Press Cure Stator Bar Manufacturing
Global process engineering authority improving GE Vernova generator manufacturing reliability, quality, and equipment standards. Driving lean, DFSS, asset management, and global process improvements across the Generator Value Stream.
Builders & Developers – Share Your AI Coding Sessions
Builders using AI coding assistants to develop real projects in recorded OpenCode sessions. Flexible remote contract work supporting Mercor’s AI research partner.