Strategic Project Lead – AI Post-Training
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Strategic Project Lead improving frontier AI models through high-quality training data at Appen. Owning client projects, evaluation workflows, quality standards, and AI data delivery.
Responsibilities:
- Lead AI companies in developing and improving frontier models through high-quality data programs
- Own end-to-end project delivery, including scope, timelines, budgets, staffing, and risk management
- Lead client communication, status reporting, planning sessions, and escalations
- Translate model improvement objectives into data requirements, workflows, rubrics, and evaluation plans
- Define quality standards and acceptance criteria for preference data, model comparisons, and evaluation outputs
- Monitor delivery quality, investigate inconsistencies, and resolve ambiguous requirements with clients
- Advise on data design, evaluation approaches, and project feasibility
- Develop reusable guidelines, SOPs, and QA frameworks
- Mentor Operations Specialists and contribute to project scoping, pilots, and new capability development
- Work closely with clients and internal teams to translate AI research needs into reliable datasets and measurable outcomes
Requirements:
- 1–2+ years of experience in AI data operations, project coordination, or delivery, ideally in a GenAI or frontier AI environment
- Familiarity with at least one AI post-training or model evaluation workflow
- Experience coordinating projects or workstreams, managing stakeholders, and communicating with clients
- Understanding of data quality, annotation workflows, and quality assurance methods
- Ability to translate evolving requirements into clear workflows, rubrics, and measurable quality standards
- Strong troubleshooting and organizational skills, with the ability to manage multiple priorities
- Interest in current AI developments, including frontier models and post-training approaches
- Experience with reinforcement learning from human feedback (RLHF), preference data, or model response evaluation
- Familiarity with rubric design, model comparison, benchmark development, or evaluation creation
- Experience assessing model responses for quality, accuracy, reasoning, or instruction following
- Exposure to AI companies, frontier AI labs, or model evaluation programs
- Bilingual capabilities, particularly German or a Nordic language, as a nice-to-have
Benefits:
- Permanent - Regular Full-time employment
- Remote work arrangement
- Flexibility to deliver in a way that works for you and your team
- Tools, resources, and development opportunities to build capability over time
- Work on complex AI challenges across industries and geographies
- Collaborative culture valuing innovation, curiosity, accountability, excellence, and humility
Similar Jobs
Senior Data & AI Engineering Consultant
Senior consultant designing and delivering Azure and Microsoft Fabric data platforms for Interlink Cloud Advisors’ clients. Building governed, analytics-ready datasets for BI, analytics, and AI.
Senior Full Stack Engineer – AI Agentic
Senior Full-Stack AI Engineer building LLM-powered recruiting platforms for Inallmedia.com. Developing AI agents, Python services, and Salesforce/ATS integrations for global staffing clients.
AI Engineer – Freelance
AI Engineer building generative AI, LLM, and RAG solutions for HRM clients. Designing scalable platforms and supporting software delivery from analysis through deployment.
Staff AI Engineer
Staff AI Engineer designing reliable, secure and cost-efficient production agents for Cobalt’s pentesting platform. Setting agent architecture, evaluation, observability and engineering standards across teams.
Staff Software Engineer – AI
Staff Software Engineer building and deploying scalable AI/ML features for 8am’s SaaS platform. Developing Python, LLM, data infrastructure, and cloud deployment solutions for professional services.
Senior C# Developer, AI Experience
Remote senior C#/.NET developer building APIs and analyzing an enterprise data platform. Later-phase work includes LLM integration, RAG, and GenAI solutions.
Software Engineer – AI Systems, Go
Software Engineer building Go-based production AI systems and durable agent workflows for Stanbridge University. Designing reliable, observable, multi-provider AI infrastructure and backend services.
Working Student – AI Engineering
Working Student building Python AI applications, RAG workflows, and agent systems at Hamburg-based data and AI engineering company AgentixLake. Supporting evaluation, testing, deployment, and monitoring.
Staff Applied AI Engineer
Staff Applied AI Engineer owning AI portfolios and shipping agentic applications. Modernizing collectibles authentication, grading, vaulting, and trading through applied AI.
Staff Software Engineer – AI Platform
Staff Software Engineer building Aledade’s shared AI infrastructure for secure foundation-model access. Developing scalable model gateways, cloud integrations, observability, and self-service platform capabilities.
Divisional Artificial Intelligence Engineer III
AI platform engineer leading architecture, reliability, and adoption for shared LLM infrastructure. Building reusable orchestration, observability, and production services across products.
Forward Deployed AI Engineer
Forward Deployed AI Engineer deploying production AI solutions for Keyrus, an enterprise intelligence consultancy. Integrating APIs, cloud platforms, enterprise systems, and client workflows.
Staff Applied AI Engineer
Staff Applied AI Engineer owning business-domain AI portfolios at Collectors, a collectibles authentication, grading, and trading technology company. Building production agents and reusable application patterns.
AI Architect, Software Architect
Arquitecto de IA Generativa y software para knowmad mood, compañía de transformación digital. Diseñando arquitecturas, soluciones empresariales y servicios de IA para clientes.
Java Software Architect, AI
Arquitecto Java y especialista en IA Generativa para knowmad mood, compañía de transformación digital. Diseñando arquitecturas, modernizando aplicaciones y asesorando a clientes en soluciones de IA.
Senior Libraries Engineer – AI, HPC
Senior Libraries Engineer developing GPU- and CPU-accelerated libraries for AI, image processing, and scientific computing at NVIDIA. Optimizing algorithms and leading library engineering projects.
AI Engineer, Forward Deployed
AI Engineer building production Claude agents, RAG pipelines, and MCP integrations for Collectiv’s enterprise analytics and AI consulting clients. Consulting directly with stakeholders from a fully remote U.S.-based role.
AI Engineer, Forward Deployed – Copilot, Azure AI Foundry
AI Engineer building production Microsoft Copilot and Azure AI Foundry solutions for Collectiv’s enterprise consulting clients. Developing RAG pipelines, agents, integrations, evaluations, and production-ready governance.
Engineer, Software Architect, AI Practitioner
Software-Architekt entwickelt moderne TypeScript-Enterprise-Anwendungen für DAI Software. Verantwortlich für Architektur, Entwicklung, Testing und Deployment KI-gestützter Lösungen.
AI Engineer, Analyst III
Pessoa AI Engineer no Grupo Boticário, líder brasileiro de beleza, desenvolvendo integrações com LLMs para o OMS. Automatizando fluxos, reduzindo trabalho manual e melhorando a experiência do usuário.