Tech AI Data Delivery Manager
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI data delivery manager building LLM-agent automation, quality systems, and analytics for TransPerfect’s DataForce. Managing data collection and annotation projects with vendors and stakeholders.
Responsibilities:
- Design and run AI data projects
- Build hybrid automation combining deterministic tooling with LLM agents
- Decide which workflow steps use rules versus models and design hand-offs
- Set up and run agents in Claude and the native enterprise agentic environment
- Configure task specifications, data and tool connections, schedules, monitoring, and failure handling
- Design quality assurance workflows, guidelines, rubrics, and scorecards
- Calibrate automated checks against human reviewers and develop measurable error categories
- Run data collection and annotation projects end to end, including scoping, vendors, workflows, tracking, and delivery
- Build tooling for project coordinators
- Collect, clean, and analyze production and quality data
- Create reporting on throughput, rework, error rates, and contributor performance
- Test automation before release and build continuous auditing workflows
- Document specifications, tickets, and runbooks for coordinators and engineers
Requirements:
- Intermediate JavaScript and Python skills sufficient to build and maintain production automation
- Hands-on agent building in Claude, including projects, skills, connectors, and scheduled tasks
- Ability to build agents in the native enterprise agentic environment and connect APIs with native infrastructure
- LLM evaluation experience, including prompt and rubric design and calibration against human judgment
- Data analytics background with experience in the data collection or annotation industry
- Experience managing projects with external vendors or contributors and multiple stakeholders
- Ability to make and own decisions with incomplete information
Benefits:
- Remote work
- Full-time, fixed-term employment (1 year with possibility to extend)
Similar Jobs
Tech AI Data Delivery Manager
AI Data Delivery Manager building hybrid automation, LLM agents, and QA workflows for TransPerfect’s data collection and annotation services. Managing analytics and vendor-led delivery projects remotely from Bangalore.
Director of AI-Powered Selling
Director building generative AI tools for Convergint’s security technology customers and Account Executives. Creating AI selling curriculum, demonstrations and training as a hands-on individual contributor.
AI Voice Recording Contributor – Arabic, Gulf
Freelance Arabic Gulf voice contributor recording native-dialect speech samples for RWS’s AI evaluation projects. Completing task-based recordings through an online platform from home.
AI Voice Recording Contributor, Arabic – Gulf
Arabic (Gulf) voice contributor recording natural speech for RWS AI evaluation projects. Completing flexible, task-based recordings through RWS’s online platform.
AI Voice Recording Contributor, Arabic – Gulf
Freelance Arabic (Gulf) voice contributor recording approximately 640 text prompts for RWS AI evaluation. Producing natural dialect recordings remotely to improve speech and language systems.
AI Voice Recording Contributor, Arabic
Freelance Arabic (Jordan) voice contributor recording natural speech for RWS’s AI evaluation project. Completing flexible, task-based recordings to improve speech and language technologies.
AI Voice Recording Contributor, Arabic
Freelance Arabic (Morocco) voice contributor recording natural dialect speech for RWS AI evaluation projects. Reading scripted text cards and producing accurate audio datasets remotely.
AI Voice Recording Contributor – Scots
Freelance Scots voice contributor recording natural dialect speech for RWS’s AI evaluation project. Completing approximately 640 guided recordings remotely over a flexible one-month engagement.
AI Voice Recording Contributor, Spanish
Freelance voice contributor recording Spanish Puerto Rico speech data for RWS’s AI evaluation projects. Reading text prompts and producing accurate, natural recordings remotely.
Senior AI, MCP Engineer
AI/MCP Engineer leading production LLM features and MCP integrations. Building secure, scalable AI capabilities for PlentyONE’s e-commerce ERP platform.
Veterinary Dentist, Dental Annotator – AI Project
Veterinary Dentist annotating dog and cat dental X-rays for Mindy Support’s AI data-labeling services. Applying veterinary dentistry expertise to classify pathologies and improve diagnostic tools.
Applied Research – Scientific AI
Applied Research scientist building and post-training agents for scientific discovery. Developing RL environments, evaluations, and reproducible research infrastructure for Prime Intellect’s open superintelligence platform.
Applied Research – Sovereign AI
Applied researcher building post-training and agent systems for Prime Intellect’s open AI platform. Developing secure, high-assurance AI for public-sector and regulated-industry workflows.
Director ISC Data and AI
Director governing supply-chain data, ontology, products, and AI agents at BD, a global medical technology company. Leading ISC data transformation, governance, interoperability, and executive strategy.
Architect, Ontology – AI Innovation
Architecting agentic AI, semantic, and knowledge-graph platforms for Kinaxis, a global supply-chain orchestration company. Connecting enterprise planning data into reusable platform capabilities.
AI Trainer – Swahili
Swahili AI contributor network supporting Welo Data’s global AI data projects. Annotating content, evaluating outputs, and creating prompts on flexible remote assignments.
Healthcare Subject Matter Expert – AI Model Evaluation
Healthcare SMEs evaluating clinical accuracy, reasoning, and safety in AI-generated medical content for Volga Partners. Project-based remote assignments for physicians, nurse practitioners, and physician assistants.
Healthcare Subject Matter Expert – AI Model Evaluation
Healthcare professionals evaluating AI-generated medical content for Volga Partners. Applying clinical judgment to improve the accuracy and reliability of healthcare AI models.
AI Evaluation Engineer
AI Evaluation Engineer building statistical evaluation, CI/CD testing, and observability infrastructure for Scopic’s production AI agents. Designing adversarial, multi-turn, and structured-output test systems.
English AI Safety Specialist
AI Safety Specialist reviewing English conversations and labeling AI responses. Helping Mercor’s AI lab and enterprise partners train and enhance frontier models.