Tech AI Data Delivery Manager
Posted 5hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI Data Delivery Manager building hybrid automation, LLM agents, and QA workflows for TransPerfect’s data collection and annotation services. Managing analytics and vendor-led delivery projects remotely from Bangalore.
Responsibilities:
- Design and run AI data projects
- Build hybrid automation combining deterministic tooling with LLM agents
- Decide which workflow steps should use rules versus models and design hand-offs
- Set up and run agents in Claude and the native enterprise agentic environment
- Configure task specifications, data and tool connections, schedules, monitoring, and failure handling
- Design quality assurance workflows, guidelines, rubrics, and scorecards
- Calibrate automated checks against human reviewers and measure error categories
- Run data collection and annotation projects end to end, including scoping, vendors, workflows, tracking, and delivery
- Build tooling for project coordinators
- Collect, clean, and analyze production and quality data
- Create reporting on throughput, rework, error rates, and contributor performance
- Test automation before release and build continuous auditing workflows
- Create specifications, tickets, and runbooks for coordinators and engineers
Requirements:
- Intermediate JavaScript and Python, sufficient to build and maintain production automation
- Hands-on agent building in Claude, including projects, skills, connectors, and scheduled tasks
- Ability to build agents in the native enterprise agentic environment and connect APIs with native infrastructure
- LLM evaluation experience, including prompt and rubric design and calibration against human judgment
- Data analytics background with experience in the data collection or annotation industry
- Experience managing projects with external vendors or contributors and multiple stakeholders
- Ability to make and own decisions with incomplete information
Benefits:
- Remote work arrangement
- Full-time, fixed-term employment (1 year with possibility to extend)












