AI Data Quality Analyst – Level 4
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Data Quality Analyst ensure high quality standards for AI/ML processes in data analysis. Performing audits, root cause analysis, and collaborating on project requirements with diverse teams.
Responsibilities:
- Perform quality audits on annotated datasets to ensure that they meet established guidelines and quality benchmarks.
- Leverage statistical based quality metrics such as F1 score and inter-annotator agreement to evaluate data quality.
- Analyse annotation errors, trends, project processes, and project documentation to identify and understand the root cause of errors and propose remediation strategies.
- Resolve and analyse edge-case annotations to ensure quality and identify areas for improvement.
- Become proficient in using annotation and quality control tools to perform reviews and track quality metrics.
- Become an expert in the project specific guidelines and provide feedback for potential clarifications or improvements.
- Identify opportunities to use automation to help enhance analytics, provide deeper insights, and improve efficiency.
- Develop and maintain up-to-date documentation on quality standards, annotation guidelines, and quality control procedures.
- Provide regular feedback that identifies areas for improvement across the annotation pipeline.
- Work closely with key project stakeholders and clients to understand project requirements and improve annotation pipelines.
- Assist with training annotators, providing guidance, feedback, and support to ensure data quality.
- Provide regular updates that highlight data quality metrics, key findings, and actionable insights for continuous process improvements.
Requirements:
- Bachelor’s degree in a technical field (e.g. Computer Science, Data Science) or equivalent practical experience.
- 1+ years of experience as a data analyst with exposure to data quality and/or data annotation - ideally within an AI/ML context.
- Familiarity with the basic concepts of AI/ML pipelines and data.
- Strong analytical and problem-solving skills with an exceptional eye for detail.
- Excellent written and verbal communication skills, with the ability to clearly articulate quality issues and collaborate with diverse teams.
- Ability to work independently and manage time effectively to meet deadlines.
- A strong problem-solver who thinks critically and drives innovation and continuous optimisation.
- A quick learner with the ability to work independently in a fast-paced environment.
- A strong focus on detail, balanced against strategic priorities.
- A positive can-do attitude and the ability to easily adapt to new environments.
- Not afraid to speak up.
Benefits:
- Competitive industry salaries
- Comprehensive benefits packages
- Internal mobility and professional growth opportunities
Similar Jobs
Freelance Energy Sector Expert
Energy Sector Professional at AI startup evaluating energy sector forecasts with strong analytical skills. Work remotely with a YC-backed company focusing on machine learning technologies.
Head of AI Solutioning
Lead AI Solutioning for clients, focusing on business processes and AI architecture development. Engage in technical leadership and team development within a remote work model.
Biology AI Training Expert
Biology expert creating AI training problems reflecting authentic scientific workflows. Designing challenging questions for frontier AI systems in remote work environment.
Biology AI Training Expert
Biology expert designing advanced problems for AI training. Focus on authentic scientific workflows for leading AI models with immediate availability.
Biology AI Training Expert
Biology expert creating challenging, deterministic problems for AI models in a remote role. Focusing on authentic scientific workflows and high standards of rigor and clarity.
Biology AI Training Expert
Biology expert creating challenging problems for frontier AI training data submission and verification. Engaging in computational analysis and experimental reasoning to enhance AI models.
Chemistry AI Training Expert
Chemistry expert creating advanced problems to train AI systems. Role requires strong skills in Python and chemistry knowledge for advanced problem design.
Chemistry AI Training Expert
Experts in Chemistry designing advanced problems for training frontier AI models. Collaborating on high-quality STEM training data with potential project extensions.
Chemistry AI Training Expert
Chemistry AI Training Expert designing advanced deterministic problems for frontier AI models. Focused on high-quality STEM training data for AI labs with rigorous technical explanations.
Chemistry AI Training Expert
Chemistry expert designing advanced deterministic problems for AI model training. Collaborating on high-quality STEM training data for leading AI labs.
Chemistry AI Training Expert
Design difficult chemistry problems for AI training evaluation processes. Collaborate and ensure reproducibility and technical precision in project deliverables.
Chemistry AI Training Expert
Chemistry expert design challenging problems for AI training data. Focusing on real scientific workflows with strong detail and clarity.
Chemistry AI Training Expert
Chemistry expert designing challenging problems for AI training data in STEM. Create original, verifiable tasks with strong computational rigor and precision.
Biology AI Training Expert
Biology expert creating advanced problems for AI systems. Involves computational analysis, Python usage, and ensuring technical clarity for quality scientific data.
Biology AI Training Expert
Biology expert creating deterministic problems for AI models, improving scientific reasoning in biology. Seeking strong Python and biological analysis skills, fully remote role.
Computer Science AI Training Expert
Computer Science expert needed to design challenging, verifiable problems for AI training. Work involves creating advanced problems in algorithms, machine learning, and computational methods.
Computer Science AI Training Expert
Computer Science expert designing challenging, original computational problems for AI training. Creating tasks that enhance model reasoning with verifiable solutions in a remote capacity.
Computer Science AI Training Expert
Design and create challenging computational problems for AI training in Computer Science. Collaborate to improve technical reasoning in leading AI models.
Computer Science AI Training Expert
Design advanced computational problems and tasks for AI systems. Collaborate to enhance AI model performance through challenging problem sets and verified solutions.
Computer Science AI Training Expert
Designing advanced problems in computer science and computational methods for AI training. Collaborating on tasks that challenge AI systems with clear documentation in English and robust solutions.