Manager, Test Data Engineering Team
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Test Data Engineering Manager leading automated data quality, synthetic data, and observability engineering. Supporting Live Nation’s global live entertainment and ticketing operations.
Responsibilities:
- Lead and evolve a team of primarily QA-background engineers into a high-performing, engineering-driven function
- Design and build reusable data quality frameworks integrated into Databricks pipelines
- Develop standardized validation libraries for schema checks, freshness, volume, and anomaly detection
- Define and enforce data quality standards and “Definition of Done” across pipelines
- Build scalable solutions for synthetic data generation and masking
- Develop replay frameworks for validating pipeline changes against production scenarios
- Create automated regression testing harnesses for batch and streaming pipelines
- Establish monitoring, alerting, and SLA/SLO frameworks for data pipelines
- Build tools to measure and track data quality, pipeline health, and reliability metrics
- Enable proactive detection of data issues in production environments
- Lead and grow a team of data quality engineers and test data engineers
- Partner with Data Engineering, Product, and Analytics teams to embed quality practices
- Drive adoption of frameworks and standards across global engineering pods
- Define and execute a long-term roadmap for enterprise data quality
- Prioritize initiatives across multiple stakeholders and global teams
- Eliminate manual validation processes through automation and engineering best practices
- Partner with internal stakeholders to define data validation requirements and establish reusable testing frameworks across the organization
- Manage multiple roadmaps and shared-service backlogs supporting diverse engineering teams
- Collaborate across North America, Europe, and Asia with globally distributed teams
Requirements:
- 5+ years in Data Engineering, Test Data Engineering, or related fields
- 2+ years in a technical leadership or management role
- Strong experience with Databricks, Spark, distributed data systems, Python and SQL
- Experience building automated validation or data quality frameworks
- Hands-on experience with data observability or validation tools such as Great Expectations, Deequ, or Soda
- Familiarity with streaming architectures and real-time validation
- AI orchestration experience is a huge plus
- Ability to automate synthetic data generation, data profiling, and pipeline regression testing
- Understanding of anomaly detection and large-scale data validation patterns, such as hash/Merkle-based validation
- Experience with major TDM tools for data profiling and sampling
- Experience with JIRA and agile user story and acceptance criteria writing
- Willingness to work with cross-functional teams across time zones and odd hours as necessary
- Excellent analytical skills
- Experience with user behavior data is a plus
- Track record of successfully launching test data solutions or BI validation applications
- Versatile, hands-on mindset with a bias for execution
- Passion for live music and events is a plus
Benefits:
- Medical, vision, dental and mental health benefits for you and your family
- Health care concierge
- Flexible Spending Accounts (FSA) or Health Savings Accounts (HSA)
- Free concert tickets
- Generous paid time off, including paid holidays, sick time, and personal days
- 401(k) program with company match
- Stock reimbursement program
- New parent programs including caregiver leave and baby bonuses
- Fertility, adoption, foster, or surrogacy support
- Career and skill development programs with School of Live
- Tuition reimbursement
- Student loan repayment
- Volunteer time off
- Crowdfunding match
- Reasonable accommodations for qualified individuals with disabilities
- Reasonable religious accommodations
Similar Jobs
Azure Data Architect
Azure Data Architect designing governed data platforms, models, and pipelines for Lingarogroup. Supporting data quality, security, governance, and analytics across Poland-based operations.
Data Architect, Databricks
Data Architect migrating Databricks workloads to AWS data platforms for CI&T’s enterprise AI transformation clients. Building scalable pipelines, governance, integrations, and secure analytics infrastructure.
Staff Data Engineer
Staff Data Engineer building scalable data systems for Oviva’s AI-powered chronic care platform. Designing pipelines, data products, and quality frameworks across European healthcare operations.
Senior Data Migration Specialist
Senior Data Migration Specialist leading secure EMR migrations for WELLSTAR’s Canadian healthcare platforms. Improving data tools, validation, governance, and go-live readiness.
Senior Data Engineer
Senior Data Engineer building cloud-native Databricks and AWS data platforms for a commercial laser fusion company. Designing real-time pipelines, observability, and AI-enabled engineering workflows.
Associate Data Engineer
Associate Data Engineer building Azure, Synapse, and Microsoft Fabric data solutions for Baker Tilly’s mid-market and enterprise clients. Developing pipelines, lakehouse models, governance, and analytics-ready assets.
Data Engineer
Data Engineer building Snowflake and Azure claims data infrastructure for ProgenyHealth. Supporting healthcare analytics, reporting, security, and reliable enterprise data pipelines.
Data Engineer
Data Engineer building scalable pipelines and analytics warehouses for Troveo’s licensed AI training data platform. Supporting data modeling, quality, reporting, and reliable delivery to AI teams.
Data Engineering Lead
Data Engineering Lead guiding engineers and consolidating Oxford Global Resources’ Azure and Microsoft Fabric data platform. Owning architecture, ETL reliability, governance, and delivery.
Principal Engineer – Data Retrieval
Principal Engineer architecting web-scale crawling, ingestion, and retrieval infrastructure for NVIDIA’s foundation AI models. Leading distributed systems design, production scaling, and high-quality pretraining data delivery.
IT Data Science Principal, Data Warehouse
Leading enterprise data warehouse, analytics, and AI capabilities for Cornerstone Building Brands, a North American building-products manufacturer. Driving roadmaps, governance, modernization, and multidisciplinary delivery.
Data Engineer
Data Engineer building reliable pipelines for Branch’s fintech platform, which accelerates payments and provides financial services. Using Python, SQL, Airflow, Snowflake, DBT, and GCP.
Data Engineer
Data Engineer building reliable pipelines and transformations for Definitive Healthcare’s healthcare data products. Supporting Claims and Consumer domains with Python, SQL, Spark, and cloud platforms.
Senior Data Platform Engineer
Senior Data Platform Engineer building scalable data lakes, ingestion pipelines, and Kubernetes infrastructure. Supporting analytics, product applications, AI workloads, and large-scale model execution.
Medical Receptionist, Data Migration Specialist
Remote medical receptionist and data migration specialist transferring patient records from Elation Health to Dakota Health. Supporting U.S. practice scheduling, patient calls, and administrative workflows.
Data Engineer
Data Engineer building Azure Databricks pipelines for credit-card data at CGI, a global IT and business consulting firm. Modernizing financial data platforms and controls.
Working Student – Data Engineering
Working Student building Python and SQL data pipelines for AgentixLake’s cloud data and AI engineering projects. Supporting data quality, lakehouse platforms, testing, and monitoring.
Data Engineer – Temporary
Data Engineer building reliable Zuora-to-GCP ETL pipelines for Applaudo’s AI-powered solutions. Maintaining integrations, data quality, monitoring, and warehouse validation in an async distributed team.
WEKA Data Platform Administrator
WEKA Data Platform Administrator operating NeuralMesh enterprise AI data infrastructure for GPU-cloud customers. Managing storage, Kubernetes, networking, automation, and customer workload performance.
Analytics Engineer – Data Platform
Analytics Engineer building Snowflake and dbt models for Aline’s senior-living resident lifecycle platform. Creating governed data foundations for BI reporting and AI-driven care outcomes.