Lead Data Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Lead Data Engineer at Valtech focusing on data engineering with Microsoft Fabric and Azure. Designing data architecture and overseeing data pipelines for enterprise platforms.
Responsibilities:
- Design and own the end‑to‑end medallion data architecture within Microsoft Fabric, including Bronze/Silver/Gold standards, modeling patterns, and governance frameworks.
- Define and drive architectural standards, patterns, and best practices across ingestion, transformation, data modeling, lineage, quality, and orchestration.
- Partner as a peer with the Director of Data & Analytics to shape long-term platform strategy, roadmap, and technical decision-making.
- Anticipate downstream implications of architectural choices, proactively guiding decisions that ensure long-term reliability, scalability, and maintainability.
- Architect and build highly available, distributed, fault‑tolerant data pipelines supporting batch and real‑time workloads.
- Lead the migration and integration of multiple disparate data sources into the new Fabric-based enterprise platform.
- Define data modeling approaches for enterprise‑scale structured, semi‑structured, and unstructured datasets.
- Establish end‑to‑end standards for ingestion → processing → serving layers.
- Tune and optimize distributed processing across large datasets and high-volume pipelines.
- Develop complex transformations and scalable pipelines using SQL, Python, dbt, and Fabric-native tools.
- Implement automation across the Fabric ecosystem leveraging REST APIs, Data Factory, pipelines, and workflow orchestration.
- Guide and mentor engineering teams on advanced data architecture concepts, distributed systems, metadata management, and platform hygiene.
- Conduct root cause analysis on platform issues, driving permanent solutions rather than short-term fixes.
- Act as a senior technical authority in design reviews, architectural discussions, and cross‑functional planning.
- Collaborate with analytics, product, and business stakeholders to understand requirements and translate them into architectural solutions.
- Communicate complex technical concepts clearly to both technical and non‑technical audiences.
Requirements:
- 8+ years of experience in data engineering, data architecture, or platform engineering.
- Experience building or migrating enterprise data platforms on Microsoft Fabric.
- Deep expertise with SQL, Python, and distributed data processing.
- Significant experience designing enterprise data architectures and medallion/lakehouse patterns.
- Strong knowledge of modern data platforms — Databricks, Azure Synapse, Microsoft Fabric, Delta Lake, or similar.
- Hands-on experience with cloud-native data engineering (Fabric preferred).
- Expertise building and optimizing large‑scale ETL/ELT pipelines across raw → refined → curated zones.
- Experience with automation and integration using REST APIs.
- Strong analytical thinking, system design skills, and the ability to foresee downstream technical consequences.
- Excellent communication skills and ability to engage as a peer with senior leadership.
- Upper-Intermediate English skills.
Benefits:
- Flexibility, with remote and hybrid work options (country-dependent)
- Career advancement, with international mobility and professional development programs
- Learning and development, with access to cutting-edge tools, training and industry experts
- Medical, dental, and vision insurance for you and your family, plus employer contributions to Health Savings Accounts
Similar Jobs
Senior Data Engineer – Azure Databricks
Senior Data Engineer building and optimizing data pipelines within Azure Databricks. Working on a major data platform modernization initiative for a global financial services client.
Lead Data Engineer
Lead Data Engineer at Cushman & Wakefield, architecting enterprise-scale data platforms and supporting integration projects. Mentoring engineers and driving innovation in cloud-native data engineering.
Senior Data Engineer
Data Engineer Sr at Siigo, a leader in accounting software for SMEs in LATAM. Designing scalable data extraction processes for business intelligence insights and ecosystem performance.
Senior Data Engineer
Senior Data Engineer at Delfos responsible for developing scalable business applications. Join our team to tackle challenges in data analysis from Spain.
Senior Data Engineer
Senior Data Engineer designing and implementing scalable data systems for corporate technology initiatives. Collaborating cross-functionally to ensure high-quality data solutions that meet business needs.
Lead Data Engineer
Lead Data Engineer defining data architecture and driving strategy for SANS cyber security training organization. Collaborating with teams to build scalable and secure data ecosystems.
Data Engineer
Data Engineer building scalable ETL/ELT data pipelines using GCP and BigQuery. Collaborating across teams to ensure robust data infrastructure and analytics ready datasets.
DataOps Engineer
DataOps Engineer architecting the 'Golden Path' for data infrastructure for Panopto’s learning platform, enabling rapid innovation and seamless growth for 10+ million users.
Junior Data Engineer
Junior Data Engineer supporting client data integrations and master data management using Syncari for AI initiatives. Collaborating with engineering teams for seamless client onboarding.
Data Engineering Lead
Data Engineering Lead overseeing design and development of next-generation data platform at MediaRadar. Spearheading data architecture and leading a team of data engineers for large-scale projects.
Data Engineer
Data Engineering role focused on building data infrastructure for AI-powered electricity marketplace startup. Collaborating across teams to drive insights that inform pricing and performance.
Senior Data Engineer, AI/ML
Sr. Data Engineer helping evolve modern data stack for AI and ML at Octave. Collaborating with teams to ensure reliable data pipelines and scalable analytics.
Contract Data Architect, Snowflake
Contract Data Architect specializing in Snowflake for The Motley Fool, a financial services company. Focused on optimizing reporting layer and enhancing data efficiency in a remote setting.
Semi Senior Data Engineer
Semi Senior Data Engineer building ELT pipelines and analytics models for clients at Ryz Labs. Hands-on role requiring strong skills in data engineering and Python, and customer interaction.
Senior Data Engineer – Real-Time ML, Pricing Platform
Senior Data Engineer building real-time data platforms for pricing algorithms at Trumid. Collaborating with engineers and data scientists to enhance infrastructure reliability and performance.
Data Engineer – Architect
Data Architect role for defining data strategy and optimizing data models for high-performance ecosystems. Collaborate across LATAM for product innovation and technical expertise in data management.
Data Engineering Architect
Data Engineering Architect at Juniper Square designing modern data architecture and engineering solutions. Leading transformation of data engineering into a scalable, product-oriented platform organization.
Senior Data Architect
Senior Data Architect supporting Los Alamos National Laboratory. Modernizing data architecture and collaborating on key analytics initiatives.
Senior Data Engineer
Senior Data Engineer designing and maintaining reliable data pipelines and scalable infrastructure for a personal injury law firm. Contributing to analytics, reporting, and decisions across the organization.
Principal Data Engineer
Principal Data Engineer leading data governance and managing reporting teams at Teachstone. Unifying data across multiple platforms to inform insights and operational efficiencies.