Senior Data Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Data Engineer designing governed Microsoft Fabric pipelines, warehouses and semantic models for Nucleus, a retirement-services platform provider. Leading delivery, controls, incidents and engineering standards.
Responsibilities:
- Own the design and delivery of complex parts of the Microsoft Fabric data platform
- Decide how new data sources are onboarded and modelled, including required controls and promotion readiness
- Lead ingestion pipeline and warehouse model design from source review through live, reconciled and documented production pipelines
- Define and evolve engineering standards, naming conventions, load patterns and re-runnability requirements
- Lead design of the conformed warehouse layer and resolve source-system differences in identifiers, hierarchies and status models
- Provide in-depth peer review and act as technical approver for production changes, especially regulatory pipelines and semantic models
- Work with the Product Owner to scope, break down, estimate and prioritise data and BI projects
- Design validation, reconciliation and monitoring controls, own materiality-threshold judgements, and provide evidence to risk, compliance and audit reviewers
- Lead complex incident diagnosis, code and data rollback, root-cause analysis and recovery
- Govern semantic models, keeping business logic in version-controlled warehouse procedures and measures thin
- Mentor engineers through review, pairing and structured knowledge transfer
- Potentially line manage engineers, including objectives, development plans, one-to-ones and performance
- Engage finance, risk, compliance and business stakeholders to turn requirements into deliverable solutions
- Lead Agile planning, backlog refinement and retrospectives and drive continuous improvement
- Support data outputs for management information, financial reporting, self-service analytics, AI capability and FCA/PRA regulatory returns
Requirements:
- Advanced SQL development, optimisation and troubleshooting, including complex stored procedure logic over bi-temporal, large data volumes
- Proven record of designing and delivering pipelines or platforms end to end in a cloud data platform such as Microsoft Fabric, Azure Data Factory, Synapse or Databricks
- In-depth understanding of dimensional modelling using the Kimball methodology, conformed dimensions, slowly changing dimensions, surrogate key strategies and incremental load patterns
- Strong semantic model and DAX skills, with a clear view on where logic belongs between the warehouse and the model
- Confidence with Python for parsing, automation and data handling, ideally in a notebook environment
- Strong working knowledge of branching strategy, pull request policy, environment promotion and secret management
- Experience operating change control in a governed environment
- Experience designing reconciliation, validation and monitoring controls, and setting investigation thresholds
- Ability to lead diagnosis and recovery during live data incidents and communicate clearly
- Genuine interest in mentoring and developing other engineers
- Ability to manage priorities, expectations and delivery with senior stakeholders
- Comfort taking unclear requirements or undocumented source feeds and turning them into defined, deliverable work
- Hands-on experience with Microsoft Fabric Lakehouse, Fabric Data Warehouse, Data Pipelines, Notebooks, Git integration and deployment pipelines is desirable
- Experience delivering data used for regulatory reporting and working with audit, risk and compliance reviewers is desirable
- Experience with Wrap, SIPP, pensions or investment platform data is desirable
- Experience with encrypted file transfers, key management and automated decryption in a controlled environment is desirable
- Understanding of curated data supporting AI use cases and related governance is desirable
- DP-700 certification is welcome but not required
Benefits:
- Non-contributory pension
- Bonus
- Enhanced parental leave
- Paid time off for emergencies
- Health and wellbeing initiatives
- Flexible working options
- Inclusion and diversity embedded in the company culture
- Recognition and rewards for employees' efforts
Similar Jobs
Senior Data Engineer
Senior Data Engineer architecting secure, scalable data warehouses and lakes for Avenga’s global technology services. Leading complex data initiatives, governance, and technical teams.
Data Engineer
Data Engineer building Microsoft Fabric pipelines, warehouses and semantic models for Nucleus retirement platforms. Supporting regulated financial reporting, analytics and AI capabilities.
Senior Data Engineer, GCP
Senior Data Engineer designing GCP data platforms, pipelines, warehouses, and lakehouses. Delivering scalable analytics, AI, and ML solutions for customer environments.
Senior Data Engineer, GCP
Senior Data Engineer building scalable GCP data platforms, warehouses, lakehouses, and pipelines. Leading customer data projects across architecture, analytics, deployment, and governance.
Senior Data Engineer, GCP
Senior Data Engineer designing scalable GCP data solutions for customer environments. Building pipelines, warehouses, lakehouses, and analytics platforms across the full data lifecycle.
Senior Synthetic Data Engineer – Autonomous Driving
Senior Synthetic Data Engineer developing synthetic data, sensor simulation, and Cosmos/NuRec world-model systems. Advancing NVIDIA’s autonomous-driving platform through scalable simulation and validation.
Senior Data Engineer – Data Foundation, Analytics
Senior Data Engineer building CUJU’s data foundation for AI-powered football talent scouting. Developing AWS pipelines, analytics models, and scalable data services.
Software Engineer – Data Products, AI Applications
Software Engineer building executive-ready Databricks applications for Data Elephant, a data and AI consultancy. Developing visualizations, applying AI/ML, and collaborating with client stakeholders.
Senior Data Engineer
Engenheiro de Dados Sênior projetando arquiteturas, modelos e pipelines analíticos para a consultoria de dados Rox Partner. Atuação com Azure, Databricks, Data Lake e Power BI.
Data Architect Principal, Analytics Pipeline
Principal Data Architect designing AWS-Snowflake pipelines that turn government healthcare claims into fraud alerts at GDIT. Owning event-driven architecture, standards, integrations, and production delivery.
Senior Data Engineer – IICS, Redshift
Senior Data Engineer building IICS, Redshift, SQL, and Python data pipelines for CompassX’s consulting clients. Supporting Power BI reporting, data quality, and pharma-sector stakeholder delivery.
Data Architect
Azure Data Architect designing enterprise-scale Azure, Snowflake, and dbt data platforms for EXL. Defining architecture standards, modernization strategies, and analytics solutions.
Senior Staff Data Engineer
Senior Staff Data Engineer building scalable data infrastructure for SonderMind’s digital mental health platform. Leading pipelines, architecture, reliability, and compliance for analytics, ML, and clinical outcomes.
Mid Level Data Engineer
Mid-level Data Engineer building reliable pipelines, data models, and infrastructure for Satalia’s data science, optimization, and AI projects. Fully remote from Greece.
Data Engineer II
Data Engineer II building Kafka, Spark, and dbt data platforms for Mrsool's on-demand delivery business. Developing reliable pipelines, models, warehouses, and analytics datasets.
Lead Data Engineer
Lead Data Engineer building University of the Cumberlands’ Snowflake lakehouse and analytics infrastructure. Leading architecture, pipelines, governance, and the data engineering team.
Junior Data Engineer, MarTech Specialist – Mobile Apps
Junior Data Engineer supporting mobile app tracking, attribution, and data pipelines at Customlytics, a DACH app marketing agency. Maintaining dashboards and marketing integrations for client campaigns.
Senior Software Engineer, Data Platform
Senior Data Engineer architecting G-P’s AI-native Databricks platform. Building scalable data frameworks and streaming systems for G-P’s global employment SaaS platform.
Financial Data Engineer, AI/LLM
Financial Data Engineer building stock-market data infrastructure for Binance’s blockchain ecosystem. Developing Flink pipelines and reliable datasets for trading products and AI applications.
Senior Product Manager – Data Platform, Web3
Senior Product Manager owning Trust Wallet’s global Web3 data platform roadmap. Leading on-chain data ingestion, token data governance, and analytics products.