Lead Data Engineer – Databricks
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Data Engineer Lead leading cloud data migrations with Databricks, Python, and Spark. Building Big Data and Machine Learning systems for Muttdata’s clients.
Responsibilities:
- Lead end-to-end data migration initiatives, ensuring a smooth, secure, and business-aligned transition
- Define and communicate data architecture decisions across cloud data platforms such as AWS Redshift, Databricks, and related technologies
- Coordinate discovery and documentation of dependencies, schema inventories, data flows, and critical migration processes
- Own migration and cutover planning, including validations and contingency measures
- Serve as primary liaison between engineering, analytics, product, and business stakeholders
- Translate technical changes into clear business impact assessments
- Define and document assumptions, requirements, and acceptance criteria
- Oversee validation of migrated datasets for accuracy, consistency, and integrity
- Identify, assess, and mitigate migration-related risks and escalate blockers and dependencies
- Drive problem-solving and decision-making in fast-paced, ambiguous environments
- Create and maintain migration runbooks, testing strategies, rollback plans, and operational procedures
- Provide project status updates to technical and executive stakeholders
- Promote data governance, quality, and operational best practices
- Align engineers, analysts, and product stakeholders around priorities, timelines, and delivery expectations
Requirements:
- Experience in Data Engineering, including building and optimizing data pipelines
- Experience working with Databricks, Python, and Spark, building batch and streaming
- Advanced English Level
- Familiarity with a BI visualization tool like Looker or Tableau
Benefits:
- Remote-first culture – work from anywhere!
- AWS, DBT, Google Cloud, Azure & Databricks certifications fully covered
- In-Company English Lessons
- Birthday off + an extra vacation week (Mutt Week!)
- Referral bonuses
- Maslow: Monthly credits to spend in our benefits marketplace
- Annual Mutters' Trip
- Monthly Childcare Reimbursement
Similar Jobs
Director of Data Engineering – M4
Director leading secure data platforms and AI-enabled engineering for ClassLink’s education technology products. Building engineering teams, cloud architectures, governance, and reliable data services for schools.
Principal Data Platform Engineer – Swedish Ad Platform
Principal Data Platform Engineer building an AI-first event-driven lakehouse for a global AdTech company. Defining scalable data architecture, governance, pipelines, and AI-ready data products.
Principal Data Platform Engineer – Swedish Ad Platform
Principal Data Platform Engineer building an AI-first data platform for a global AdTech company. Designing event-driven lakehouse architecture, governed data products, and scalable analytics infrastructure.
Senior Clinical Data Engineer
Senior Clinical Data Engineer designing regulated data solutions for Parexel's clinical trials. Leading ingestion, validation, reporting, and technical teams in Hyderabad.
Cúram Technical Consultant – Data Migration
Cúram Technical Consultant designing and testing data migrations for PLATO, Canada’s Indigenous-owned software testing and technology services company. Supporting Agile delivery, Azure DevOps, CI/CD, and test automation.
Senior Data Engineer
Senior Data Engineer building scalable pipelines and data platforms for Moniepoint, Africa’s all-in-one financial platform. Optimising cloud data systems, accuracy, and model performance.
Staff Data Engineer – Mission Data Platform
Staff Data Engineer architecting scalable pipelines and data products for LMI’s secure U.S. Army platform. Integrating distributed systems and mentoring engineers.
Senior Data Engineer
Senior Data Engineer leading Azure data architecture, pipelines, and warehouse implementations. Mentoring technical teams and delivering cloud data solutions for clients in the Philippines.
Lead Consultant, Data Architecture – Engineering
Lead consultant designing Azure data architectures, data warehouses, and pipelines. Providing technical leadership and engineering solutions for clients in the Philippines.
Talent Acquisition Data Engineering & Analytics Intern
Graduate intern building Snowflake data pipelines, dimensional models, and Power BI dashboards for Solidigm’s global memory business. Automating Talent Acquisition reporting and analytics.
Senior Data Engineer
Senior Data Engineer building scalable data infrastructure for Atom Learning’s personalised education products. Developing pipelines, models and predictive learning features used by students, teachers and schools.
Senior Staff Data Engineer
Senior Staff Data Engineer shaping distributed data systems for SmithRx’s pharmacy benefits platform. Driving data strategy, governance, quality, and engineering-wide technical excellence.
Data Engineer
Data Engineer building scalable pipelines and centralized data platforms for XTB’s online financial trading business. Developing integrations, infrastructure, and data quality standards.
Associate Data Engineer
Associate Data Engineer building data pipelines, warehouses, and BI datasets for TaskUs’s outsourced digital services. Supporting ETL automation, data quality, modeling, testing, and monitoring.
Senior Rust Data Engineer
Senior Rust Data Engineer architecting high-throughput data services and ingestion pipelines for Nagarro’s digital product engineering company. Building low-latency infrastructure integrated with cloud warehouses and lakehouses.
Software Engineer, Data Systems/ETL
Software Engineer developing data systems and ETL software remotely from India. Producing code, unit tests, documentation, technical specifications, and proof of concepts.
Data Engineer – Databricks, Power BI
Data Engineer building Databricks applications and Power BI dashboards for Qualysoft, an international IT consulting and services company. Automating enterprise data integrations for energy and other industry clients.
Senior Principal Technical Product Engineer – Data Security
Principal Technical Product Engineer advancing Palo Alto Networks’ DSPM and DDR capabilities. Designing cloud and AI data-security architectures for strategic enterprise customers.
Engineer III – Platform Data Engineer
Platform Data Engineer operating CrowdStrike’s cybersecurity data platform. Managing Airflow, Superset, Terraform, CI/CD, cloud infrastructure, and data security.
Senior SAP Data Engineer
SAP Data Engineer Sênior projetando e otimizando modelos de dados SAP HANA para a UltraCon Consultoria em TI. Integração, relatórios, planejamento e gestão de incidentes em ambiente SAP BTP.