Senior Data Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Engenheiro de Dados Sênior construindo pipelines medalhão no Databricks e Azure para cliente automotivo global. Garantindo governança, qualidade e CI/CD para habilitar BI e Data Science.
Responsibilities:
- Design and implement end-to-end medallion architecture in Databricks
- Ingest data into Azure Data Lake Storage Gen2 and build Bronze, Silver, and Gold layers for batch and near-real-time sources
- Ingest data from source systems into Azure, handling schema evolution, validation, and reprocessing
- Use Unity Catalog for access control, data lineage, and data governance
- Build and maintain CI/CD pipelines in Azure DevOps
- Orchestrate production pipelines using Databricks Workflows
- Share platform ownership with the Analytics Engineer and clearly document ownership and timelines
- Manage ingestion, transformation logic, and the structure and quality of the Gold layer
- Deliver a Gold layer that enables insights, BI, and assets ready for Data Science
Requirements:
- Relevant experience in Data Engineering, including at least 3 years of hands-on experience with Databricks and medallion architecture in production
- Proficiency in Python, SQL, and PySpark
- Previous experience with Azure Data Lake Storage Gen2, Unity Catalog, Azure DevOps, and Databricks Workflows
- Fluent English is required, as this role will work directly with a global program team
- Nice to have: previous experience integrating Salesforce as a data source
- Nice to have: Databricks certification, such as Databricks Certified Data Engineer Professional or Associate
- Nice to have: experience in the automotive industry or in other regulated, multi-site manufacturing programs
- Proactivity, direct communication, ownership, and genuine care
Similar Jobs
Senior Data Engineer
Senior Data Engineer building data contracts and Delta Sharing for JLL’s enterprise real estate data platform. Enabling governed, self-service access for analytics, reporting, and product teams.
Senior AI Engineer – Data, MLOps
Senior AI Engineer building production ML, GenAI, and MLOps solutions for Teradyne’s test automation business. Operationalizing enterprise AI across Azure, Google Cloud, Snowflake, and Microsoft Fabric.
Principal Cloud Data Engineer
Cloud data engineer building governed, AI-ready data pipelines for Teradyne’s global test and automation solutions. Enabling enterprise AI, analytics, and operational insights across multicloud platforms.
Data Architect, Informatica
Senior Data Architect designing Informatica, data governance, and hybrid-cloud solutions. Delivering enterprise architectures for Talan’s international technology consulting clients.
Data Architect, Informatica
Senior Data & Informatica Architect designing secure hybrid enterprise data architectures for Talan, an international technology consulting group. Leading Informatica, cloud, integration, governance, and data security initiatives.
Data Architect, Informatica
Senior Data & Informatica Architect designing secure hybrid enterprise architectures for Talan’s technology consulting clients. Leading data integration, governance, cloud, and Informatica architecture initiatives.
Data Platform Engineer
Data Platform Engineer building data pipelines, APIs, and risk knowledge graphs for Worth AI’s AI-powered decision-making products. Supporting real-time onboarding and trusted data services.
Data Engineer
Data Engineer maintaining ETL pipelines and data quality for Cotiviti’s healthcare data operations. Supporting scalable ingestion, warehousing, governance, and production data delivery.
Principal Data Architect
Principal Data Architect designing scalable GCP Data Lakehouse platforms for Egen’s data and insights consultancy. Leading client architecture, pipelines, governance, and technical delivery.
Lead Data Engineer
Senior Data Engineer building GCP data pipelines for Egen’s healthcare data innovation. Driving machine learning initiatives and data solutions that improve patient outcomes.
Vice President, Data Engineering
Vice President leading data strategy, architecture, and engineering for PICTON Investments, a Canadian alternative investment manager. Building financial data platforms supporting portfolios, analytics, risk, and AI.
Director of Data Engineering
Director of Data Engineering leading scalable, governed data platforms for OnTrac’s same-day and next-day U.S. delivery services. Overseeing pipelines, AI-ready data products, budgets, and engineering teams.
Engagement Lead – Enterprise Data Warehouse
Engagement Lead owning CIO-level client relationships and prioritizing enterprise data warehouse delivery. Shaping Snowflake remediation and Power BI dashboards for Bounteous, a global AI services firm.
Senior Data Engineer, Databricks
Engenheiro de Dados Sênior atuando em migração e engenharia de dados no Azure Databricks. Automatizando pipelines e assegurando governança, desempenho e integridade em ambientes críticos.
DBA, Bulk Data Management Engineer
DBA engineering Webbing’s global telecoms connectivity and IoT data platform. Managing PostgreSQL, telecom network databases, bulk data pipelines, governance, and disaster recovery.
DBA, Bulk Data Management Engineer
DBA engineering Webbing's global telecom connectivity and IoT platform across PostgreSQL, BSS, and network databases. Building resilient data operations, integrations, governance, and disaster recovery.
DBA, Bulk Data Management Engineer
DBA managing PostgreSQL, bulk data, and governance for Webbing’s global telecom connectivity and IoT platform. Building resilient databases, mediation pipelines, monitoring, and disaster recovery.
DBA, Bulk Data Management Engineer
DBA engineering PostgreSQL databases and bulk-data pipelines for Webbing’s global connectivity and IoT platform. Managing telecom network integrations, governance, high availability, and disaster recovery.
Data Engineer
Data Engineer diseñando pipelines, arquitecturas y plataformas de datos escalables para iCodde. Integrando, transformando y asegurando datos para análisis y decisiones operativas.
Collibra Engineer – Data Governance
Collibra Engineer improving data catalogs, metadata, and workflows for AMDEX.ai’s federal data modernization services. Supporting a DHS client with governance, quality, and interoperability.