Data Engineer, Databricks
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Data Engineer overseeing data operations and solutions within Azure cloud environments. Collaborating on Databricks and ensuring reliable data processes and governance practices.
Responsibilities:
- Maintain data environments and processes in Azure and on-premises, ensuring continuous and reliable operation;
- Perform advanced administration and support for Databricks (Azure), including troubleshooting and operational tuning;
- Monitor and track pipelines, jobs, integrations, and data routines with a preventive and corrective approach;
- Implement fixes and improvements to existing processes, focusing on root cause analysis and recurrence reduction;
- Lead incident management and resolution (SLA, prioritization, communication, follow-up until stabilization);
- Support BI and development teams, ensuring environments are ready for new releases and demands;
- Continuously evolve and improve DataOps/CI-CD pipelines for data (governance, quality, and reliability);
- Collaborate with infrastructure and architecture teams when needed (capacity, access, security, network, performance);
- Ensure adherence to best practices for security, governance, and compliance in the data context;
- Propose and implement improvements to observability, monitoring, and alerts (metrics, logs, traceability).
Requirements:
- Senior experience in Data Engineering with a focus on support/operations (not only greenfield projects);
- Strong experience with Databricks, including troubleshooting and maintaining jobs/pipelines;
- Experience in cloud environments, preferably Microsoft Azure;
- Experience supporting pipelines, integrations, and data processes in production;
- Knowledge of monitoring, incident management, and problem management (SLA, prioritization, response, and post-incident).
Similar Jobs
Staff Data Engineer
Staff Data Engineer at firsthand Health designing and optimizing data infrastructure. Engaging in impactful work supporting individuals living with serious mental illness with a modern technology stack.
Data Architect – Tieto Tech Consulting
Data Architect designing scalable data architectures at Tieto Tech Consulting. Guiding clients through complex data solutions and fostering innovation in data and tech.
Lead Data Engineer – Tieto Tech Consulting
Lead Data Engineer at Tieto Tech Consulting, focusing on designing and evolving data platforms. Collaborating on data engineering initiatives and guiding project teams to deliver impactful solutions.
Data Architect
Data Architect designing scalable, secure architectures at Tieto Tech Consulting. Guiding complex decisions and collaborating with stakeholders for impactful data solutions.
Lead Data Engineer – Tieto Tech Consulting
Lead Data Engineer at Tieto Tech Consulting transforming raw data into impactful business solutions. Analyzing systems, guiding teams, and ensuring high-quality data architecture delivery.
Senior Data Architect – Common Data Model, Metadata Platforms
Senior Data Architect at a tech services company developing common data models and metadata platforms. Leading architecture design and integrating data systems for enterprise solutions.
Engenheiro de Dados – Sênior
Senior role in Data Engineering focusing on GCP with responsibilities in data governance, modeling, and pipeline management.
Data Engineer
Engenheiro de Dados criando dashboards e integrando dados de várias fontes. Colaborando com equipes de negócios e desenvolvendo soluções de BI de forma remota.
Senior Data Engineer
Data Engineer responsible for designing and maintaining scalable data pipelines at a global IT firm. Collaborating with various stakeholders to deliver insights from data solutions.
Data Engineer III
Data Engineer focusing on development and deployment of data-driven systems solutions at Raytheon. Analyzing ERP data, curating datasets, and collaborating with stakeholders to enhance business performance.
Data Engineer – 4-month contract
Data Engineer creating scalable data pipelines for autonomous truck technology. Focusing on ETL/ELT workflows and AWS-based data infrastructure management.
Senior Data Architect
Senior Data Architect supporting data architecture initiatives across cloud environments at Goods & Services. Designing, implementing, and optimizing data infrastructure and solutions to drive innovation and decision-making.
Data Architect
Data Architect designing scalable data solutions at EX Squared LATAM. Bridging business and technology to drive data-driven decision-making.
Data Engineer
Data Engineer at Anika Systems responsible for designing and building data pipelines. Supporting federal clients with data strategies and ensuring high-quality data for analytics.
Data Architect
Data Architect leading enterprise data architecture design and implementation for federal clients. Shaping data strategy and supporting data-driven decision-making with AI-driven workflows.
Senior Data Engineer
Senior Data Engineer responsible for building and maintaining Avra's data platform for AI. Engage with complex real-world data challenges in a remote-first environment.
Data Engineer
Data Engineer building and evolving Avra’s data platform from messy to structured datasets. Implementing reliable data pipelines and collaborating with senior engineers for real-world solutions.
Data Engineering Specialist
Data Engineering Solutions Specialist at Snowflake managing Data Engineering sales execution for ingestion workloads. Collaborating with teams to maximize customer adoption and drive revenue targets.
Data Architect
Data Architect designing scalable data solutions for LATAM projects. Leading implementation and guiding cross-functional teams in a modern Microsoft-based data ecosystem.
Senior Data Engineer
Senior Data Engineer supporting analytics and machine learning at Podimetrics. Building and maintaining data systems and pipelines for early diabetic foot ulcer detection.