Senior Data Engineer – Especialista en Databricks
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Data Engineer designing and optimizing data pipelines in cloud environments. Collaborating with multidisciplinary teams on advanced analytics and machine learning projects.
Responsibilities:
- Diseñar y desarrollar pipelines de datos eficientes y escalables utilizando Databricks, Spark y tecnologías relacionadas.
- Implementar procesos de ingestión, transformación y almacenamiento de datos en entornos cloud (Azure, AWS o GCP).
- Optimizar el rendimiento de clusters Spark y gestionar costos en plataformas Databricks.
- Garantizar la calidad, gobernanza y seguridad de los datos en todas las etapas del ciclo de vida.
- Colaborar con equipos de Data Science y BI para habilitar modelos predictivos y dashboards.
- Automatizar procesos mediante CI/CD y herramientas de orquestación (Airflow, Azure Data Factory, etc.).
- Documentar arquitecturas y flujos de datos, asegurando buenas prácticas y estándares.
Requirements:
- +5 años de experiencia en ingeniería de datos y entornos Big Data.
- Experiencia demostrable en Databricks y Apache Spark.
- Conocimiento avanzado en SQL, Python y Scala.
- Experiencia en cloud computing (Azure, AWS o GCP) y almacenamiento distribuido (Delta Lake, Parquet).
- Familiaridad con CI/CD, Git, y herramientas de orquestación.
- Comprensión de arquitecturas orientadas a datos y principios de DataOps.
- Inglés profesional (oral y escrito).
- Deseable: Certificaciones en Databricks o Azure/AWS/GCP.
- Experiencia en streaming de datos (Kafka, Event Hub).
- Conocimiento de modelos de machine learning y su integración en pipelines.
Benefits:
- Programa de formación por parte de la empresa para que puedas seguir desarrollándote y promocionar dentro del plan de carrera que existe para ti.
- Contrato indefinido y estabilidad.
- Retribución flexible y más beneficios
- Flexibilidad horaria.
- Modalidad de teletrabajo híbrida.
- Te ofrecemos un entorno dinámico, en el que tu plan de carrera y crecimiento será nuestro objetivo.
- Buen ambiente de trabajo, abiertos e inclusivos.
- Formarás parte de un gran equipo de profesionales con inquietud y motivación por la tecnología.
Similar Jobs
Lead Data Engineer
Data Engineer Lead designing scalable data platforms for advanced analytics at Blend. Collaborating with cross-functional teams to build robust data solutions.
Data Architect – Strong Azure Services, Finance Experience (GL, AR, AP)
Data Architect specializing in financial systems (GL, AR, AP) and using Azure. Fully remote position requiring 12+ years of relevant experience.
Senior Data Architect – 2 months project
Seeking a Senior Data Architect for a two-month project focused on building a data warehouse in the car rental industry. Must have experience in data engineering and warehouse architecture.
BI Data Engineer
Lead Data Engineering initiatives in IT Analytics for transforming raw data into strategic assets. Collaborate with business areas to develop data solutions with a strong analytical vision.
Senior Data Engineer
Senior Data Engineer designing and maintaining scalable data pipelines for Pax8's cloud marketplace. Collaborating on architecture and mentoring data engineers while driving data quality and reliability.
Data Engineer IV
Data Engineer IV developing scalable data pipelines and orchestration frameworks at Rackspace Technology. Leading teams in data governance and managing analytics workloads across Azure and Databricks.
Information/Data Architect
Information/Data Architect providing technical expertise and support for data architecture requirements at Concept Plus. Developing data strategies and maintaining information structures for effective governance.
Staff Data Engineer, Financial Data Operations
Staff Data Engineer on a mission to drive financial data operations for Root's tech-focused insurance platform. Collaborating with engineering and finance to enhance data workflows for payments and incentives.
Senior Data Engineer, Marketing Operations
Senior Data Engineer driving marketing operations and strategy at Root. Collaborating with multiple teams to enhance data infrastructure and analytics capabilities.
Data Engineer I
Data Engineer I supporting data platform development at EverCommerce. Collaborating with senior engineers and analytics teams to deliver reliable, high-quality data.
Technical Lead – Data Engineering, Analytics
Technical Lead delivering enterprise data engineering and analytics solutions for Department of Veterans Affairs. Lead teams to architect systems that strengthen mission operations for Veterans.
Senior Data Engineer
Senior Data Engineer designing and maintaining scalable data infrastructure for enterprise reporting, financial reconciliation, and operational analytics at Vetcor.
Data Migration and Onboarding Specialist
Data Migration and Onboarding Specialist at Alt Legal focused on client data migration and onboarding process. Collaborating internally and externally to ensure customer satisfaction and accurate data management.
Data Engineer – Cloud, BI Architecture
Data Engineer at First Table creating a cloud warehouse from scratch and managing data flow. Leading technical architecture for marketing and product functions to enhance data-driven decision making.
Data Engineer
Data Engineer building data integration pipelines for data lakes and warehouses. Collaborating with stakeholders to meet business requirements in a leading publishing company.
Founding Data Engineer – PG, Opensearch
Founding Data Engineer responsible for building the data infrastructure at Neuroscale AI. Designing and maintaining scalable data systems to support AI-driven products.
Data Architect – Operations Technology
Data Architect designing enterprise-wide data solutions for Trissential's clients. Leading modernization initiatives and collaborating on advanced analytics in Operations Technology.
Senior Data Platform Compliance Engineer
Senior Data Platform Compliance Engineer ensuring compliance in cloud environments. Collaborating on data governance and implementing CI/CD practices for data services.
Data Engineer – Healthcare
Data Engineer designing and maintaining scalable data platforms using AWS at Experian. Collaborating with cross-functional teams to support analytics and machine learning projects.
Principal Data Engineer
Principal Data Engineer playing a key role in developing data infrastructure and analytical platform at Prescryptive. Responsible for architecture, design, implementation, and mentorship across teams.