Ingeniero de Datos – Spark, Kafka, AWS
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Ingeniero de Datos diseñando pipelines batch y streaming con Spark, Kafka y AWS. Optimización de datos a gran escala para una multinacional de consultoría IT.
Responsibilities:
- Diseñar, desarrollar y optimizar pipelines de datos a gran escala
- Trabajar con procesos batch y streaming
- Integrarse a una célula ágil orientada a datos
- Participar en proyectos de datos productivos y de alto impacto
- Trabajar para una multinacional de consultoría IT
Requirements:
- Apache Spark avanzado: dominio de PySpark y Spark SQL, optimización de jobs, particionamiento, caching y procesamiento distribuido
- Experiencia práctica con Apache Kafka y Spark Structured Streaming o Apache Flink
- Experiencia en producción con servicios AWS como S3, Glue, EMR, Kinesis/MSK, Lambda, IAM o VPC
- Python avanzado y SQL avanzado
- Experiencia con Parquet, Avro, JSON y/o Delta Lake
- Manejo de Airflow o AWS Step Functions
- Git y prácticas de CI/CD
- Mínimo 3 años de experiencia en Ingeniería de Datos
- Al menos 2 años trabajando con Spark en ambientes productivos de alto volumen
- Experiencia comprobable en streaming de datos en tiempo real
- Spark + Streaming (Kafka/Flink) + AWS son requisitos excluyentes
- Estudios: Universidad / Carrera Profesional
Benefits:
- Todas las Prestaciones de Ley
- Seguro de Vida
- Asistencias Médicas y Psicológicas
- Convenios Educativos y Financieros
- Descuentos en GYM, Ópticas, Viajes, Inglés
- Plataformas e-learning
Similar Jobs
Senior Data Engineer – Microsoft Fabric
Data Engineer building Microsoft Fabric pipelines, Lakehouses, and curated datasets. Supporting analytics, reporting, and AI use cases for Expleo, a global engineering and consulting provider.
Senior Data Engineer
Engenheiro de Dados na DOMVS iT construindo e mantendo pipelines ETL/ELT escaláveis. Desenvolvendo soluções com AWS, Python, SQL e bases de dados.
Data Architect Lead
Data Architect Lead modernizing VA supply-chain data and systems for SAIC, a mission technology integrator. Building cloud integrations, AI/ML analytics, and real-time inventory dashboards.
Data Engineer III
Senior Data Engineer building high-volume data pipelines for Ookla, a global connectivity intelligence company. Supporting data scientists with Spark, Python, SQL, and modern lakehouse technologies.
Data Engineer II
Data Engineer building high-volume pipelines for Ookla, a connectivity intelligence company. Supporting data scientists and analysts with accurate, scalable internet performance data.
Director, Data Engineering – Google Cloud Platform
Director leading TTEC Digital’s Google Cloud data engineering practice. Building enterprise data platforms, GenAI infrastructure, and governance solutions for client transformations.
Senior Data Architect
Senior Data Architect building Snowflake and dbt data foundations for LG Energy Solution Vertech’s energy storage business. Enabling trusted analytics, reporting, governance, and AI across enterprise systems.
Presales Data Architect – Modern Data Stack, AI
Presales Data Architect diseñando arquitecturas Modern Data Stack y soluciones de IA para Reclut, marketplace de reclutamiento con IA. Liderando preventa, PoCs y assessments de arquitectura.
Staff Clinical Informatics Data Architect
Staff Clinical Informatics Data Architect leading FHIR, OMOP, and healthcare data integration for Verily Health's AI-enabled precision-health platform. Overseeing pipelines, standards, and data quality.
Product Manager, Person Data Platform
Product Manager owning Signify Health’s healthcare person-data ingestion platform roadmap. Driving reliable client data intake, platform stability, and HIPAA-compliant care-delivery operations.
Lead Engineer, Data Platform
Lead Engineer building secure, scalable hybrid data platforms for a global investment management firm. Leading architecture, automation, reliability, and enterprise data engineering standards.
Senior Software Engineer – Data Platform
Senior Software Engineer building LightBox's AI platform and developer tooling. Connecting commercial real estate data, AI models, and production workflow applications.
Forward Deployed AI Engineer – Data Intelligence
Forward Deployed AI Engineer building Claude-powered enterprise data and RAG solutions for NewRocket’s ServiceNow clients. Integrating governed data, AI workflows, and enterprise systems for secure operational outcomes.
Domain Data Architect
Domain Data Architect designing governed data models, integrations, and analytics solutions. Supporting US LBM, a leading U.S. specialty building-materials distributor.
Senior Data Engineer – Operational Reporting, Data Platforms
Senior Data Engineer building Oracle-based reporting data layers and pipelines for CVS Health’s healthcare operations. Supporting near real-time business intelligence, production reliability, and data quality.
D365 Data Migration Lead
D365 Data Migration Lead owning Dynamics 365 data migrations for HSO, a global Microsoft business transformation partner. Leading governance, ETL, cutovers, and data quality across international client projects.
Senior Data Engineer – Full Stack
Senior Data Engineer building end-to-end Databricks data products for DigiCert, which secures digital interactions worldwide. Developing pipelines, APIs, applications, governance, and production operations.
Senior Data Engineer, BizTech
Senior Data Engineer leading scalable batch and real-time data systems for Airbnb’s global hospitality platform. Shaping data strategy, governance, integrations, and engineering best practices.
Senior Data Engineer
Engenheiro de Dados Sênior construindo pipelines medalhão no Databricks e Azure para cliente automotivo global. Garantindo governança, qualidade e CI/CD para habilitar BI e Data Science.
Senior Data Engineer
Senior Data Engineer building data contracts and Delta Sharing for JLL’s enterprise real estate data platform. Enabling governed, self-service access for analytics, reporting, and product teams.