Data Engineer

Posted 26ds ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

Data Engineer designing large-scale data systems operating at petabytes scale. Collaborating with engineers and product managers to provide robust technical solutions at Stefanini.

Responsibilities:

  • Responsible for design, development and operations of large-scale data systems operating at petabytes scale.
  • Focusing on real-time data pipelines, streaming analytics, distributed big data and machine learning infrastructure.
  • Interacting with the engineers, product managers, BI developers and architects to provide scalable robust technical solutions.
  • Provides and supports the implementation and operations of the data pipelines and analytical solutions.
  • Performance tuning experience of systems working with large data sets.
  • Experience in REST API data service – Data Consumption.

Requirements:

  • Experiencia sólida en ingeniería de datos, manejo de grandes volúmenes de información, ETL, modelado de datos, y herramientas como Spark, Python, SQL, etc.
  • Min 6-8 años de BIG data development experience.
  • Demonstrates up-to-date expertise in Data Engineering, complex data pipeline development.
  • Experience in agile models
  • Design, develop, implement and tune large-scale distributed systems and pipelines that process large volume of data; focusing on scalability, low -latency, and fault-tolerance in every system built.
  • Experience with Java, Python to write data pipelines and data processing layers
  • Experience in Airflow & Github.
  • English conversational
  • Experience in writing map-reduce jobs.
  • Demonstrates expertise in writing complex, highly-optimized queries across large data sets
  • Proven, working expertise with Big Data Technologies Hadoop, Hive, Kafka, Presto, Spark, HBase.
  • Highly Proficient in SQL.
  • Experience with Cloud Technologies ( GCP, Azure)
  • Experience with relational model, memory data stores desirable ( Oracle, Cassandra, Druid)

Benefits:

  • Sueldo acorde a experiencia
  • Prestaciones de Ley
  • Días extra con goce se sueldo
  • Convenios en escuelas de idiomas, entretenimiento, cursos y más
  • Vales de despensa