Senior Data Engineer

Posted 1hrs ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

Engenheiro de Dados Sênior construindo pipelines Big Data para a Reply, multinacional de consultoria e soluções de TI. Processamento distribuído em AWS e colaboração com equipes de análise e ciência de dados.

Responsibilities:

  • Build and manage reliable data pipelines covering data ingestion/collection, processing, integration, storage, and delivery
  • Work on distributed systems architecture for parallel processing of large volumes of data (MPP)
  • Combine multiple heterogeneous data sources
  • Collaborate with analytics and data science teams to build data-driven solutions and generate value

Requirements:

  • Hands-on experience with ingesting, integrating, processing, and storing large volumes of data
  • Experience working on Big Data projects
  • Behavior-Driven Development (BDD)
  • Data extraction with Python and data processing with PySpark
  • Experience with ETL tools
  • Knowledge of relational and dimensional data modeling (Data Warehousing)
  • Experience with SQL databases
  • Experience with EMR, Kinesis, Redshift, S3, Glue, and Elasticsearch on AWS
  • Knowledge of Kafka
  • Knowledge of Data Lakes and DataOps
  • Nice to have: knowledge of Terraform or CloudFormation

Benefits:

  • Cutting-edge environment / Innovation at our core – Challenging projects alongside highly qualified specialists
  • Continuous learning – Discounts and partnerships with leading universities and technology platforms in Brazil
  • Language learning without barriers – Special rates on language-learning platforms
  • Projects involving AI, Cloud, Machine Learning, and Industry 4.0
  • Strategic partnerships with Microsoft, Oracle, AWS, and SAP