Senior Data Engineer

Posted 3hrs ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

Senior Data Engineer at Reply managing data pipelines and collaborating on data-driven solutions. Working with emerging technologies like AI, Cloud, and Big Data.

Responsibilities:

  • Build and manage reliable data pipelines involving ingestion/collection, processing, integration, storage, and data availability across the organization
  • Work within a distributed systems architecture for massively parallel (MPP) data processing, combining diverse heterogeneous data sources and collaborating with analytics and data science teams to build solutions and generate data-driven value

Requirements:

  • Practical experience with ingestion, integration, processing, and storage of large volumes of data
  • Experience working on Big Data projects
  • Behavior Driven Development (BDD)
  • Data extraction using Python and data processing with PySpark
  • Experience with ETL tools
  • Knowledge of relational and dimensional data modeling (Data Warehouse)
  • Experience with SQL databases
  • Experience with Big Data-related AWS toolset such as EMR, Kinesis, Redshift, S3, Glue, Elasticsearch
  • Knowledge of Kafka
  • Knowledge of Data Lake and DataOps
  • Experience with Data Science
  • Preferred/Differential: AWS certifications
  • Knowledge of infrastructure provisioning tools as code for cloud such as Terraform and CloudFormation

Benefits:

  • Swile flexible card you can use as you wish (meal and food allowances)
  • Totalpass or Gympass
  • Mental health support – Psicologia Viva
  • Bradesco Health Plan
  • Bradesco Dental Plan
  • Profit sharing
  • Childcare assistance for our moms
  • Incentives for certifications
  • Special talks and webinars
  • RAF referral bonus program
  • Life insurance
  • Subsidy for English or Italian
  • Open English discount
  • Birthday gift
  • Possibility to relocate to another country
  • Partnerships with universities