Senior Data Engineer
Posted 1hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Engenheiro de Dados Sênior construindo pipelines Big Data para a Reply, multinacional de consultoria e soluções de TI. Processamento distribuído em AWS e colaboração com equipes de análise e ciência de dados.
Responsibilities:
- Build and manage reliable data pipelines covering data ingestion/collection, processing, integration, storage, and delivery
- Work on distributed systems architecture for parallel processing of large volumes of data (MPP)
- Combine multiple heterogeneous data sources
- Collaborate with analytics and data science teams to build data-driven solutions and generate value
Requirements:
- Hands-on experience with ingesting, integrating, processing, and storing large volumes of data
- Experience working on Big Data projects
- Behavior-Driven Development (BDD)
- Data extraction with Python and data processing with PySpark
- Experience with ETL tools
- Knowledge of relational and dimensional data modeling (Data Warehousing)
- Experience with SQL databases
- Experience with EMR, Kinesis, Redshift, S3, Glue, and Elasticsearch on AWS
- Knowledge of Kafka
- Knowledge of Data Lakes and DataOps
- Nice to have: knowledge of Terraform or CloudFormation
Benefits:
- Cutting-edge environment / Innovation at our core – Challenging projects alongside highly qualified specialists
- Continuous learning – Discounts and partnerships with leading universities and technology platforms in Brazil
- Language learning without barriers – Special rates on language-learning platforms
- Projects involving AI, Cloud, Machine Learning, and Industry 4.0
- Strategic partnerships with Microsoft, Oracle, AWS, and SAP


















