Senior Data Engineer - AWS
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Engenheiro de Dados Sênior construindo pipelines, Data Lakes e arquiteturas AWS. Consultoria de tecnologia conectando dados, plataformas e IA para transformar grandes empresas.
Responsibilities:
- Design, develop, and evolve scalable data pipelines using AWS services
- Develop robust processes for data ingestion, transformation, and provisioning (ETL/ELT)
- Implement and optimize solutions using AWS Glue, S3, Lambda, Athena, Redshift, EMR, Step Functions, and EventBridge
- Design, implement, and maintain Data Lakes and modern data architectures in an AWS environment
- Develop solutions using Python and SQL with a focus on performance, scalability, and data quality
- Work with large volumes of structured and unstructured data
- Ensure data quality, integrity, security, and governance throughout the pipeline
- Optimize queries, processing, and data consumption to reduce costs and improve performance
- Collaborate with Analytics, Data Science, Software Engineering, and Architecture teams to build strategic solutions
- Implement monitoring, observability, and error handling for data pipelines
- Participate in defining standards, best practices, and the evolution of the platform's data architecture
- Support analysis and resolution of critical incidents related to the data environment
Requirements:
- Proven experience as a Data Engineer in AWS environments
- Strong knowledge of core AWS services used in data architectures, such as S3, Glue, Athena, Redshift, Lambda, EMR, and IAM
- Solid experience developing data pipelines using ETL/ELT patterns
- Experience with Apache Spark/PySpark and Delta Lake
- Advanced knowledge of Python and SQL
- Experience with data modeling for analytical environments and Data Lakes
- Knowledge of Infrastructure as Code (IaC) using AWS CloudFormation or Terraform
- Experience with version control using Git and CI/CD practices
- Understanding of partitioning, query optimization, and distributed processing
- Experience with monitoring, observability, and troubleshooting data pipelines
- Knowledge of cloud data architecture and best practices for security and data governance
- Strong analytical skills, problem-solving ability, and experience working in collaborative teams
- Preferred: experience with Databricks on AWS
- Preferred: familiarity with Apache Airflow or other workflow orchestration tools
- Preferred: experience with event-driven architectures
- Preferred: knowledge of Apache Iceberg or Apache Hudi
- Preferred: experience with Docker and Kubernetes
- Preferred: experience on Machine Learning, AI, and MLOps projects
- Preferred: experience in large enterprise environments and mission-critical projects
- Preferred: AWS certifications focused on Data Engineering, Data Analytics, or Solutions Architecture
Benefits:
- Employment model can be either Contractor (PJ — no benefits) or CLT (Brazilian payroll with benefits)
Similar Jobs
Architect, Modern Platforms – Cloud Infrastructure
Cloud Infrastructure Architect designing secure, scalable AWS, Azure, and GCP environments. Presidio delivers cloud, cybersecurity, AI, and managed technology solutions for enterprise clients.
Cloud & Platform Engineer
Rapid Solutions Pod Lead leading client engagements and engineering pods for AHEAD's cloud, platform engineering, and AI transformation solutions. Owning delivery, governance, recommendations, and offering development.
Online Visiting Professor – Cloud Computing
Online Cloud Computing Professor teaching practitioner-focused courses for DeVry University. Developing syllabi, delivering virtual instruction, assessing students, and integrating responsible AI technologies.
Senior Cloud Architect
Senior Cloud Architect modernizing secure, scalable cloud platforms for Guild Mortgage, a mortgage banking company. Leading Azure architecture, automation, DevSecOps, and enterprise platform engineering.
Cloud Engineer – Subject Matter Expert
Cloud Engineer SME architecting secure Azure data, analytics, and pipeline infrastructure. Supporting U.S. federal defense agencies and Army logistics within DoD IL5/IL6 environments.
Cloud Engineer – Principal
Principal Cloud Engineer designing and operating secure multi-tenant cloud platforms for GDIT’s U.S. government missions. Automating, migrating, and optimizing AWS, Azure, GCP, or OCI environments.
Azure Cloud Engineer
Azure Cloud Engineer managing scalable Azure infrastructure for Market Cloud’s IT consulting services. Deploying Kubernetes, automating infrastructure, and optimizing secure cloud-native solutions.
Cloud Architect – Networking
Cloud Architect leading secure Azure networking architecture and technical delivery for 3Cloud client engagements. Coaching infrastructure teams and unblocking complex cloud implementations.
Senior Salesforce Health Cloud Developer
Senior Salesforce Health Cloud Developer building and integrating government healthcare systems. Developing Apex, LWC, APIs, and CI/CD solutions in Salesforce Government Cloud.
Technical Engineer – Cloud Engineer
Cloud Engineer optimizing cloud platforms, enterprise architecture, and automation for Highmark Health’s national insurance and healthcare network. Supporting reliable technical solutions and next-generation technologies.
Cloud Engineer – Contract
Cloud Engineer building secure, scalable GCP infrastructure and data systems for 66degrees, an enterprise AI transformation partner. Automating deployments, CI/CD, monitoring, compliance, and disaster recovery for global clients.
Security Engineer, Cloud
Cloud Security Engineer securing Azure governance, identity, networking, monitoring, and compliance controls. Supporting landing zones, IaC guardrails, posture reviews, and cloud incident response for a U.S. organization.
Cloud Engineer – Windows, Linux Platform Automation
Cloud Engineer automating Windows, Linux, and SaaS platforms for a cloud operations team. Building runbooks and tooling across cloud systems and products.
Cloud Engineer – Windows, Linux Platform Automation
Cloud Engineer automating Windows, Linux, and public-cloud platforms for SaaS operations. Building runbooks, improving systems efficiency, and supporting large-scale infrastructure.
Strategic Cloud Engineer – GCP Platform, FinOps
Strategic Cloud Engineer optimising GCP costs and reliability for a regulated, multi-product SaaS platform. Operating Kubernetes, Terraform, observability, CI/CD, and AI-assisted infrastructure workflows.
Cloud Engineer – Windows, Linux Platform Automation
Cloud Engineer automating Windows, Linux, and public-cloud platforms for a SaaS operations team. Building runbooks and improving large-scale systems management across diverse products.
Software Engineer, Cloud EOS Team
Software Engineer developing CloudEOS control-plane, data-plane, and management services for Arista Networks’ cloud-enabled WAN networking products. Working with C/C++, Linux, DPDK, and public-cloud infrastructure.
Staff Cloud Security Engineer, Cloud Platform
Staff Cloud Security Engineer securing Calix’s AI-powered, cloud-first broadband platform. Building protected GCP infrastructure and CI/CD controls for communication service providers.
Staff AI Cloud Engineer
Staff AI Cloud Engineer building production AI, cloud, and full-stack systems for G-P’s global employment SaaS platform. Raising architecture, reliability, and engineering standards across teams.
Senior Software Engineer, Full Stack – React, Python, Azure
Senior full-stack engineer building AI-native computational design software for Upstart 13. Developing TypeScript/React and Python/Azure platform infrastructure for generative engineering products.