Data Engineer – AWS, Databricks
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Data Engineer focused on AWS and Databricks at Stefanini. Role involves building data pipelines and ensuring data governance using modern tools.
Responsibilities:
- Build and maintain data ingestion, transformation, and curation pipelines;
- Develop ELT/ETL pipelines using PySpark and SQL across Medallion layers;
- Implement data quality rules, monitoring, and remediation standards;
- Perform data profiling and source inventory for assessment and governance;
- Catalog datasets and apply data handling policies compliant with the LGPD (Brazilian Data Protection Law) using Unity Catalog;
- Work on API integration, multiple data sources, and orchestration processes.
Requirements:
- Strong experience as a Data Engineer;
- Databricks (Delta Lake);
- PySpark and SQL;
- Building ELT/ETL pipelines;
- Medallion architecture;
- Batch and streaming ingestion (Auto Loader, Kafka, and Structured Streaming);
- Dimensional modeling and Data Vault;
- dbt and/or Delta Live Tables (DLT);
- Data quality frameworks (Great Expectations, DLT Expectations);
- Observability and pipeline monitoring;
- Orchestration with Databricks Workflows and/or Apache Airflow;
- Integration with APIs and various data sources;
- Fluent English is essential for conversation.
Benefits:
- Meal or food allowance (meal voucher);
- Discounts on courses, universities, and language schools;
- Stefanini Academy — platform with free, up-to-date online courses with certificates;
- Mentoring;
- Benefits club for medical consultations and exams;
- Health insurance;
- Dental insurance;
- Perks and discounts at leading establishments;
- Travel club;
- Pet care plan/partnership.
Similar Jobs
Senior Data Engineer, AWS, Python, SQL
Senior Data Engineer at Devsu designing and maintaining AWS data platforms. Collaborating with software engineers and stakeholders on analytics, ecommerce, and logistics initiatives.
Cloud Computing Intern
Internship role in Cloud Computing at RealCloud with training for AWS certifications. Collaborate in a team and engage in projects related to Cloud technology.
Senior Cloud Engineer
CMS Senior Cloud Engineer monitoring Defender for Cloud alarms and dashboards. Triage high-impact recommendations and ensure cloud security compliance in Azure and AWS environments.
CMS Manager – Cloud Engineer
Cloud Security Manager investigating Defender for Cloud alerts and managing security for AWS and Azure environments. Leading remediation efforts and addressing systemic misconfigurations in cloud systems.
Cloud Engineer
Cloud Engineer responsible for delivering reliable and secure cloud operations across AWS and Azure. Building CI/CD pipelines and improving operational reliability using AI-driven tools.
Cloud Engineer
Cloud Engineer responsible for designing and implementing AWS cloud solutions for enterprise clients. Ensuring secure, scalable, and automated environments remotely in LATAM.
Azure Developer, 2X
Azure Developer supporting the migration of enterprise applications to Microsoft Azure, focusing on modernization and refactoring existing components with cloud-native architecture.
Lead Azure Data Engineer
Lead Azure Data Engineer at 3Pillar, focusing on building robust data platforms with Azure Data Stack. Engage in data engineering projects to enhance client analytics capabilities.
Senior Azure Network Engineer
Senior Azure Network Engineer with deep expertise in cloud networking, security, and hybrid connectivity. Leading initiatives to design and implement secure Azure environments and manage migrations.
Cloud Infrastructure Consultant – Terraform Expert
Cloud Infrastructure Consultant at Alpha FMC responsible for designing, deploying, and maintaining secure cloud environments. Client-facing role requiring Terraform expertise and strong technical independence.
Cloud Engineer III
Senior technical resource for IT Systems Cloud Engineering at Hanger, Inc. leading technology solution implementation with a focus on customer service and IT operations.
Cloud Engineer
Senior Cloud Engineer designing, implementing, and managing secure cloud infrastructure for diverse technology projects. Collaborating with teams to deliver AI-driven solutions at Accelerant.
FinOps Engineer, Cloud Financial Analyst
FinOps Engineer/Cloud Financial Analyst focused on AWS cost optimization initiatives across various cloud environments. Requires strong engineering background and cloud operations expertise.
Principal Cloud Architect
Principal Cloud Architect leading cloud strategy and transformation initiatives at Florida Blue. Establishing cloud governance and architecture to support enterprise scalability and resilience.
Senior .NET Cloud Engineer
Senior .NET Cloud Engineer responsible for building scalable applications on AWS. Working with Kubernetes and collaborating on cloud infrastructure projects.
Senior Cloud Engineer, AWS
Senior Cloud Engineer managing AWS infrastructure for Mindera's software engineering applications. Collaborating with an agile team to build resilient systems that impact users worldwide.
Cloud Architect
OpenStack Architect supporting Red Hat cloud technology solutions in Puteaux, France. Working at customer sites to design and implement reliable and scalable architecture solutions.
Cloud Engineer
Cloud Engineer participating in cloud infrastructure design and optimization for various platforms. Engaging with teams to deliver innovative cloud-based solutions in a supportive environment.
Azure Cloud Engineer
Azure Cloud Engineer developing innovative cloud solutions for healthcare. Managing Azure infrastructure, ensuring compliance, and providing real-time customer support.
Senior AWS Engineer
Senior AWS Engineer providing technical solutions for cloud implementations on AWS. Collaborating with clients and colleagues in an agile environment focused on continuous development.