Senior Data Engineer – Airflow, AWS
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Data Engineer skilled in Apache Airflow, Python, and AWS at Stefanini. Focused on developing scalable and efficient data pipelines for strategic data platform transformation projects.
Responsibilities:
- Develop, maintain, and evolve data pipelines using Apache Airflow (MWAA);
- Build data ingestion, transformation, and provisioning processes (ETL/ELT);
- Develop solutions using Python, Spark, and AWS services;
- Implement and support data architectures in Data Lake, Lakehouse, and Data Warehouse environments;
- Perform data modeling to meet analytical and business needs;
- Ensure data quality, governance, and observability of processed data;
- Monitor and optimize the performance of data pipelines and processes;
- Collaborate with business, analytics, and technology teams to evolve the data platform;
- Support the definition of best practices, standards, and continuous improvements across the data ecosystem.
Requirements:
- Strong experience with Apache Airflow (MWAA) for orchestrating data pipelines;
- Python development experience for building and maintaining ETL/ELT processes;
- Advanced knowledge of SQL Server;
- Experience with Apache Spark for large-scale data processing;
- Experience with AWS services, particularly Redshift, S3, Glue, and MWAA;
- Knowledge of data modeling for analytical environments;
- Experience with Data Warehouse, Data Lake, and Lakehouse architectures;
- Familiarity with Medallion architecture (Bronze, Silver, Gold);
- Experience with data governance, quality, and observability;
- Experience in developing, optimizing, and monitoring data pipelines.
Benefits:
- Meal allowance or meal voucher;
- Discounts on courses, universities, and language schools;
- Stefanini Academy — platform with free, up-to-date online courses and certificates;
- Mentoring;
- Benefits club for consultations and exams;
- Health insurance;
- Dental insurance;
- Discount and perks club at top retailers and establishments;
- Travel club;
- Pet care benefits.
Similar Jobs
Forward Deployed Engineer
Forward Deployed Engineer for ModSquad, designing, building, and deploying complex AI systems for high-stakes environments. Involves collaborative engagements with clients and deep system integration challenges.
Engineer – Identity Solutions
Engineer at DGR Systems focusing on Identity and Access Management solutions. Delivering projects to enhance security and operational efficiency in customer environments.
Ingeniero/a ILS Naval – Aprovisionamiento
Ingeniero/a ILS Naval ensuring availability of spare parts for military ships. Working in a multinational consulting firm specialized in engineering services.
Ingeniero/a ILS Naval – Control de Configuración
Engineer joining multinational consultancy ATEXIS, specialized in naval defense configuration control. Responsible for logistics configuration integrity of military vessels throughout their lifecycle.
Ingeniero ILS Naval, Mantenimiento
Ingeniero/a ILS Naval responsible for maintenance strategies of military vessels. Join ATEXIS, an engineering consultancy specializing in aerospace, defense, and maritime services.
Power Systems Advisory Engineer
Power Systems Advisory Engineer supporting smart grid technology for electric cooperatives. Leading engineering insights and project execution in a collaborative environment.
Senior Electrical Commissioning Engineer
Senior Electrical Commissioning Engineer for data center projects at JLL. Responsible for commissioning, QA/QC processes, and team management.
Process Safety Engineer
Process Safety Engineer developing and implementing process safety programs for safe manufacturing at Solenis. Providing technical leadership in hazard analysis, risk management, and compliance auditing.
Distinguished Engineer
Distinguished Engineer at Home Depot shaping technology strategies and mentoring engineering talent. Focus on Marketing Tech, AI strategies, and enterprise architecture.
FPGA, Market Development Engineer
Market Development Engineer driving FPGA market share growth in EMEA. Collaborating with sales teams and customers to support innovative electronic component solutions.
MBSE Engineer
MBSE Engineer performing system analysis and modeling for General Dynamics in remote settings. Requires US citizenship, 5+ years experience, and strong UML skills.
Oracle Identity & Access Management Engineer
Oracle Identity & Access Management Engineer managing the CMS Healthcare Integrated General Ledger Accounting System. Focusing on Oracle Identity Management application maintenance and security controls.
Senior Engineer, Microsoft
Senior Microsoft Engineer driving our hybrid cloud architecture at Redesign Group. Bridging highly available on-premises infrastructure with cloud using Azure Arc and Hyper-V.
Ingeniero/a Data, IA
Data & AI Engineer developing AI models for industrial optimization. Collaborate in data analysis and monitoring systems for automation projects.
Senior POS Engineer
Lead Software Engineer responsible for point of sale and retail technology platform design and development at Kitestring. Focused on modern software development and technical leadership with a diverse team.
MuleSoft Engineer
MuleSoft Engineer supporting New York State Government client. Focused on leveraging the MuleSoft ecosystem for automated integration architecture.
Senior CV Engineer
Senior CV Engineer training and fine-tuning generative models for Social Discovery Group's worldwide projects. Collaborating with global teams on cutting-edge computer vision research and model optimization.
Forward Deployed Engineer
Forward Deployed Engineer responsible for customer technical support and integration for Praetorian's security platform. Engaging with clients and resolving issues effectively to enhance product reliance.
Forward Deployed Engineer
Technical support specialist for strategic customer accounts at Dropzone AI. Collaborating with teams to enhance cybersecurity operations and customer trust.
Model Based Controls Engineer – Motors
Model Based Design Engineer developing electric motors using MATLAB/Simulink at a leading tools company. Collaborating with teams globally to drive technology innovations.