Senior Data Engineer – Azure Cloud
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Engenheiro de Dados SR atuando na construção e sustentação de pipelines de dados em Azure. Contribuindo para soluções escaláveis e eficientes em projetos de Data & AI.
Responsibilities:
- Develop, maintain and optimize scalable data pipelines
- Work with distributed processing using Apache Spark
- Orchestrate workflows and data routines with Apache Airflow
- Develop solutions in Python following engineering best practices
- Operate in cloud environments, especially Microsoft Azure
- Create and maintain deployment pipelines using CI/CD practices
- Work with configuration and automation files in YAML/YML
- Use Docker for containerization of applications and services
- Develop, test and document data transformation models with dbt
- Collaborate with engineering, analytics and business teams to ensure solution quality, reliability and performance
- Support technical decisions related to architecture, performance, observability and data governance
Requirements:
- Advanced English is a mandatory requirement
- Experience with Azure and data-related services
- Solid knowledge of Python
- Experience with Apache Spark
- Experience with Apache Airflow
- Experience with CI/CD practices
- Experience with development and configuration using YAML/YML
- Knowledge of Docker
- Experience with dbt for data transformation and modeling
- Familiarity with code versioning, testing, documentation and development best practices
- Experience in consulting projects (a plus)
- Knowledge of lakehouse architecture, data lake or data warehouse (a plus)
- Experience with Databricks, Azure Data Factory, Synapse or Fabric (a plus)
- Knowledge of observability, monitoring and data quality (a plus)
- Experience with critical production environments and high-volume pipelines (a plus)
Benefits:
- Position also open to candidates with disabilities
Similar Jobs
Cloud Security Engineer
Cloud Security Engineer improving cloud security across Oracle, AWS, GCP, and Azure environments. Engaging clients by implementing security controls and compliance initiatives.
Senior Data Engineer – Databricks, Azure Data Platform
Senior Data Engineer responsible for building and maintaining a scalable data platform on Databricks. Supporting key processes in the insurance and reinsurance environment with multiple data sources integration.
Consultant – Cloud Infrastructure Services
Consultant for Cloud Infrastructure Services at Red Hat delivering customer cloud projects and improving customer experiences. Engaging in design, implementation, and support of Red Hat cloud solutions.
Senior SAP Business One Consultant – Cloud Migration, Future Architecture
SAP Business One Consultant at Cloudiax focusing on cloud migration from SQL Server to SAP HANA. Collaborating with partners and clients to ensure their migration strategies succeed.
Senior Cloud Platform Engineer – Tech Cloud Development
Senior Python Cloud Platform & Full-Stack Engineer at EY building scalable cloud-native solutions and automation frameworks. Focus on improving operational efficiency through engineering tools and dashboards.
Principal Cloud Architect
Principal Cloud Architect leading multi-cloud infrastructure design and optimization at Banner Health. Collaborating with cross-functional teams to ensure scalability, security, and innovation across cloud systems.
Back-End Python Engineer, AWS – Desktop
Back-End Python Engineer designing scalable RESTful APIs and microservices at Miratech. Focused on cloud technologies and backend development in a global IT services context.
Back-End Python Engineer – AWS
Back-End Python Engineer developing scalable AWS applications for Miratech. Collaborating across teams to design and maintain secure backend systems using cloud technologies and Python.
Lead Java Developer – Azure
Lead Java Developer for Satalia creating enterprise quality optimisation and ML solutions. Collaborate with data science teams, ensuring robust and high-quality cloud solutions for customers.
Data Engineer, Snowflake, dbt, Azure
Data Engineer developing data pipelines and transformations using Snowflake and Azure Data Factory. Working remotely with an expert team in Data & AI at Logicalis Spain.
Cloud Architect
Cloud Architect at Techmahindra responsible for designing scalable enterprise solutions. Collaborating cross-functionally and ensuring architecture alignment with standards and practices.
Cloud Security Engineer
Join Periferia IT Group as a Cloud Security Engineer managing security for applications and microservices. Work fully remote with opportunities for professional growth in a tech-driven environment.
Cloud Network Engineer – III
Cloud Network Engineer III supporting multi-cloud infrastructure as part of a healthcare technology team. Responsible for documentation, development, and maintenance of cloud implementations.
Cloud Support Engineer
Cloud Support Engineer at Net at Work providing advanced remote technical support across multiple client environments. Focusing on swift service restoration and detailed documentation of technical issues.
Senior Tech Cloud Developer – ITSM, Service Integration Management
Senior Manager at EY responsible for ITIL/ITSM implementation and service management solutions. Leading strategic plans, project delivery, and service model framework creation with corporate stakeholders.
Software Engineer – API, Microservices, AWS
API/Microservices/AWS Software Engineer at CSAA Insurance Group designing scalable cloud-based microservices using modern tech. Collaborating in an Agile environment to deliver high-performing APIs and services.
Cloud Data Architect
Cloud Data Architect designing cloud-native data platforms for business insights at Data Ideology. Leading modernization efforts and supporting enterprise data systems with scalable solutions.
Azure Engineer
Azure Engineer designing, implementing, and managing cloud solutions for enterprise clients. Collaborating with cross-functional teams and ensuring optimal performance and security in Azure.
Cloud Ops Engineer
CloudOps Engineer managing AWS cloud infrastructure for Bloom Growth's platform. Automating operations, enhancing system reliability, and supporting production environments for optimal customer experience.
Senior Azure Cloud Engineer
Senior Azure Cloud Engineer designing, automating, and operating secure Azure cloud platforms at Applaudo. Collaborating across teams to implement cloud best practices and improve platform reliability.