Senior Data Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Engenheiro de Dados Sênior remoto desenvolvendo pipelines e arquitetura lakehouse para a Monte Bravo. Construção de plataforma financeira inovadora com Python, PySpark, AWS e DBT.
Responsibilities:
- Develop applications and data pipelines with Python
- Process large volumes of data in a distributed environment using PySpark
- Build and govern data transformations using dbt
- Orchestrate pipelines with Airflow
- Use GitHub for version control, pull requests, code reviews, and CI/CD integration
- Work with AWS services, including Lambda, CloudWatch, S3, Redshift, and Aurora
- Implement and work with Apache Iceberg
- Apply Data Lakehouse and Medallion Architecture patterns
- Execute ETL/ELT processes
- Contribute to building an innovative financial platform from the ground up, with no technical legacy
Requirements:
- Strong experience with Python, developing applications and data pipelines with a focus on performance, maintainability, and best practices
- Experience with PySpark for distributed processing of large volumes of data
- Advanced SQL proficiency
- Experience with dbt for building and governing data transformations
- Knowledge of Airflow for pipeline orchestration
- Strong experience with GitHub, including version control, pull requests, code reviews, and CI/CD pipeline integration
- Knowledge of AWS, especially Lambda, CloudWatch, S3, Redshift, and Aurora
- Experience with Apache Iceberg
- Knowledge of Data Lakehouse architecture and Medallion Architecture
- Experience with ETL/ELT processes
- Nice to have: experience with Databricks
- Nice to have: knowledge of Kafka, particularly in building producers and event-driven messaging systems
Benefits:
- End-to-end professional growth opportunities
- Healthy work environments
- Real-world, high-impact projects
- An environment that fosters innovation, technical ownership, and autonomy
- The opportunity to build a platform from the ground up, with no technical legacy
- Use of best-in-class tools, best practices, and innovative ideas
Similar Jobs
Data Platform Engineer – Mid-level
Data Platform Engineer building self-serve CI/CD, IaC, and governance tooling for ShippyPro’s global shipping platform. Owning deployment paths, pipeline modules, and data access workflows.
Senior AI / ML / Data Engineer
Senior AI/ML/Data Engineer developing ML, NLP, LLM, and RAG solutions for QAVION GROUP’s integrated consulting and technology business. Building scalable data pipelines and GenAI services.
Data Engineer
Data Engineer building secure Snowflake data architecture and pipelines for Blood Cancer United. Enabling enterprise analytics and business intelligence to improve blood cancer patient outcomes.
Senior - Principal Data Engineer
Senior Data Engineer shaping scalable Databricks data platforms for RevoData, a European Data & AI consultancy. Leading architecture, pipelines, cloud solutions and client-facing technical decisions.
Senior / Principal Data Engineer
Senior/Principal Data Engineer building scalable Databricks data platforms for RevoData, a boutique Data & AI consultancy. Shaping architecture, pipelines and client solutions across Europe.
Software Engineer, Data
Software Engineer building Python-based cloud data systems for Kunai’s banking and fintech clients. Designing scalable pipelines, real-time streams, and data platforms using AWS, Snowflake, and Databricks.
Founding Engineer – Data Platform
Founding Engineer building a lakehouse and FHIR data platform for a healthcare AI scale-up. Processing millions of clinical events and integrating hospital systems across Latin America.
Academic Content Developer – Financial Data Engineering, Credit Systems
Academic content developer creating fintech engineering curriculum for Jala University. Designing modules, labs, reference implementations, evaluation harnesses, and instructor guides.
Lead Geospatial Data Engineer
Lead geospatial data engineer guiding cloud-based geospatial, imagery, and enterprise data solutions at Logic20/20. Leading architecture, delivery, code quality, and engineering teams.
Lead Data Engineer – PySpark, Palantir Foundry
Lead Data Engineer building governed PySpark and Palantir Foundry pipelines for Logic20/20’s AI and analytics consulting practice. Improving releases, data infrastructure, and audit readiness for client projects.
Senior Manager, Data Engineering – Medicare Revenue
Senior Manager owning CVS Health’s Medicare revenue data engineering foundation. Building auditable healthcare data pipelines for revenue forecasting, risk adjustment, Finance, and Actuarial teams.
Senior Data Engineer
Senior Staff Data Engineer leading Capital One’s enterprise data pipelines and cloud architecture. Driving scalable data platforms, governance, and innovation across banking technology.
Data Engineer III
Data Engineer III building AWS data lakes, pipelines, and analytics systems for Republic Services’ environmental services business. Developing MarkLogic APIs, Snowflake warehouses, and streaming ingestion architectures.
Senior Data Platform Engineer – Snowflake
Senior Data Platform Engineer bei JobRad Loop, Aufbau einer Snowflake-Datenplattform und neuer BI-Landschaft. Integration von JobRad-Leasingdaten, stabilen Pipelines und fachlicher Teamführung.
Data Engineer – Mid-Level
Mid-level Data Engineer building AI/ML data systems for Ignite Digital’s national security and Navy IT clients. Designing pipelines, models, dashboards, and integrations using Python, SQL, and QLIK Advana.
Senior Data Platform Engineer
Senior Data Platform Engineer building DEFCON AI’s durable, explainable data platform for resilient optimization. Preserving provenance, uncertainty, source disagreements, and point-in-time entity histories.
Senior Data Engineer
Senior Data Engineer designing banking data pipelines across AWS, Oracle, Airflow, dbt, and SAP. Modernizing legacy systems through Data Mesh and Medallion architectures.
Senior Data Engineer
Senior Data Engineer building BigQuery and Dataform pipelines for Avenga, an AI-focused international engineering firm. Migrating ETL workflows and modernizing analytics across cloud and on-premises systems.
Senior Data Engineer – Clinical Platforms, Databricks
Senior Data Engineer building Databricks-based clinical trial platforms at Muttdata. Designing compliant lakehouse pipelines and integrations for regulated clinical data.
Senior Big Data Architect
Senior Big Data Architect designing Cloudera, Kafka, and AWS data platforms for banking clients. Leading enterprise-scale streaming, integration, governance, and architecture standards.