Mid-Level Data Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Engenheiro de Dados desenvolvendo pipelines batch e streaming na Spread Tecnologia. Otimizando data lakes, ETL/ELT e governança em ambientes GCP e AWS.
Responsibilities:
- Design and implement efficient batch and streaming data pipelines, integrating different sources and formats
- Maintain and optimize databases and data lakes, ensuring security and performance
- Develop data ingestion, transformation, and delivery processes (ETL/ELT)
- Ensure data quality, integrity, and consistency throughout the data lifecycle
- Collaborate with data science, analytics, and software development teams
- Monitor and automate data workflows, proposing continuous improvements to the architecture
- Implement best practices for version control, documentation, and data governance
- Contribute to the advancement of a data-driven culture within innovation teams
Requirements:
- Experience working as a Data Engineer
- Proficiency in data-oriented programming languages (Python, SQL, Scala, or equivalent)
- Experience with data processing tools and frameworks (Airflow, Spark, Kafka, dbt, Pub/Sub, Kinesis, Cloud Functions, Lambda Functions, etc.)
- Knowledge of relational and non-relational databases (PostgreSQL, MongoDB, BigQuery, Redshift, etc.)
- Knowledge of MLOps (Vertex AI, Amazon SageMaker/Bedrock)
- Experience with cloud environments (GCP and AWS) and managed data services
- Best practices in version control (Git) and continuous integration
- Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field
- Knowledge of data modeling for AI, Machine Learning, and/or Deep Learning (preferred)
- Familiarity with data governance and cataloging tools, such as Data Catalog (preferred)
- Experience with infrastructure as code (Terraform, CloudFormation) (preferred)
- Certifications in cloud data engineering or architecture (Google Professional Data Engineer or AWS Data Engineer) (preferred)
Benefits:
- 100% remote work, depending on the contract model
- Accessibility and inclusion: this position is also open to persons with disabilities
Similar Jobs
Data Engineer II
Data Engineer II building ETL pipelines, data models, and scalable platforms for Ncontracts’ financial risk and compliance solutions. Supporting analytics, reporting, performance, and team mentorship.
Data Engineer – Health Data Metrics
Data Engineer building AWS data pipelines and healthcare quality metrics infrastructure for Keebler Health’s value-based care platform. Integrating FHIR, population health, and HIPAA-compliant data systems.
Senior Data Engineer
Engenheiro de Dados Sênior construindo pipelines Big Data para a Reply, multinacional de consultoria e soluções de TI. Processamento distribuído em AWS e colaboração com equipes de análise e ciência de dados.
Data Architect
Data Architect designing and building Databricks and Microsoft Fabric lakehouse platforms for Pythian’s data transformation clients. Owning ingestion, governance, modeling, pipelines, and analytics delivery.
Senior Data Engineer, Reporting – Python, SQL, AWS
Senior Data Engineer building Python, SQL, AWS, and Redshift pipelines for Nortal’s global merchant reporting. Developing financial reporting services and a self-service Reporting API.
Software Engineer, Data Layer
Software Engineer building Coinbase’s GraphQL data layer for Consumer, Base, and Institutional products. Improving high-scale API reliability, performance, and developer experience.
Data Engineer
Data Engineer building scalable cloud data pipelines for People10’s digital transformation solutions. Integrating databases, APIs, SaaS applications, and analytics platforms.
Senior Data Engineer
Senior Data Engineer modernizing scalable data pipelines for a cybersecurity solution protecting applications from automated attacks. Optimizing SQL, DBT, Snowflake, and Elastic workflows.
Senior Data Engineer – Tieto Tech Consulting
Senior Data Engineer building scalable cloud data platforms and pipelines for Tieto Tech Consulting, a digital accelerator for software engineering and business design. Advising customers and delivering reliable data-driven solutions.
Senior Data Engineer – Tieto Tech Consulting
Senior Data Engineer building scalable cloud data platforms and pipelines for Tieto Tech Consulting, a digital accelerator combining business design with software engineering. Advising customers and delivering data-driven solutions.
Software Engineer, Data Team
Software Engineer shaping Confluence’s Python data platform for investment data. Building unified APIs, migrating SQL Server logic, and integrating modern data sources.
Data Engineer
Data Engineer criando soluções de dados em nuvem para empresa brasileira de tecnologia e inovação. Gerenciando Databricks, AWS/Azure, data lakes, data warehouses e pipelines ETL/ELT.
Data Engineer – International Client
Data Engineer building scalable Databricks data products for The White Team’s technology consulting clients. Developing dbt, SQL, Jinja pipelines and modern data architecture remotely across the EU.
Senior Big Data Engineer – AdTech Cybersecurity
Senior Big Data Engineer optimizing Snowflake, SQL, and Java services for a cybersecurity AdTech platform. Improving real-time fraud-risk assessment scalability, performance, and cost efficiency.
Data Platform Engineer
Data Platform Engineer building PostgreSQL-to-Azure CDC pipelines for Software Mind’s global technology clients. Operating Kafka, Debezium and Kubernetes data infrastructure in production.
Data Platform Engineer
Data Platform Engineer building secure, observable infrastructure for B2Spin’s social casino and gaming products. Managing IaC, IAM, CI/CD, monitoring, cost governance, and disaster recovery.
Data Engineer – UniData, UniVerse
UniData/UniVerse Data Engineer building commission and incentive-processing systems for direct-selling and MLM businesses. Optimizing hierarchies, payouts, integrations, and high-volume transactional data.
Senior Data Engineer
Senior Data Engineer building trusted Snowflake data products for Granum’s landscaper and arborist software ecosystem. Operating governed pipelines that power analytics, AI, and operational decisions.
Ingeniero de Datos – Spark, Kafka, AWS
Ingeniero de Datos diseñando pipelines batch y streaming con Spark, Kafka y AWS. Optimización de datos a gran escala para una multinacional de consultoría IT.
Senior Data Engineer – Microsoft Fabric
Data Engineer building Microsoft Fabric pipelines, Lakehouses, and curated datasets. Supporting analytics, reporting, and AI use cases for Expleo, a global engineering and consulting provider.