Senior Data Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Data Engineer building cloud data platforms for Valtech, an experience innovation company. Enabling analytics, AI, GenAI, and data products through scalable pipelines and governance.
Responsibilities:
- Design, build, and optimize modern cloud-based data platforms powering analytics, AI, and data products
- Develop reliable batch, streaming, and near-real-time pipelines using technologies such as Spark and Delta Lake
- Build ingestion, transformation, and curation workflows for structured and unstructured data
- Implement lakehouse architectures and medallion layering within Databricks or Fabric
- Deliver curated datasets for analytics, machine learning, causal modeling, and optimization systems
- Enable GenAI pipelines, including LLM, RAG, vector-based, and agent-based data flows
- Design scalable logical and physical data models
- Orchestrate workflows using Airflow, dbt, Databricks Workflows, Azure Data Factory, or equivalents
- Apply data governance, lineage, quality, access control, and security best practices
- Establish observability for data freshness, pipeline reliability, and SLA adherence
- Enable data-serving layers such as APIs, feature inputs, and analytical endpoints
- Monitor and optimize pipelines and infrastructure for performance, scalability, and cost efficiency
- Discover, derive, and refine business requirements with stakeholders
- Collaborate with data scientists, ML engineers, analysts, platform teams, and business stakeholders
- Support adoption of data products and contribute to data and AI ecosystem best practices
Requirements:
- Experienced Senior Data Engineer
- Strong hands-on experience with Apache Spark and Delta Lake
- Strong programming skills in Python and SQL
- Proven experience building batch and streaming data pipelines
- Experience building production-grade data platforms
- Solid understanding of data modeling, data quality, and governance principles
- Strong, demonstrable hands-on experience with AWS data services and the Databricks Lakehouse Platform, or Microsoft Azure/Fabric services and tooling
- Deep expertise in at least one of the AWS or Azure/Fabric platform tracks
- Experience with lakehouse architectures and distributed data systems
- Strong understanding of scalability, reliability, and performance considerations in data pipelines
- Strong problem-solving skills and collaborative approach to cross-functional work
- Familiarity with Snowflake or GCP is a plus but not required
- Experience in Agile or consulting environments is beneficial
- Experience with both AWS and Azure/Fabric, GenAI and AI data systems, CI/CD for data pipelines, Terraform or CloudFormation, Kafka, Spark optimization, advanced analytics, ML workloads, data products, or large-scale analytics platforms is nice to have
- No educational credential is specified
Benefits:
- Private health insurance
- Education program with training and certification
- Wellbeing program
- Free coffee, drinks, and snacks at work
- Company dinners
- Company events, including ski trips, karting, laser-tag, wine tasting, picnics, and cooking classes
- Competitive salary
- 24 days of vacation
- Annual company events with the whole team
- Challenging projects
- Inclusive culture and support for growth
- Open feedback culture
- Reasonable accommodations during the interview process
Similar Jobs
Senior Data Engineer
Senior Data Engineer building OCR and ingestion pipelines for an AI consultancy serving insurers. Converting unstructured insurance documents into structured data for RAG and anti-financial-crime models.
Senior Data Engineer
Senior Data Engineer building cloud data platforms for Valtech, an experience innovation company transforming brands through data, AI, creativity, and technology. Enabling analytics, GenAI, and production-grade data products.
Senior Data Engineer
Senior Data Engineer building cloud data platforms for Valtech, an experience innovation company transforming brands through data, AI, creativity, and technology. Enabling analytics, ML, GenAI, and production-grade data products.
Senior Software Engineer, Data Platform
Senior Software Engineer building distributed data infrastructure for Human Interest’s retirement fintech platform. Owning pipelines, AWS compute, security, and AI-ready architecture.
Senior Data Engineer
Senior Data Engineer building secure Databricks data products for Oportun, a mission-driven financial services company. Leading pipelines, governance, integrations, and member communications infrastructure.
AI Data Engineer
AI Data Engineer improving internal annotation tools, dashboards, and workflows. Supporting RWS’s AI data collection, labeling, and validation services with Python and Azure.
Senior Data Architect
Senior Data Architect leading scalable data architecture, pipelines, and governance for CI&T’s enterprise EdTech transformation engagement. Hands-on technical leadership with US client stakeholders.
Data Platform Engineer – Mid-level
Data Platform Engineer building self-serve CI/CD, IaC, and governance tooling for ShippyPro’s global shipping platform. Owning deployment paths, pipeline modules, and data access workflows.
Senior AI / ML / Data Engineer
Senior AI/ML/Data Engineer developing ML, NLP, LLM, and RAG solutions for QAVION GROUP’s integrated consulting and technology business. Building scalable data pipelines and GenAI services.
Senior Data Engineer
Engenheiro de Dados Sênior remoto desenvolvendo pipelines e arquitetura lakehouse para a Monte Bravo. Construção de plataforma financeira inovadora com Python, PySpark, AWS e DBT.
Data Engineer
Data Engineer building secure Snowflake data architecture and pipelines for Blood Cancer United. Enabling enterprise analytics and business intelligence to improve blood cancer patient outcomes.
Senior - Principal Data Engineer
Senior Data Engineer shaping scalable Databricks data platforms for RevoData, a European Data & AI consultancy. Leading architecture, pipelines, cloud solutions and client-facing technical decisions.
Senior / Principal Data Engineer
Senior/Principal Data Engineer building scalable Databricks data platforms for RevoData, a boutique Data & AI consultancy. Shaping architecture, pipelines and client solutions across Europe.
Software Engineer, Data
Software Engineer building Python-based cloud data systems for Kunai’s banking and fintech clients. Designing scalable pipelines, real-time streams, and data platforms using AWS, Snowflake, and Databricks.
Founding Engineer – Data Platform
Founding Engineer building a lakehouse and FHIR data platform for a healthcare AI scale-up. Processing millions of clinical events and integrating hospital systems across Latin America.
Academic Content Developer – Financial Data Engineering, Credit Systems
Academic content developer creating fintech engineering curriculum for Jala University. Designing modules, labs, reference implementations, evaluation harnesses, and instructor guides.
Lead Geospatial Data Engineer
Lead geospatial data engineer guiding cloud-based geospatial, imagery, and enterprise data solutions at Logic20/20. Leading architecture, delivery, code quality, and engineering teams.
Lead Data Engineer – PySpark, Palantir Foundry
Lead Data Engineer building governed PySpark and Palantir Foundry pipelines for Logic20/20’s AI and analytics consulting practice. Improving releases, data infrastructure, and audit readiness for client projects.
Senior Manager, Data Engineering – Medicare Revenue
Senior Manager owning CVS Health’s Medicare revenue data engineering foundation. Building auditable healthcare data pipelines for revenue forecasting, risk adjustment, Finance, and Actuarial teams.
Senior Data Engineer
Senior Staff Data Engineer leading Capital One’s enterprise data pipelines and cloud architecture. Driving scalable data platforms, governance, and innovation across banking technology.