Senior Data Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Data Engineer responsible for building robust data pipelines and aggregates for Zeta's AdTech platform. Collaborating with backend, ML, and product teams to deliver reliable data.
Responsibilities:
- Build data pipelines: Develop robust batch and streaming pipelines (Kafka/Kinesis) to ingest, transform, and enrich large-scale event data (impressions, clicks, conversions, costs, identity signals).
- Create data aggregates & marts: Design and maintain curated aggregates and dimensional models for multiple consumers—prediction models, agents, BI dashboards, and measurement workflows.
- Data modeling & contracts: Define schemas, data contracts, and versioning strategies to keep downstream systems stable as sources evolve.
- Data quality & reliability: Implement validation, anomaly detection, backfills, and reconciliation to ensure completeness, correctness, and timeliness (SLAs/SLOs).
- Performance & cost optimization: Optimize compute/storage for scale (partitioning, file sizing, incremental processing, indexing), balancing latency, throughput, and cost.
- Orchestration & automation: Build repeatable workflows with scheduling/orchestration (e.g., Airflow, Dagster, Step Functions) and CI/CD for data pipelines.
- Observability for data systems: Instrument pipelines with metrics, logs, lineage, and alerting to accelerate detection and root-cause analysis of data issues.
- Security & governance: Apply least-privilege access, PII-aware handling, and governance controls aligned with enterprise standards.
Requirements:
- 5+ years building production data pipelines and data products (batch and/or streaming) in a high-scale environment.
- Strong experience with SQL and data modeling (dimensional modeling, star/snowflake schemas, event modeling).
- Hands-on experience with streaming systems (Kafka preferred) and/or AWS Kinesis, including event-driven designs.
- Proficiency in one or more languages used for data engineering (Python, Java, Scala, or Go).
- Experience with distributed data processing (Spark, Flink, or equivalent) and performance tuning at scale.
- Experience with AWS data services and cloud-native patterns (S3, Glue/EMR, Athena, Redshift, etc. as applicable).
- Familiarity with lakehouse/table formats and large-scale storage patterns (e.g., Parquet; Iceberg/Hudi/Delta are a plus).
- Experience with orchestration/workflow tooling (Airflow/Dagster/Step Functions) and CI/CD for data workloads.
- Strong data quality/observability practices (tests, monitoring, lineage; understanding of SLAs/SLOs).
- Experience with SQL + NoSQL data stores (e.g., Postgres/MySQL; DynamoDB/Cassandra/Redis) and choosing the right store per use case.
- Clear communicator and collaborator; able to work with mixed audiences and translate needs into reliable data interfaces.
Benefits:
- Unlimited PTO
- Excellent medical, dental, and vision coverage
- Employee Equity
- Employee Discounts, Virtual Wellness Classes, and Pet Insurance And more!!
Similar Jobs
Senior Application Data Architect
Senior Application Data Architect leading enterprise data architecture and engineering initiatives. Collaborating with cross-functional teams to design and build scalable data solutions.
Unit Lead, Data Engineering
Lead the Data Engineering team at evoila, driving innovative data projects and developing advanced technological solutions in Germany. Collaborate on Greenfield projects and enhance existing platforms.
Data Engineer – AI Platform
Data Engineer responsible for building data ingestion pipelines for the AI platform at TaskUs. Engaging in scalable data management with strong experience in Python, SQL, and AWS.
Data Engineer II
Data Engineer II contributing to data governance engineering programs at CareSource. Focused on solution design architecture and implementation of standards for data management.
Data Architect
Consultant for Taxwell assisting Americans in finding tax credits and deductions. Advocating for customers and providing guidance in a supportive environment.
Account Executive – AI Data Platform Sales
Account Executive specializing in AI Data Platform Sales, managing enterprise client relationships. Focus on new customer acquisition and account growth driving analytics and AI initiatives.
Lead Data Engineer
Data Engineer Lead designing scalable data platforms for advanced analytics at Blend. Collaborating with cross-functional teams to build robust data solutions.
Data Architect – Strong Azure Services, Finance Experience (GL, AR, AP)
Data Architect specializing in financial systems (GL, AR, AP) and using Azure. Fully remote position requiring 12+ years of relevant experience.
Senior Data Architect – 2 months project
Seeking a Senior Data Architect for a two-month project focused on building a data warehouse in the car rental industry. Must have experience in data engineering and warehouse architecture.
BI Data Engineer
Lead Data Engineering initiatives in IT Analytics for transforming raw data into strategic assets. Collaborate with business areas to develop data solutions with a strong analytical vision.
Senior Data Engineer
Senior Data Engineer designing and maintaining scalable data pipelines for Pax8's cloud marketplace. Collaborating on architecture and mentoring data engineers while driving data quality and reliability.
Data Engineer IV
Data Engineer IV developing scalable data pipelines and orchestration frameworks at Rackspace Technology. Leading teams in data governance and managing analytics workloads across Azure and Databricks.
Information/Data Architect
Information/Data Architect providing technical expertise and support for data architecture requirements at Concept Plus. Developing data strategies and maintaining information structures for effective governance.
Staff Data Engineer, Financial Data Operations
Staff Data Engineer on a mission to drive financial data operations for Root's tech-focused insurance platform. Collaborating with engineering and finance to enhance data workflows for payments and incentives.
Senior Data Engineer, Marketing Operations
Senior Data Engineer driving marketing operations and strategy at Root. Collaborating with multiple teams to enhance data infrastructure and analytics capabilities.
Data Engineer I
Data Engineer I supporting data platform development at EverCommerce. Collaborating with senior engineers and analytics teams to deliver reliable, high-quality data.
Technical Lead – Data Engineering, Analytics
Technical Lead delivering enterprise data engineering and analytics solutions for Department of Veterans Affairs. Lead teams to architect systems that strengthen mission operations for Veterans.
Senior Data Engineer
Senior Data Engineer designing and maintaining scalable data infrastructure for enterprise reporting, financial reconciliation, and operational analytics at Vetcor.
Data Migration and Onboarding Specialist
Data Migration and Onboarding Specialist at Alt Legal focused on client data migration and onboarding process. Collaborating internally and externally to ensure customer satisfaction and accurate data management.
Data Engineer – Cloud, BI Architecture
Data Engineer at First Table creating a cloud warehouse from scratch and managing data flow. Leading technical architecture for marketing and product functions to enhance data-driven decision making.