Lead Data Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Lead Data Engineer at Egen focusing on building and optimizing cloud-native data platforms on Google Cloud. Mentoring engineers and designing sustainable data architectures with a data-first mindset.
Responsibilities:
- Architect and optimize large-scale data platforms on Google Cloud, with BigQuery as the analytical backbone
- Design and build unified batch and streaming pipelines that handle high-volume, mission-critical workloads
- Lead infrastructure-as-code practices, ensuring environments are repeatable, secure, and version-controlled
- Implement open table formats to enable cross-cloud and cross-engine data interoperability
- Establish automated data quality, metadata, and lineage practices across the data estate
- Partner with data scientists, analysts, and product teams to translate business needs into reliable data products
- Mentor engineers, review designs, and raise the bar on engineering standards
Requirements:
- 7+ years in data engineering, with at least 2 years in a lead or senior individual contributor capacity on Google Cloud-based platforms
- **BigQuery (Advanced):** Deep knowledge of BigQuery architecture, including partitioning, clustering, slot management, storage optimization, and query execution tuning
- **Streaming & Batch Pipelines:** Strong hands-on experience building unified pipelines using **Dataflow** (Apache Beam), **Dataproc**, and **Pub/Sub**
- **Infrastructure as Code:** Production experience developing and managing cloud infrastructure with **Terraform**
- **Open Table Formats:** Working knowledge of **Apache Iceberg**, including its role in enabling cloud and engine interoperability (e.g., across BigQuery, Spark, Snowflake)
- **Data Governance:** Experience with **Dataplex** and **Data Catalog** for automated data quality checks, metadata tagging, and column-level lineage from source to destination
Benefits:
- Comprehensive Health Insurance
- Paid Leave (Vacation/PTO)
- Paid Holidays
- Sick Leave
- Parental Leave
- Bereavement Leave
- 401 (k) Employer Match
- Employee Referral Bonuses
Similar Jobs
Senior Data Engineer
Senior Data Engineer at DTN responsible for designing and implementing data solutions with cloud architecture. Mentoring teams and ensuring data governance in a dynamic environment.
Data Engineer
Data Engineer responsible for building data pipelines and configuring customer instances for B2B sales intelligence. Collaborating with Customer Success to deliver data solutions.
Data Engineer Manager
Lead Data Engineering Manager at Blend, focused on designing scalable solutions for Journey Analytics. Overseeing data platforms and leading a team of engineers to deliver high-quality datasets.
Data Engineer Manager
Data Engineer Manager leading a team for Journey Analytics initiatives at Blend, an AI services provider. Focus on scalable data solutions and data engineering best practices.
Data Migration Analyst
Data Migration Analyst at NikoHealth overseeing transitions from legacy platforms into SaaS solutions. Ensure data accuracy and provide customer support during the migration process.
Senior Data Engineer – Databricks, AWS
Senior Databricks Data Engineer specializing in AWS cloud-native data solutions. Supporting federal client data platform modernization initiatives with expertise in data pipelines and governance.
Freelance Data Engineer
Data Engineer at Incubeta responsible for designing, building, and maintaining data processing systems to ensure data integrity and optimize pipelines. Mentors junior members and delivers data solutions effectively.
Senior Data Engineer
Senior Data Engineer delivering modern data solutions at Carrier, focused on data pipelines and lakehouse architectures. Collaborating with cross-functional teams to support analytics and reporting.
Lead Product Manager, Data Platform
Lead Product Manager at Alkami driving the data platform strategy for the fintech sector. Collaborate cross-functionally to enhance data products in a remote-first environment.
Data Warehouse Developer
Data Warehouse Developer assisting in the analytics solutions for the University of Wisconsin-Platteville. Collaborating in the design, build, testing, and deployment of data warehousing.
Senior Data Engineer
Senior Data Engineer building resilient data pipelines for Verantos's high-accuracy RWE generation platform. Leading data architecture and collaborating with cross-functional teams in a remote US-based role.
Senior Data Engineer
Senior Data Engineer designing and building streaming pipelines for Simple Life, an AI-powered health coaching app. Collaborate on ingesting and processing data to enhance user experience.
Senior Data Engineer – AI
Senior Data Engineer at Anaplan building AI capabilities and solutions for business decision-making. Working across the full stack of Anaplan AI applications and developing innovative features.
Associate Data Engineer – Artificial Intelligence, AI
Data Engineer at Cotiviti managing data processes and implementations for operational excellence. Involves data analysis, pipeline creation, and troubleshooting in collaboration with Engineering teams.
Data Engineer – AI, Agents, Context – Revenue Cycle (Associate)
Data Engineer developing and maintaining AI/context data capabilities for healthcare innovation. Building data pipelines and collaborating to enhance operational efficiency and clinical outcomes.
Data Engineer – AI, Agents, Context, Clinical – Senior Associate
Data Engineer contributing to healthcare AI context platform at Huron. Implementing data products and ensuring operational excellence in a remote role.
Data Operations Engineer
Data Operations Engineer Associate managing Power BI datasets for healthcare organizations. Designing data models and ensuring data quality to optimize analytics and reporting processes.
Senior Data Engineer, AI & Context Platform, Healthcare Insights, Rev Cycle
Senior Data Engineer focused on AI context platform for healthcare insights. Leading technical delivery in building scalable data capabilities leveraging unstructured data.
Data Architect – Data Governance
Data Architect at Smarthis, focusing on defining efficient data architectures and supporting engineering teams in implementations. Collaborating on data solutions across cloud environments.
Data Engineer, L3
Data Engineer (L3) designing scalable data architecture and robust data pipelines for social marketing. Collaborate in a fintech initiative providing insights on personal finance and growth marketing.