Lead Data Engineer
Posted 3hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Data Engineer building GCP data pipelines for Egen’s healthcare data innovation. Driving machine learning initiatives and data solutions that improve patient outcomes.
Responsibilities:
- Design, architect, develop, and support GCP data pipelines to extract, load, and transform data
- Maintain a holistic view of information assets by creating and maintaining documentation showing how information is stored, processed, and supported
- Work with the project team to estimate and plan the work effort
- Attend daily team standups
- Work with business analysts and project management to review business requirements and produce technical design specifications
- Collaborate with cross-functional teams to design, develop, and deploy robust data solutions for data-driven decision-making and improved patient outcomes
- Drive ML and data engineering initiatives
Requirements:
- 5+ years of hands-on experience as a Data Engineer or Data Architect
- Proven track record leading technical projects and teams
- Expert proficiency in Google Cloud Platform (GCP) tools, including Google Cloud Storage (GCS), BigQuery, Cloud Composer/Airflow, and Dataproc/Spark
- Strong data analysis and problem-solving skills
- Proficiency in a Business Intelligence (BI) tool
- Advanced SQL skills, including writing, tuning, and interpreting complex SQL queries
- Experience writing and maintaining Unix/Linux shell scripts
- Solid understanding of Data Build Tool (DBT)
- Experience with CI/CD pipelines
- Machine Learning experience
- Proficiency in developing Python-based ELT data pipelines
- Expertise in optimizing GCP BigQuery SQL queries and scripts
Benefits:
- Competitive salary
- Health insurance
- Retirement plans
- Professional development opportunities
















