Senior GCP Data Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Data Engineer in healthcare focusing on Google Cloud Platform and scalable data solutions. Developing data pipelines and optimizations using GCP tools and best practices.
Responsibilities:
- Design, develop, and maintain scalable batch and real-time data pipelines on GCP
- Implement and manage Medallion Architecture (Bronze, Silver, Gold layers) for data processing
- Build high-performance data transformations using Python and PySpark
- Develop and optimize complex SQL queries for analytical workloads
- Work extensively with BigQuery for large-scale data processing and performance tuning
- Develop and deploy pipelines using Cloud Dataflow
- Orchestrate workflows using Cloud Composer (Apache Airflow)
- Manage data storage and lifecycle using Google Cloud Storage (GCS)
- Implement version control and CI/CD pipelines using Git-based tools
- Ensure data security, governance, and access control using GCP IAM
- Optimize data solutions for performance, scalability, reliability, and cost-efficiency
Requirements:
- Strong hands-on experience with Google Cloud Platform (GCP)
- Expertise in BigQuery (partitioning, clustering, query optimization)
- Proven experience implementing Medallion Data Architecture
- Strong programming skills in Python and PySpark
- Hands-on exposure on Java
- Advanced proficiency in SQL (complex joins, window functions, performance tuning)
- Hands-on experience with Cloud Dataflow
- Experience with Cloud Composer (Airflow) for orchestration
- Experience working with Google Cloud Storage (GCS)
- Knowledge of version control systems (Git) and CI/CD practices
- Strong understanding of GCP IAM and cloud security best practices
Benefits:
- Health insurance
- Flexible work arrangements
Similar Jobs
Senior Consultant II, Applied Machine Learning, Data Engineering
Applied Machine Learning Engineer Senior Consultant II developing AI-driven data pipelines and solutions. Support data automation initiatives to enhance operational efficiency and data quality.
Data Engineer – Fintech
Data Engineer developing scalable data solutions for the fintech sector at Hypoport. Responsible for end-to-end data product ownership and cross-functional collaboration.
Staff Data Engineer
Founding Data Engineer at Payabli developing data systems and pipelines for payments infrastructure. Owner of data reliability and architecture decisions critical to the platform's analytics and ML efforts.
Data & AI Engineer – Microsoft Fabric
Senior Data Engineer with deep expertise in Microsoft Fabric and AI integration at Reply. Delivering end-to-end data solutions and building large-scale data pipelines.
Data Engineer
Data Engineer designing, building, and optimizing scalable healthcare data solutions leveraging Microsoft Azure ecosystem. Focus on ingestion, transformation, modeling, and delivery of complex datasets.
Senior IT Data Architect
Senior IT Data Architect providing technical leadership within the Data and Analytics organization for Rentokil family of companies. Translating enterprise data strategy into actionable technical roadmaps and overseeing a team of Data Architects.
Data Engineer
Data Engineer responsible for managing critical pipelines and customer identity data assets for Europe's leading platform in e-commerce. Collaborating with data engineers and analysts to deliver data-driven solutions.
Data Engineer – Senior (GCP)
Seeking a Senior Data Engineer for strategic initiative at Leega with focus on GCP. Joining a dynamic team to automate data validation and enhance performance indicators.
Senior Data Engineer, Snowflake
Senior Data Engineer designing and building cloud-based data platforms focused on Snowflake at ZigZag. Leading architecture and operational management for data solutions in a remote Philippine role.
Senior Data Engineer – Graph Databases, Databricks
Senior Data Engineer at DaCodes focusing on graph database implementation and performance testing. Contributing to strategic initiatives in enterprise-scale knowledge graph technologies across LATAM and the USA.
Data Architect
Data Architect shaping and advancing Skillable’s data and BI strategy. Collaborating on data architecture roadmap and delivering innovative data solutions.
Senior Data Engineer, dbt, GCP
Senior Data Engineer focused on data processes within GCP at Leega. Involves automation, data ingestion, and management of data workflows.
Data Engineer
Data Engineer shaping challenging data and AI projects for a leading data science startup. Working with innovative data solutions in the Microsoft Azure environment.
AI Data Architect
AI Data Architect building and maintaining data pipelines and API integrations for BraunAbility's AI solutions. Ensuring security and compliance within the AI environment through effective RBAC protocols.
Senior Manager, Data Engineering
Senior Manager, Data Engineering at CVS Health leading Financial data modeling and data product delivery. Overseeing data pipeline development and mentoring junior engineers.
Senior Data Architect – Engineering
Senior Data Architect leading data architecture design and evolution for a tech company. Collaborating with engineering and data teams for scalable data platforms.
Lead Data Engineer
Lead Data Engineer at 3M designing and optimizing data platforms for AI/ML applications. Collaborating with data scientists and mentoring junior engineers in data engineering best practices.
Manager, Data Engineering
Manager managing a team of 3-4 data engineers at Capital Blue Cross. Overseeing project workflows, quality, and technical guidance for data solutions.
Senior Data Engineer
Senior Data Engineer managing data engineering projects for a Canadian financial institution. Delivering high-impact initiatives with minimal supervision and strong technical guidance.
Senior Data Engineer – Platform Experience
Senior Data Engineer with Platform Experience helping a Canadian financial institution upgrade its Core Data Platform. Requires 7+ years in Data Engineering and strong technical skills in various tools.