Senior Cloud Data Engineer, GCP Data Fabric
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Cloud Data Engineer spearheading data migration initiatives to Google Cloud Platform. Focused on optimizing cloud data pipelines, data integrity, and implementing modern data architectures.
Responsibilities:
- Lead migration of over 100TB of enterprise data from Cloudera Hadoop environments into Google Cloud Platform
- Migrate data from HDFS, Hive, AWS S3, and FSx into BigQuery
- Validate data integrity throughout migration activities
- Optimize storage, performance, and scalability
- Design and develop modern cloud-native data pipelines
- Build scalable ingestion and transformation frameworks
- Develop optimized BigQuery storage models
- Support enterprise Data Fabric implementation
- Design and implement Medallion Architecture (Bronze, Silver, Gold)
- Develop secure and scalable data movement frameworks
- Improve platform reliability, performance, and operational efficiency
- Support cloud-native data engineering best practices
Requirements:
- 6+ years of Cloud Data Engineering experience
- Advanced experience with Cloudera (HDFS/Hive)
- Experience migrating large-scale enterprise data platforms
- Strong Google Cloud Platform (GCP) experience
- Experience with BigQuery
- Experience building modern cloud data pipelines
- Experience working with Hadoop ecosystems (HDFS, Hive)
- Experience with AWS data storage services (S3 and/or FSx)
- Experience designing and implementing Medallion Architecture (Bronze, Silver, Gold)
- Strong SQL and data engineering fundamentals
- Experience optimizing large-scale data storage and processing
- Excellent troubleshooting and problem-solving skills
- Data Fabric implementation experience (preferred)
- Serverless data architecture (preferred)
- Data lake modernization (preferred)
- Data governance and security (preferred)
- Data quality and validation frameworks (preferred)
- CI/CD for data engineering (preferred)
- Infrastructure as Code (preferred)
- Python or Spark development experience (preferred)
- Enterprise cloud migration experience (preferred)
Similar Jobs
Cloud Security Engineer
Cloud Security Engineer improving cloud security across Oracle, AWS, GCP, and Azure environments. Engaging clients by implementing security controls and compliance initiatives.
Senior Data Engineer – Databricks, Azure Data Platform
Senior Data Engineer responsible for building and maintaining a scalable data platform on Databricks. Supporting key processes in the insurance and reinsurance environment with multiple data sources integration.
Consultant – Cloud Infrastructure Services
Consultant for Cloud Infrastructure Services at Red Hat delivering customer cloud projects and improving customer experiences. Engaging in design, implementation, and support of Red Hat cloud solutions.
Senior SAP Business One Consultant – Cloud Migration, Future Architecture
SAP Business One Consultant at Cloudiax focusing on cloud migration from SQL Server to SAP HANA. Collaborating with partners and clients to ensure their migration strategies succeed.
Senior Data Engineer – Azure Cloud
Engenheiro de Dados SR atuando na construção e sustentação de pipelines de dados em Azure. Contribuindo para soluções escaláveis e eficientes em projetos de Data & AI.
Senior Cloud Platform Engineer – Tech Cloud Development
Senior Python Cloud Platform & Full-Stack Engineer at EY building scalable cloud-native solutions and automation frameworks. Focus on improving operational efficiency through engineering tools and dashboards.
Principal Cloud Architect
Principal Cloud Architect leading multi-cloud infrastructure design and optimization at Banner Health. Collaborating with cross-functional teams to ensure scalability, security, and innovation across cloud systems.
Back-End Python Engineer, AWS – Desktop
Back-End Python Engineer designing scalable RESTful APIs and microservices at Miratech. Focused on cloud technologies and backend development in a global IT services context.
Back-End Python Engineer – AWS
Back-End Python Engineer developing scalable AWS applications for Miratech. Collaborating across teams to design and maintain secure backend systems using cloud technologies and Python.
Lead Java Developer – Azure
Lead Java Developer for Satalia creating enterprise quality optimisation and ML solutions. Collaborate with data science teams, ensuring robust and high-quality cloud solutions for customers.
Data Engineer, Snowflake, dbt, Azure
Data Engineer developing data pipelines and transformations using Snowflake and Azure Data Factory. Working remotely with an expert team in Data & AI at Logicalis Spain.
Cloud Architect
Cloud Architect at Techmahindra responsible for designing scalable enterprise solutions. Collaborating cross-functionally and ensuring architecture alignment with standards and practices.
Cloud Security Engineer
Join Periferia IT Group as a Cloud Security Engineer managing security for applications and microservices. Work fully remote with opportunities for professional growth in a tech-driven environment.
Cloud Network Engineer – III
Cloud Network Engineer III supporting multi-cloud infrastructure as part of a healthcare technology team. Responsible for documentation, development, and maintenance of cloud implementations.
Cloud Support Engineer
Cloud Support Engineer at Net at Work providing advanced remote technical support across multiple client environments. Focusing on swift service restoration and detailed documentation of technical issues.
Senior Tech Cloud Developer – ITSM, Service Integration Management
Senior Manager at EY responsible for ITIL/ITSM implementation and service management solutions. Leading strategic plans, project delivery, and service model framework creation with corporate stakeholders.
Software Engineer – API, Microservices, AWS
API/Microservices/AWS Software Engineer at CSAA Insurance Group designing scalable cloud-based microservices using modern tech. Collaborating in an Agile environment to deliver high-performing APIs and services.
Cloud Data Architect
Cloud Data Architect designing cloud-native data platforms for business insights at Data Ideology. Leading modernization efforts and supporting enterprise data systems with scalable solutions.
Azure Engineer
Azure Engineer designing, implementing, and managing cloud solutions for enterprise clients. Collaborating with cross-functional teams and ensuring optimal performance and security in Azure.
Cloud Ops Engineer
CloudOps Engineer managing AWS cloud infrastructure for Bloom Growth's platform. Automating operations, enhancing system reliability, and supporting production environments for optimal customer experience.