Senior ETL Testing, Data Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior ETL/Data Engineer building and testing scalable GCP data pipelines. Developing cloud data warehouses, automation, and CI/CD integrations for an IT services organization.
Responsibilities:
- Design and implement scalable ETL and ELT processes utilizing GCP services such as BigQuery, Cloud Dataflow, and Cloud Data Fusion
- Manage and orchestrate data workflows using Cloud Composer (Apache Airflow) to ensure seamless data movement and processing
- Develop and maintain data warehousing solutions across Snowflake, Oracle, Teradata, and various SQL databases
- Write efficient, high-performance code in Java and Python to handle complex data transformations and logic
- Construct advanced SQL queries involving window functions, CTEs, and complex joins to extract and manipulate data
- Establish and enforce testing protocols, including source-to-target reconciliation, schema validation, and regression testing
- Integrate data pipelines into CI/CD workflows using Jenkins, Git, and GCP Cloud Build to streamline deployment and version control
- Collaborate within an Agile environment using Jira and Confluence to track progress, manage defects, and document technical specifications
- Utilize Informatica PowerCenter and Talend for enterprise-level data integration tasks
Requirements:
- 5 to 10 years of professional experience in data engineering, ETL testing, or related fields
- Proven proficiency with Google Cloud Platform (GCP) services, specifically BigQuery, Cloud Storage, and Cloud Composer
- Strong command of relational and NoSQL databases, including PostgreSQL, MySQL, Cloud SQL, Cloud Spanner, Oracle, and Snowflake
- Advanced skills in Java (JDBC, Apache Beam SDK) and Python (Pandas, PyTest)
- Expert-level knowledge of SQL, including complex joins, window functions, and PL/SQL
- Hands-on experience with testing frameworks like TestNG, JUnit, and BDD Cucumber, along with data-driven testing methodologies
- Familiarity with CI/CD pipelines, Git, GitHub, Maven, and defect tracking systems like Jira and HP ALM
- Must be available for remote work
Similar Jobs
Data Engineer
Data Engineer building batch and streaming infrastructure for DKSR’s CIVORA urban data hub. Supporting cities, regions, and mission-critical data use cases.
Senior AI/ML/Data Engineer
Senior AI/ML/Data Engineer building ML, NLP, LLM, and RAG solutions for QAVION’s consulting and technology boutique. Developing semantic search, GenAI services, and scalable data pipelines.
Assistant Vice President – Technology, Information Management, Data Warehouse
Data Solution Architect leading Mashreq Global Services' Information Management–Data Warehouse department. Designing Databricks Lakehouse solutions, enterprise data models, streaming systems, and governance frameworks.
Assistant Vice President – Technology, Information Management, Data Warehouse
Assistant Vice President leading Mashreq Global Services' enterprise data warehouse architecture, operations, and strategy. Guiding specialists, securing platforms, and driving data modernization.
Senior Software Engineer, Data Platform
Senior Software Engineer solving distributed-systems challenges in Apache Pinot for StarTree’s real-time analytics cloud. Improving performance, reliability, concurrency, and data infrastructure at massive scale.
Data Engineer
Data Engineer building Python and Azure data pipelines, integrations, and APIs. Delivering scalable ETL/ELT and real-time data solutions for enterprise consulting clients.
Data Engineer II – Library Systems
Data Engineer II building ETL pipelines, metadata systems, and AI-ready data platforms for Johns Hopkins Libraries. Supporting research, analytics, data quality, and library operations.
Data Engineer
Data Engineer building scalable Azure and Snowflake data platforms for Datavail’s data management and cloud services. Developing pipelines, warehouses, lakes, and analytics solutions.
Senior Data Engineer
Senior Data Engineer building clinical data pipelines and cloud applications for Providence’s healthcare system. Supporting data-driven operations with modern engineering, analytics, and AI technologies.
Data Engineering Analyst
Data Engineering Analyst optimizing Servus Credit Union’s data warehouse, pipelines, integrations, and analytics infrastructure. Supporting data-driven financial services for Alberta members.
Senior Cloud Data Engineer
Senior Cloud Data Engineer building secure cloud data systems for BMC. Designing pipelines, data warehouses, ETL processes, and cloud-based data solutions.
Senior Backend Engineer - Data Platform
Backend Developer building TypeScript and Node.js data services for NaNLABS’ insurance wildfire-risk platform. Designing integrations, ingestion pipelines, and reliable PostgreSQL systems.
Data Engineering Intern
Data Engineering Intern building scalable ELT pipelines and data models at Super.com, a consumer fintech platform. Ensuring data quality, governance, and operational reliability for high-volume datasets.
Data Warehouse, Analytics Architect
Data warehouse architect designing scalable lakehouse and analytics infrastructure for Virtru’s secure data-sharing platform. Leading SRE, technical architecture, and engineering mentorship.
Presales Data Architect, Modern Data Stack, AI
Presales Data Architect diseñando arquitecturas Modern Data Stack y AI para Reclut, marketplace de reclutamiento con IA. Liderando preventa, PoCs y conexión entre clientes y equipos de delivery.
Senior Data Engineer – MS Fabric
Senior Data Engineer building Azure data platforms and ETL pipelines for Keyrus, a global data, digital, and AI consulting company. Supporting enterprise analytics, reporting, and master data management.
Data Architect
Data Architect designing Lakeside's enterprise data architecture for BI, analytics, and AI. Leading Snowflake, data modeling, governance, and resilient integration solutions.
Software Engineer – Agentic Data Pipelines
Software engineer building agentic LLM systems for biomedical data acquisition, curation, and quality control. Supporting Iambic Therapeutics’ AI-driven drug discovery platform and Enchant model training.
Engineer III – Platform Data Engineer
Platform Data Engineer building and operating CrowdStrike's cybersecurity analytics infrastructure. Managing Airflow, Terraform, CI/CD, cloud platforms, and data security at scale.
Lead Forward Deployed Engineer – Data Science, Integration
Forward Deployed Engineer at Salesforce, the AI CRM company, building ML, API integrations, and workflows for defense and intelligence customers. Leading secure, customer-site mission delivery.