Data Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Data Engineer building Azure Databricks pipelines for credit-card data at CGI, a global IT and business consulting firm. Modernizing financial data platforms and controls.
Responsibilities:
- Design, develop, and maintain Azure Databricks pipelines for credit card data ingestion, transformation, integration, and downstream consumption
- Develop scalable processing solutions using PySpark, Python, Spark SQL, SQL, Delta Lake, and ADLS for high-volume card datasets
- Build transformation logic for cardholder, account, transaction, authorization, payment, balance, fee, interest, rewards, and servicing data
- Translate business requirements and source-to-target mappings into reusable Databricks notebooks, workflows, jobs, and ETL/ELT processes
- Support credit card platform conversion and modernization, including data mapping, historical/incremental loads, transformation, and reconciliation
- Implement automated data quality, balancing, reconciliation, cleansing, and exception-handling controls across source and target environments
- Protect sensitive cardholder information, including PAN and PCI-sensitive data, through masking, tokenization, encryption, and appropriate data-handling practices
- Troubleshoot and optimize Databricks pipelines
- Collaborate with credit card SMEs, architects, analysts, and application teams
- Build innovative solutions and relationships with teammates and clients while accessing global capabilities
Requirements:
- 5+ years of Data Engineering, ETL/Data Warehouse, or Big Data experience, including 3+ years of hands-on Azure Databricks development
- Strong hands-on development experience with Databricks, PySpark, Python, Spark SQL, SQL, Delta Lake, and ADLS
- Experience designing and developing scalable ETL/ELT pipelines for large-volume transactional and financial datasets
- Strong experience with data transformation, source-to-target mapping, cleansing, reconciliation, data quality, and exception handling
- Credit card/payments domain experience with knowledge of card accounts, transactions, authorizations, payments, balances, billing, and settlement
- Experience with Azure DevOps, Git, CI/CD, and Agile/Scrum development practices
- Strong banking/financial services experience and understanding of financial data controls and reconciliation
- Experience with TSYS or another major credit card processing platform preferred
- Experience supporting credit card conversions, migrations, or platform modernization preferred
- Knowledge of the end-to-end card lifecycle preferred
- Experience with Mastercard and/or Visa data, interfaces, reporting, rewards, or loyalty programs preferred
- Understanding of PCI DSS, PAN protection, tokenization/detokenization, encryption, and sensitive cardholder data management preferred
- Experience with advanced Databricks capabilities such as Unity Catalog, Workflows, Auto Loader, and Lakeflow/Delta Live Tables preferred
- Experience modernizing Informatica PowerCenter or SSIS workloads to Databricks/PySpark preferred
- Azure and/or Databricks certifications and experience with large-scale banking conversion initiatives preferred
- Ability to successfully complete a background investigation
- Qualified applicants must meet applicable U.S. employment requirements
Benefits:
- Competitive compensation
- Comprehensive insurance options
- Matching contributions through the 401(k) plan and the share purchase plan
- Paid time off for vacation, holidays, and sick time
- Paid parental leave
- Learning opportunities and tuition assistance
- Wellness and Well-being programs
- Ownership opportunity from day 1 through CGI Partners model
- Global capabilities and industry and technology expertise
- Career development and skill-building opportunities
- Reasonable accommodations for qualified individuals with disabilities
Similar Jobs
Working Student – Data Engineering
Working Student building Python and SQL data pipelines for AgentixLake’s cloud data and AI engineering projects. Supporting data quality, lakehouse platforms, testing, and monitoring.
Data Engineer – Temporary
Data Engineer building reliable Zuora-to-GCP ETL pipelines for Applaudo’s AI-powered solutions. Maintaining integrations, data quality, monitoring, and warehouse validation in an async distributed team.
WEKA Data Platform Administrator
WEKA Data Platform Administrator operating NeuralMesh enterprise AI data infrastructure for GPU-cloud customers. Managing storage, Kubernetes, networking, automation, and customer workload performance.
Analytics Engineer – Data Platform
Analytics Engineer building Snowflake and dbt models for Aline’s senior-living resident lifecycle platform. Creating governed data foundations for BI reporting and AI-driven care outcomes.
Senior Data Engineer – Mid Shift
Data Engineer building AWS and Snowflake platforms for Shore360, an Australian-owned Philippine staffing and administrative support firm. Developing reliable pipelines, APIs, and data quality controls.
Senior Software Engineer, Data Infrastructure – RDBMS
Senior engineer operating petabyte-scale PostgreSQL infrastructure for TRM Labs’ AI-powered crime-intelligence platforms. Automating database operations, optimizing performance, and managing CDC pipelines remotely across LATAM.
Data Architect
Databricks Data Architect designing secure Lakehouse architectures and AI-ready data platforms for Devoteam clients. Modernizing legacy systems across cloud and multi-cloud environments.
Senior Data Engineer
Senior Data Engineer building auditable GCP data pipelines for DysrupIT’s financial billing and invoicing platform. Ensuring accurate reconciliation, lineage, and trusted financial data.
Senior Software Engineer, Data Acquisition
Senior software engineer building distributed crawling and ingestion systems for People Data Labs, a provider of people and company data. Improving scalable backend services and data products.
IT Architect, Data Scientist
IT Architect/Data Scientist supporting DLH’s federal health and national-security programs. Leading cloud architecture, data science, interoperability, security engineering, and compliance for SCHARE.
Senior Business Data Engineer
Senior Business Data Engineer building AWS data infrastructure and automated reporting for Nex’s family motion-gaming platform. Improving pipeline reliability and supporting cross-functional business teams.
Senior Data Engineer
Senior Data Engineer building Python, Spark, and Databricks pipelines for Quantiphi’s data and AI solutions. Leading cloud migration, CI/CD automation, and scalable analytics engineering.
Senior Data Engineer – IBM DB2
Senior Data Engineer modernizing IBM DB2 data environments. Building reliable ETL/ELT pipelines and AWS integrations for enterprise applications and payroll systems.
Lead Data Architect
Lead Data Architect owning enterprise data architecture for C5MI Insight’s federal SAP S/4HANA modernization program. Leading data governance, migration, analytics architecture, and master data teams.
FBS Data Engineer, SQL, Power BI
Data Engineer supporting Farmers’ P&C insurance analytics and financial loss reporting solutions. Translating business data needs into requirements, integrations, dashboards, and validated reporting.
Data Engineer – Insurance
Data Engineer building analytics solutions, data pipelines, and enterprise integrations for Farmers Insurance. Improving data quality, reporting, dashboards, and regulatory-compliant business outcomes.
Power BI Data Engineer
Power BI Data Engineer building Azure data pipelines, dimensional models, and executive dashboards for Legence. Transforming complex data into actionable business intelligence across the full BI lifecycle.
Azure Data Engineer
Azure Data Engineer building Azure and Microsoft Fabric data solutions for Quisitive, a global Microsoft cloud partner. Delivering pipelines, integrations, and analytics projects for clients.
Senior Data Engineer
Senior Data Engineer building multi-region data infrastructure for Horizon3’s NodeZero autonomous cybersecurity platform. Supporting Federal workloads, warehouses, pipelines, orchestration, and BI reporting.
Data Engineer, Snowflake
Data Engineer Snowflake diseñando pipelines cloud y transformaciones ELT/ETL para Logicalis Spain. Participación en proyectos de ingeniería de datos, IA y analítica avanzada.