Software Developer
Posted 1hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Databricks Data Engineer building Azure pipelines for CGI’s credit-card modernization projects. Transforming financial data with PySpark, Databricks, and reconciliation controls.
Responsibilities:
- Design, develop, and maintain Azure Databricks pipelines for credit card data ingestion, transformation, integration, and downstream consumption
- Develop scalable processing solutions using PySpark, Python, Spark SQL, SQL, Delta Lake, and ADLS for high-volume card datasets
- Build transformation logic for cardholder, account, transaction, authorization, payment, balance, fee, interest, rewards, and servicing data
- Translate business requirements and source-to-target mappings into reusable Databricks notebooks, workflows, jobs, and ETL/ELT processes
- Support credit card platform conversion and modernization, including data mapping, historical/incremental loads, transformation, and reconciliation
- Implement automated data quality, balancing, reconciliation, cleansing, and exception-handling controls across source and target environments
- Protect sensitive cardholder information, including PAN and PCI-sensitive data, through masking, tokenization, encryption, and appropriate data-handling practices
- Troubleshoot and optimize Databricks pipelines
- Collaborate with credit card SMEs, architects, analysts, and application teams
- Provide expertise in designing, developing, and executing solutions that enhance IT product and service quality
Requirements:
- 5+ years of Data Engineering, ETL/Data Warehouse, or Big Data experience, including 3+ years of hands-on Azure Databricks development
- Strong hands-on development experience with Databricks, PySpark, Python, Spark SQL, SQL, Delta Lake, and ADLS
- Experience designing and developing scalable ETL/ELT pipelines for large-volume transactional and financial datasets
- Strong experience with data transformation, source-to-target mapping, cleansing, reconciliation, data quality, and exception handling
- Credit card/payments domain experience with knowledge of card accounts, transactions, authorizations, payments, balances, billing, and settlement
- Experience with Azure DevOps, Git, CI/CD, and Agile/Scrum development practices
- Strong banking/financial services experience and understanding of financial data controls and reconciliation
- Bachelor's Degree
- Experience with TSYS or another major credit card processing platform
- Experience supporting credit card conversions, migrations, or platform modernization
- Knowledge of the end-to-end card lifecycle, including authorization, authentication, clearing, settlement, posting, and reconciliation
- Experience with Mastercard and/or Visa data, interfaces, reporting, rewards, or loyalty programs
- Understanding of PCI DSS, PAN protection, tokenization/de-tokenization, encryption, and sensitive cardholder data management
- Experience with advanced Databricks capabilities such as Unity Catalog, Workflows, Auto Loader, and Lakeflow/Delta Live Tables
- Experience modernizing Informatica PowerCenter or SSIS workloads to Databricks/PySpark
- Azure and/or Databricks certifications and experience with large-scale banking conversion initiatives
- Ability to successfully complete a background investigation
- For applicable roles, ability to meet U.S. government security-clearance requirements
Benefits:
- Competitive compensation
- Comprehensive insurance options
- Matching contributions through the 401(k) plan and the share purchase plan
- Paid time off for vacation, holidays, and sick time
- Paid parental leave
- Learning opportunities and tuition assistance
- Wellness and Well-being programs
- Ownership opportunity from day 1 through CGI’s share purchase plan and partnership model
- Opportunities to deepen skills and broaden career horizons
- Global capabilities and technology expertise
- Reasonable accommodations for qualified individuals with disabilities



















