Director, Software Engineering

Posted 12hrs ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

Director leading Databricks pipeline migration, AI-assisted engineering, and data mastering integration. Driving enterprise data-platform delivery for S&P Global’s global financial intelligence business.

Responsibilities:

  • Partner with the core Databricks team to plan and execute transition of existing data pipelines to the target enterprise data platform
  • Implement repeatable engineering patterns for ingestion, transformation, testing, deployment, and monitoring across onboarded datasets
  • Lead adoption of AI-powered development tools such as Claude, GitHub CoPilot, and LLMs
  • Develop context engineering practices and reusable context packs
  • Guide offshore teams in defining and operationalizing asset-agnostic onboarding patterns for data assets, domains, and source systems
  • Establish reusable ingestion and processing patterns for batch and streaming use cases
  • Integrate platform pipelines and datasets with the enterprise data mastering platform
  • Establish data quality controls, reconciliation processes, and metadata alignment
  • Support consistent business definitions, reusable data concepts, and governed consumption patterns
  • Provide senior technical guidance for offshore data platform engineering
  • Influence architectural decisions and contribute to design and code reviews for complex data platform initiatives
  • Collaborate with global platform, architecture, governance, security, data mastering, Databricks-aligned, partner, offshore, and upstream/downstream teams

Requirements:

  • 10+ years of experience in data engineering, data platforms, cloud data architecture, software engineering, or related engineering domains
  • Experience as a senior Individual Contributor, technical lead, principal engineer, staff engineer, distinguished engineer, architect, or equivalent in complex data platform environments
  • Strong hands-on experience with modern data engineering and pipeline development
  • Experience with batch and/or streaming data workflows
  • Experience with Databricks-based data platforms and lakehouse-oriented architectures
  • Practical experience using AI-assisted engineering tools such as Claude, GitHub CoPilot, LLMs, or similar
  • Experience applying LLMs to engineering use cases such as code generation and optimization
  • External candidates reaching the final interview stage must attend at least one in-person interview at the nearest S&P Global office
  • Familiarity with enterprise data cataloging, metadata management, business glossary, lineage, operational metadata platforms, or semantic data layers
  • Experience with NeoXam DataHub or NeoXam-style mastering workflows
  • Knowledge of semantic modeling
  • Strong leadership skills, including coaching, empowering others, and building consensus across groups

Benefits:

  • Annual incentive plan eligibility
  • Health care coverage
  • Generous time off
  • Continuous learning and career development resources
  • Competitive pay
  • Retirement planning
  • Continuing education program with company-matched student loan contribution
  • Financial wellness programs
  • Family benefits and perks
  • Retail discounts
  • Referral incentive awards