Senior Software Engineer, Data Platform
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Data Engineer architecting G-P’s AI-native Databricks platform. Building scalable data frameworks and streaming systems for G-P’s global employment SaaS platform.
Responsibilities:
- Design and implement internal SDKs and self-service frameworks enabling distributed engineering teams to ingest and transform data autonomously
- Create reusable patterns for batch and real-time event processing
- Own the cost-effectiveness of the Databricks ecosystem
- Tune Spark execution plans and optimize shuffle partitions
- Implement auto-scaling strategies to manage DBU consumption
- Balance latency, throughput, and cloud spend as platform volume grows
- Implement Schema-on-Write validation and Data Contracts before data reaches the Bronze layer
- Partner with the Data Architect and Data Stewards on data privacy, security standards, and metadata lineage
- Champion AI-assisted development tools such as GitHub Copilot and Cursor
- Mentor engineers on distributed computing best practices
- Conduct deep-dive code reviews focused on scalability and maintainability
Requirements:
- 5+ years of experience building and operating production-grade data systems at massive scale
- Deep, hands-on mastery of the Databricks/Spark ecosystem, including Delta Lake, DLT, Spark UI debugging, and performance tuning
- Proven track record of building real-time/streaming architectures using Spark Structured Streaming, Kafka, or Kinesis as a core production requirement
- Experience managing and optimizing cloud costs in a high-growth environment
- Experience building APIs, tools, or frameworks used by other internal engineering teams
Benefits:
- Annual bonus for non-sales roles, paid based on individual and company performance in addition to base salary
- Generous paid parental leave
- Flexible time off
- Spending accounts
- Medical insurance
- Dental insurance
- Vision insurance
- Sabbatical after 5 years
- Flexible work arrangements through remote-first teams
- Resources and flexibility for remote-first employees
Similar Jobs
Junior Data Engineer, MarTech Specialist – Mobile Apps
Junior Data Engineer supporting mobile app tracking, attribution, and data pipelines at Customlytics, a DACH app marketing agency. Maintaining dashboards and marketing integrations for client campaigns.
Financial Data Engineer, AI/LLM
Financial Data Engineer building stock-market data infrastructure for Binance’s blockchain ecosystem. Developing Flink pipelines and reliable datasets for trading products and AI applications.
Senior Product Manager – Data Platform, Web3
Senior Product Manager owning Trust Wallet’s global Web3 data platform roadmap. Leading on-chain data ingestion, token data governance, and analytics products.
Associate Director, Site Engineering – Data Center Construction
Associate Director managing RFIs, design coordination, and governance for Turner & Townsend’s large-scale data center construction programs. Supporting multidisciplinary teams, reporting, and issue resolution.
Data Engineer
Data Engineer diseñando pipelines y arquitecturas de datos AWS para ARKHO, especializada en transformación digital, analítica, machine learning y servicios gestionados.
Data Engineer
Data Engineer managing pipelines, databases, and data quality for MVM, a government services provider. Developing reports, schemas, mappings, and data models for organizational operations.
Mid-Level Data Engineer
Data Engineer building AI/ML data pipelines and analytics for a Navy IT command. Designing secure, scalable data systems supporting national-security missions.
Senior AWS Data Engineer
Senior AWS Data Engineer developing scalable, reusable data platforms with Python and AWS. Debugging pipelines and delivering solutions for multi-country business environments.
GCP Data Engineer – Freelance
GCP Data Engineer designing and optimizing GCP data ecosystems for client projects. Building pipelines, data architectures, and solutions using BigQuery, Airflow, SQL, and Python.
Senior Data Engineer
Senior Data Engineer building AWS data pipelines and services for a sports-tech platform. Processing AI-generated performance data into scalable metrics, rankings, and talent insights.
Senior Data Platform Engineer – Azure, Databricks, Terraform
Senior Data Platform Engineer automating secure Azure-Databricks platforms for banking clients. Building Terraform infrastructure, Airflow orchestration, and cloud data synchronization pipelines.
Intern, Data Engineer
Data Engineer Intern supporting Acxiom’s cloud data platforms, ETL pipelines, and AI-driven workflows. Gaining hands-on experience with SQL, Python, Spark, and cloud services.
Staff Data Engineer
Staff Data Engineer setting direction for Eve’s Snowflake and dbt data platform. Building secure, reliable infrastructure for AI-powered plaintiff law firm workflows.
Senior Data Engineer
Senior Data Engineer building pipelines, governance, and reliability for Eve’s AI-native legal technology platform. Owning Snowflake, dbt, Terraform, and ingestion infrastructure.
Data Warehouse Engineer
Data Warehouse Engineer building scalable data warehouses and pipelines for a US automotive e-commerce company. Improving data quality, performance, and analytics infrastructure.
Senior Software Engineer, Data Platform
Senior Software Engineer building scalable data platforms for ServiceTrade’s commercial contractor field-service management software. Leading Python, SQL, AWS, ETL/ELT, streaming, and batch engineering.
Mid/Senior Azure Data Engineer
Azure Data Engineer building Microsoft Azure, Fabric, and Synapse data solutions for Atos's Dutch insurance client. Mostly remote from Poland with annual Netherlands business trips.
Senior Data Engineer, Snowflake
Senior Data Engineer migrating Hadoop/Hive workflows into Snowflake for Keyrus, an international AI and data consulting group. Designing scalable cloud data platforms and automated migration processes.
Senior Data Engineer
Senior Data Engineer leading Microsoft Fabric pipelines, security, automation, and medallion architectures. Supporting Rackner’s mission-critical software systems for U.S. government agencies.
Data Engineer
Data Engineer building Microsoft Fabric pipelines and Ed-Fi integrations. Supporting Rackner’s mission-critical U.S. government and national security systems.