Senior Data Engineer

Posted 2hrs ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

Senior Data Engineer designing and maintaining scalable data pipelines for Pax8's cloud marketplace. Collaborating on architecture and mentoring data engineers while driving data quality and reliability.

Responsibilities:

  • Design, build, and maintain scalable data pipelines that support diverse analytical and operational use cases
  • Transform, model, and optimize data for performance, reliability, and accessibility
  • Embed testing and quality practices throughout the data development lifecycle
  • Collaborate on architecture, design reviews, and technical decision-making
  • Continuously improve existing pipelines, tooling, and deployment processes
  • Mentor and support the growth of fellow data engineers
  • Troubleshoot and resolve complex data issues, including participation in an on-call rotation

Requirements:

  • Substantial experience building data pipelines using Python and Structured Query Language (SQL)
  • Proven expertise with distributed data processing frameworks such as Apache Spark
  • Demonstrated experience with streaming platforms like Apache Kafka
  • Strong background with orchestration and extract, transform, load (ETL) tools including Airflow, Prefect, or similar
  • Experience working within major cloud platforms such as Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)
  • Proficiency with analytical data stores like Redshift, BigQuery, Athena, or Presto
  • Experience with infrastructure and deployment tooling (for example: Terraform, Docker, Kubernetes)
  • Confidence building or contributing to continuous integration and continuous delivery (CI/CD) pipelines
  • Clear communication skills and the ability to solve complex, ambiguous problems collaboratively.

Benefits:

  • Competitive compensation
  • Comprehensive medical, dental, and vision coverage
  • 401(k) with company match
  • Generous paid time off and paid holidays
  • Paid parental leave
  • Wellness and mental health support
  • Learning and development programs
  • Company-paid life and disability insurance