Senior Software Engineer, Data

Posted 105ds ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

Senior Software Engineer collaborating with various teams to build scalable data pipelines for a CRM platform. Engaging with machine learning engineers, software engineers, and product managers to shape the future of private capital's platform.

Responsibilities:

  • Design scalable and reliable data pipelines to consume, integrate and analyze large volumes of complex data from different sources, supporting the evolving needs of our business.
  • Help define our data roadmap. You'll collaborate with our team of machine learning engineers, software engineers, product, and business leaders to shape product development.
  • Build and maintain frameworks for measuring and monitoring data quality and integrity.
  • Establish and optimize CI/CD processes, test frameworks, and infrastructure-as-code tooling.
  • Build and implement robust data-intensive applications over distributed systems.
  • Articulate the trade-offs of different approaches to building data pipelines and storage solutions, providing clear recommendations aligned with product and business requirements.

Requirements:

  • 6+ years of experience as a Software Engineer or Data Engineer with at least 2-3 years in a Senior Engineering role, leading complex, and sometimes ambiguous, engineering projects across team boundaries.
  • Proficiency in event streaming and batch processing pipelines for data-intensive applications is essential.
  • Proven hands-on experience with scalable and robust distributed data systems using Kafka, AWS SQS or similar technologies.
  • Comfortable working with large datasets and high-scale data ingestion, transformation, and distributed processing tools such as Apache Spark.
  • Strong proficiency in SQL.
  • Experience with cloud platforms such as AWS, Databricks, GCP, Azure or related technologies.
  • Familiar with CI/CD processes and test frameworks.
  • Comfortable partnering with product and machine learning teams on large, strategic data projects.

Benefits:

  • Health Benefits: We cover both you and your dependents' extended health benefit premiums and offer flexible personal & sick days to support your well-being.
  • Retirement Planning: We offer an RRSP plan to help you plan for your future.
  • Learning & Development: We provide an annual education budget and a comprehensive L&D program.
  • Wellness Support: We reimburse monthly for things like home internet, meals, and wellness memberships/equipment to support your overall health and happiness.
  • Team Connection: Virtual team-building activities and socials to keep our team connected, because building strong relationships is key to success.