Software Engineer, Data Infrastructure

Posted 43mins ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

Software Engineer building data infrastructure for AI training workloads. Collaborating with top researchers and engineers in cutting-edge AI.

Responsibilities:

  • Build and maintain the high-performance data layer our Modeling teams rely on for training and evaluation jobs.
  • Work directly on petabyte-scale storage infrastructure, and the networking and performance challenges that come with it.
  • Collaborate daily with researchers and engineers who are some of the best in the world at what they do.

Requirements:

  • 4+ years of experience working on data storage infrastructure
  • Strong command of Python
  • Kubernetes experience, especially on the storage side (Persistent Volumes, CSI drivers, etc.)
  • The ability to transform unstructured data into performant datasets across diverse storage backends including S3, GCS, and POSIX
  • Experience with distributed data processing frameworks such as Apache Beam, Spark, or Flink
  • [Nice-to-have] Familiarity with modern analytics tooling such as BigQuery, Airflow, or dbt
  • Genuine excitement about AI.
  • Comfort operating at the edge of what's known, with a desire to build something genuinely new rather than optimize what already exists

Benefits:

  • An open and inclusive culture and work environment
  • Work closely with a team on the cutting edge of AI research
  • Weekly lunch stipend, in-office lunches & snacks
  • Full health and dental benefits, including a separate budget to take care of your mental health
  • 100% Parental Leave top-up for up to 6 months
  • Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement
  • Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co-working stipend
  • 6 weeks of vacation (30 working days!)