Senior DevOps Engineer – Azure, Databricks, AI/ML Focus

Posted 2hrs ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

Senior DevOps Engineer specializing in Azure Databricks and AI/ML operations at Acuity Analytics. Contributing to AI platform enabling efficient ML model management and governance.

Responsibilities:

  • Design, implement, and optimize ML/AI pipelines for training, deployment, monitoring, and governance.
  • Leverage Azure Databricks capabilities including MLFlow for experiment tracking and Unity Catalog for data governance.
  • Build and maintain CI/CD pipelines as well as automated ModelOps workflows for AI/ML applications.
  • Ensure data architecture supports schema evolution, governance, and compliance requirements.
  • Operate in a cloud-native Azure environment to deliver robust and scalable ML solutions.

Requirements:

  • Proven experience with Azure Databricks, including MLFlow and Unity Catalog.
  • Strong background in DevOps for ML/AI, including CI/CD and pipeline automation.
  • Solid understanding of data architecture, schema evolution, and governance principles.
  • Experience working in Microsoft Azure or similar cloud environments.
  • Hands-on experience with Infrastructure as Code (IaC) using Terraform.
  • High-level understanding of machine learning and generative AI concepts and workflows (Nice to Have).
  • Solid knowledge of containerization (Docker) and orchestration (Kubernetes) (Nice to Have).
  • Experience in Python software development and scripting (Nice to Have).
  • Hands-on experience with TensorFlow, PyTorch, and Scikit-learn in a Databricks environment (Nice to Have).

Benefits:

  • People are at the Heart of our Business.
  • By investing in people, we achieve exceptional results for our clients and create new opportunities for our teams to thrive.