Resident Solutions Architect – MLOps

Posted 1ds ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

Senior Data Solutions Consultant focusing on Apache Spark and Databricks for customer engagements. Responsible for technical leadership and innovative solution delivery in a remote role.

Responsibilities:

  • Lead engagements from discovery to delivery with full ownership and accountability.
  • Architect, implement, and optimize large-scale Spark/Databricks workloads focusing on scalability and cost-efficiency.
  • Apply expert-level Spark fundamentals to troubleshoot and tune distributed data jobs and SQL workloads.
  • Design and execute PoCs and workshops to demonstrate solution vision and inspire customer confidence.
  • Act as a technical advocate for customers, anticipating issues and applying creative, data-driven solutions.
  • Collaborate with product and engineering teams to improve customer experience and platform features.
  • Champion best practices in PySpark, Databricks, and Lakehouse design while mentoring junior engineers.

Requirements:

  • Experience: 5–10 years in data engineering or analytics solution delivery.
  • Databricks Mastery: 3+ years of hands-on expertise, including job optimization, debugging, and workload governance.
  • Technical Depth: Deep understanding of Spark Internals, PySpark, and Databricks SQL (DBSQL) performance tuning.
  • Modern Lakehouse: Strong knowledge of Delta Lake, Structured Streaming, and cloud infrastructure.
  • Autonomy: Proven ability to identify and solve complex technical problems with minimal oversight.
  • Communication: Exceptional skills to simplify technical complexity for business leaders.
  • Certifications: Databricks Certified Data Engineer Professional preferred.
  • Advanced Skills: Experience with Delta Live Tables (DLT) and Unity Catalog (UC) preferred.
  • Consulting Background: Experience in large-scale data migration or AI-assisted analytics in enterprise environments preferred.

Benefits:

  • Remote work
  • Health insurance
  • Professional development