Principal Databricks Architect

Posted 1hrs ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

Principal Databricks architect designing enterprise Lakehouse and AI/ML solutions for CDW, a technology solutions provider. Advising customers and leading cloud data modernization engagements.

Responsibilities:

  • Design, develop, and implement scalable Databricks architecture solutions using Delta Lake, Unity Catalog, MLflow, and related platform capabilities for enterprise customers.
  • Collaborate with cloud solution architects, data engineers, data scientists, business analysts, and customer stakeholders to implement complex end-to-end enterprise data solutions.
  • Partner with pre-sales teams on Databricks statements of work, including solution scope, estimates, assumptions, timelines, and implementation approach.
  • Advise executive and technical stakeholders on the business value of Databricks and AI/ML and translate capabilities into customer outcomes.
  • Provide billable consulting leadership across Databricks architecture, cloud-native patterns, platform modernization, data governance, data quality, and cloud engineering.
  • Champion AI/ML through automation, optimization, and machine learning frameworks to accelerate implementation, reduce cost, and increase customer impact.
  • Assess customer data ecosystems, cloud data readiness, IT priorities, and business success measures to design implementation architectures and structured learning plans.
  • Serve as an internal and external thought leader by shaping Databricks and AI/ML strategy, mentoring peers, contributing to reusable delivery assets, and building CDW’s trusted-advisor reputation.

Requirements:

  • Bachelor’s degree and 10+ years of consulting experience, including hands-on experience designing and implementing Databricks platform solutions OR 14+ years of related IT, data platform, or cloud architecture experience.
  • Deep expertise with Databricks, Delta Lake, Unity Catalog, MLflow, data pipelines, ETL/ELT frameworks, batch and streaming solutions, PySpark, Scala, SQL, and Python scripting.
  • Experience with data governance, data cataloging, master data management, data quality, RBAC, security, compliance, and data lineage.
  • Strong cloud data architecture experience across Azure, AWS, or Google Cloud.
  • Experience with data platform modernization, cloud-native design patterns, advanced analytics, and AI/ML solution enablement.
  • Ability to optimize Databricks performance and cost through cluster configuration, job tuning, workload design, automation, and platform best practices.
  • Proven ability to lead architecture decisions, own end-to-end technical accountability, mentor resources, and guide platform-agnostic projects in agile environments.
  • Excellent communication, stakeholder management, problem-solving, adaptability, and executive presentation skills.
  • Preferred certifications include Databricks Certified Data Engineer Professional and Databricks Certified AI/ML Engineer Associate or Professional.
  • Willingness to travel to other CDW locations or client sites.
  • Valid U.S. driver’s license required.

Benefits:

  • Annual bonus target of 10% subject to terms and conditions of plan
  • Benefits package (benefits overview linked)
  • Remote work arrangement
  • Professional growth and learning opportunities
  • Collaborative and supportive work environment
  • Equal opportunity employment