Databricks Platform Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Databricks platform engineer owning secure, scalable data infrastructure for Salas O’Brien’s engineering and consulting services. Advising teams on governance, automation, networking, and emerging Databricks capabilities.
Responsibilities:
- Administer the Databricks platform across multiple environments, including workspaces, Unity Catalog, cluster policies, budget policies, and platform guardrails
- Manage identity and access using Microsoft Entra ID single sign-on, account-level SCIM group provisioning, service principals, and scalable access-control models
- Partner with IT Infrastructure and Security to manage networking and security, including customer-managed virtual private clouds, private connectivity, encryption, egress controls, audit logs, and system tables connected to enterprise monitoring tools
- Manage infrastructure and workloads through Terraform, Databricks Asset Bundles, and CI/CD practices
- Establish and maintain cost-governance practices, including tagging standards, business-unit showback, budget controls, and spending-reduction recommendations
- Advise data scientists, data engineers, analysts, and business stakeholders on platform architecture and solution design
- Provide practical recommendations balancing organizational standards with business needs
- Evaluate emerging Databricks platform capabilities and determine adoption strategies
- Monitor platform releases and assess serverless computing, Unity Catalog, Lakeflow, and other emerging features
- Translate new capabilities into practical, supportable recommendations
- Shape the platform’s scalability, security, governance, and performance through architectural decisions
Requirements:
- Several years of hands-on experience administering and architecting Databricks environments in production
- Deep, current, production-level Databricks administration experience on AWS, or significant Azure Databricks experience with a credible path to supporting AWS
- Experience designing and managing Unity Catalog in a multi-workspace environment
- Demonstrated experience developing catalog structures and access-control models for a growing organization
- Experience integrating Databricks with Microsoft Entra ID, including single sign-on and SCIM provisioning
- Strong Terraform and CI/CD experience for infrastructure and platform management
- Working knowledge of cloud networking concepts, including virtual private clouds, private connectivity, encryption, egress controls, and security-review processes
- Ability to partner with IT Infrastructure and Security teams, communicate platform needs, follow enterprise standards, and advocate for architecture improvements
- Sound judgment regarding platform defaults and organizational requirements
- Strong written and verbal communication skills
- Experience supporting government, military, or controlled-data environments, including Controlled Unclassified Information and Cybersecurity Maturity Model Certification requirements (preferred)
- Experience with enclave separation, controlled environments, and regulated-data operations (preferred)
- Databricks certifications, such as Databricks Certified Data Engineer Professional or Databricks platform administration credentials (nice to have)
- Experience with Databricks Asset Bundles (nice to have)
- Experience in a federated, decentralized, or multi-entity organization (nice to have)
- Experience with MLflow, machine learning operations, model serving, and related Databricks capabilities (nice to have)
- Travel of up to 20% may be required
Benefits:
- Performance-based bonuses
- Equity participation
- Medical insurance
- Dental insurance
- Vision insurance
- 401(k) with company match
- Paid time off
- Company holidays
- Wellness programs
- Employee-assistance resources
- Professional development support
Similar Jobs
MDR Platform Engineer
MDR Platform Engineer enhancing ThreatDown’s managed cybersecurity detection and response platform. Building SIEM rules, SOAR playbooks, integrations, and Python tools for threat analysts.
Platform Engineer
Platform Engineer building and operating AWS infrastructure for inKind’s restaurant rewards platform. Improving reliability, security, observability, deployments, and cloud scalability.
Senior Data Platform Automation Engineer
Senior engineer automating Danaher’s Snowflake-based enterprise data platform for a life sciences and biotechnology company. Building IaC, CI/CD, observability, and AI-driven operations.
Senior Platform Engineer
Senior Platform Engineer modernizing Convoso’s AI-powered contact center platform in Go. Building scalable real-time telephony, distributed systems, and analytics infrastructure.
Platform Engineer – SRE, Mid-Level
Platform Engineer SRE operando AWS, Kubernetes e GitOps para a Cortex. Construindo automações self-service e infraestrutura para sua plataforma SaaS de inteligência de mercado.
Platform Engineer – Integration
Platform & Integration Engineer building reliable Azure, Workato, and API integrations for Hickory. Automating delivery and solving complex platform challenges with global client teams.
Staff AI Platform Engineer – Agent & Retrieval Infrastructure
Staff AI platform engineer building secure Amazon Bedrock agent and retrieval infrastructure. Enabling Bedrock Ocean’s autonomous ocean-data platform and customer intelligence products.
Software Engineer – Platform
Platform Software Engineer supporting Invoice Simple, EverCommerce’s invoicing SaaS for small businesses. Building cloud infrastructure, CI/CD pipelines, and reliable production systems.
Platform Engineer II
Platform Engineer developing C++ platform software, embedded systems, and SDK components for Firefly Aerospace’s spacecraft missions. Integrating perception, sensors, and compute hardware into reliable flight systems.
Senior Front End Developer – Platform Widgets
Senior Front End Developer building scalable platform widgets for GR8_TECH’s B2B iGaming platforms. Driving microfrontend architecture, performance optimization, testing, and engineering leadership.
AI Platform Engineer
AI Platform Engineer building secure agent, MCP, and AWS Bedrock infrastructure. Enabling Sysdig’s cloud security teams with governed AI platforms, automation, and observability.
Senior Platform Engineer
Senior Platform Engineer building automated, secure cloud platforms for DoiT, a global cloud technology company. Managing GCP, AWS, Kubernetes, Terraform, and CI/CD infrastructure.
Senior Platform Engineer
Senior Platform Engineer building scalable platform infrastructure for DoiT’s multicloud customers. Automating Kubernetes, Terraform, CI/CD, and cloud operations across GCP and AWS.
Contract Platform Engineer
Contract Platform Engineer managing AWS cloud identity, access, and infrastructure-as-code for YLD’s software consultancy clients. Supporting shared infrastructure governance, change management, and team enablement.
Senior Product Engineer, Platform & Portals
Senior Product Engineer building HiveRx’s regulated pharmacy operations platform. Developing Laravel/Vue features, integrations, and secure patient and prescriber portals.
Senior DevOps Platform Engineer
Senior DevOps Platform Engineer securing Humana’s Azure and GCP platforms for healthcare delivery. Owning DevOps tooling, Kubernetes, CI/CD, and software supply chain governance.
Staff Platform Engineer
Senior Platform Engineer designing cloud infrastructure, CI/CD, and AI/ML platforms for an applied AI engineering firm. Driving DevSecOps, reliability, and platform strategy across enterprise systems.
Senior Platform Engineer – OpenShift, Kubernetes, GitOps
Senior Platform Engineer designing and operating OpenShift and Kubernetes platforms. Automating enterprise cloud infrastructure through GitOps, CI/CD, APIs, and Infrastructure as Code.
Senior Platform Engineer – OpenShift, Kubernetes, GitOps
Senior Platform Engineer building and operating OpenShift and Kubernetes platforms for enterprise cloud infrastructure. Automating CI/CD, GitOps, APIs, and Infrastructure as Code.
Lead Product Engineer – Developer Platform
Lead bunny.net’s Developer Platform, building unified deployment tools across compute, scripting, and database products. Guiding a small engineering team from discovery through production delivery.