Senior Databricks Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Databricks Solution Architect designing scalable Lakehouse platforms for healthcare analytics. Building governed pipelines that support reporting and operational decisions.
Responsibilities:
- Design and implement scalable data solutions using Databricks Lakehouse architecture
- Develop and optimize batch and real-time data pipelines for large-scale data processing
- Lead technical solution design for data integration, transformation, and analytics workloads
- Collaborate with business stakeholders, data engineers, analysts, and product teams to translate requirements into technical solutions
- Implement data governance, security, and data quality best practices using Unity Catalog and related technologies
- Optimize performance, reliability, and cost efficiency of Databricks workloads
- Support data warehouse modernization and cloud migration initiatives
- Create architecture documentation, technical standards, and design guidelines
- Troubleshoot complex data platform issues and provide technical recommendations
- Stay current with Databricks and cloud platform capabilities and drive adoption of best practices
- Deliver high-quality data platforms supporting analytics, reporting, and operational decision-making
Requirements:
- Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field
- Minimum 5 years of experience in data engineering, data architecture, or related technical roles
- Hands-on experience with Databricks in enterprise environments
- Strong knowledge of PySpark, Spark SQL, Python, and SQL
- Experience designing and implementing Lakehouse architectures
- Experience building scalable ETL/ELT data pipelines
- Strong understanding of data modeling, data warehousing, and analytics platforms
- Experience working with structured and unstructured data
- Strong problem-solving and communication skills
- Ability to work independently in a remote environment
- Experience implementing data governance and security frameworks
- Required Databricks Certified Data Engineer Associate certification
- Required Databricks Certified Data Engineer Professional certification
- Healthcare industry experience, including claims, clinical, provider, member, or revenue cycle data, preferred
- Experience with Azure, AWS, or GCP cloud platforms preferred
- Exposure to machine learning and AI/ML workloads on Databricks preferred
- Cloud platform certifications preferred
Benefits:
- Full-time remote work arrangement
- Individual contributor role
- Opportunity to work on healthcare analytics and modern data architecture initiatives
Similar Jobs
Digital Success Engineer
Digital Success Engineer building AI-assisted automation and integrations for Jamf’s Apple device management platform. Powering proactive digital customer success at scale.
Prompt Engineer
Prompt Engineer designing prompts, dialogue flows, and evaluation systems for conversational AI agents. Analyzing client processes and refining production AI products for enterprise customers.
Ingegnere – Lezioni di Matematica Online
Online physics and mathematics instructor for Letuelezioni, Italy’s private tutoring portal. Personalizing lessons and supporting students remotely with flexible scheduling.
Azure Stack HCI Engineer
Azure Stack HCI Engineer managing Microsoft hybrid cloud infrastructure. Supporting virtualization, storage, networking, security, backups, and disaster recovery.
Senior Cost Engineer – Energy
Senior Cost Engineer managing estimates, forecasts, change control, and cost reporting for Turner & Townsend’s major energy and infrastructure projects. Client-facing role supporting large-scale capital construction programs.
Sentinel Engineer
Senior Microsoft Sentinel Engineer designing and managing Microsoft Sentinel environments for Arctiq’s managed cybersecurity services. Building integrations, detection logic, and SOAR automation for clients.
Senior Protection & Control Engineer – Power & Utilities
Senior P&C Engineer leading medium- to high-voltage substation protection and control designs for Meade, a data-center and large-scale construction engineering firm. Delivering compliant drawings, relay applications, and commissioning support.
Project Engineer
Project Engineer coordinating design, construction, commissioning, and performance of utility-scale battery storage and solar projects. Supporting EPC, engineering, O&M, and asset management partners.
Lift Repair Engineer
Lift Repair Engineer repairing and maintaining Stannah’s lifts across Reading and surrounding areas. Diagnosing faults, replacing components, and restoring service safely.
Lift Repair Engineer
Lift Repair Engineer repairing, diagnosing, and maintaining lifts across Luton and nearby sites. Stannah manufactures stairlifts, lifts, escalators, and homelifts and provides repair services.
Escalator Engineer – Nights
Night-shift Escalator Engineer maintaining and repairing escalators and moving walkways across Greater London transport networks. Stannah manufactures and services lifts, escalators, and homelifts.
Escalator Engineer – Days
Escalator Engineer maintaining and repairing escalators across Greater London transport hubs. Supporting safe, reliable operation for Stannah’s lift and mobility-equipment business.
Lift Engineer
Lift Engineer servicing, repairing, and maintaining lifts across Didcot for Stannah, a global access-equipment manufacturer. Attending breakdowns, fault-finding, and keeping local sites safe and compliant.
Lift Engineer
Lift Engineer servicing, repairing, and maintaining lifts across Bristol and surrounding areas. Joining Stannah, a family-owned manufacturer and provider of lift and accessibility services.
Senior Process Controls Engineer
Process Controls Engineer leading controls, equipment scale-up, and chemical refining development. Advancing Mariana Minerals’ software-driven critical-minerals supply chain and plant automation.
Senior Forensic Engineer
Senior Forensic Engineer leading large-loss investigations, expert reporting, and testimony for J.S. Held, a global consulting firm. Advising clients and developing forensic engineering business.
Civil/Structural Forensic Engineer
Forensic Civil/Structural Engineer conducting building investigations, damage assessments, and technical reporting for J.S. Held, a global consulting firm. Traveling to project sites and advising clients as an expert.
Senior Middleware Engineer
Senior Middleware Engineer automating PKI and SSL/TLS certificate lifecycle management. Supporting Ensono’s managed technology services through secure infrastructure, compliance, and incident resolution.
Requirement Engineer
Requirements Engineer translating banking and financial-services needs into software specifications for Qualysoft, an international IT consulting company. Supporting agile delivery, testing, and stakeholder alignment.
Tender Engineer
Tender Engineer analyzing contracts, developing bid strategies, and estimating costs for industrial EPC projects. Coordinating engineering, procurement, construction, suppliers, and subcontractors.