Data Consultant, Databricks
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Data Engineer leading the development of scalable data pipelines in Databricks ecosystem. Architecting ETL/ELT processes with configuration-as-code approach for data governance and performance.
Responsibilities:
- Lead the development of scalable data pipelines within the Databricks ecosystem
- Architect robust ETL/ELT processes using a "configuration-as-code" approach
- Migrate data ingestion and transformation workloads to Databricks using Lake flow declarative pipelines
Requirements:
- Strong hands-on experience with Databricks in production environments
- Deep expertise in PySpark and advanced SQL
- Experience with:
- Delta Lake
- ingestion pipelines (batch + streaming)
- data transformation frameworks/patterns
- Proven experience implementing:
- CI/CD in Databricks
- Databricks Asset Bundles (DABs)
- declarative pipelines (Lakeflow)
- Strong AWS infrastructure familiarity (S3, IAM, compute patterns)
- Terraform experience specifically with Databricks + AWS resources
- PowerShell scripting experience (asset)
Benefits:
- Retirement Plan (401k, IRA)
- Work From Home
- Health Care Plan
Similar Jobs
Emergency Management Consultant, Strategy and Analytics
Emergency Management Consultant at Guidehouse facilitating collaboration between governments and industries during disasters. Utilizing GIS for analysis and engagement in emergency management planning.
Associate Enablement Consultant
Join BlackRainbow as an Associate Enablement Consultant to deliver NIMBUS solutions. Create e-learning and video content while enhancing customer knowledge in a remote role.
Major Gifts Consultant
Part-time Major Gifts consultant for Malaria No More, engaging stakeholders and developing fundraising strategies for the 20th Anniversary Campaign. Providing strategic guidance and supporting donor engagement activities.
Email Deliverability Consultant
Consultant focused on email deliverability strategies, working with global clients at Adobe. Responsibilities include monitoring performance, generating reports, and addressing deliverability issues.
Senior Consultant, IDX
Senior Consultant enhancing EHR platform for healthcare organizations and improving clinical outcomes. Collaborating to optimize operations and drive growth initiatives in rapidly changing healthcare environment.
Senior Consultant, Organizational Change Management
Senior Consultant at BerryDunn providing OCM expertise to local government clients. Focused on technology change management and improving client operations.
HubSpot Consultant – Full-time / Part-time
HubSpot Consultant overseeing HubSpot projects for clients at BEE Digital. Creating solutions for marketing and sales transformation with a focus on client engagement.
Part-Time Education Consultant
Education Consultant in charge of delivering professional learning experiences and implementing guidance for PK-5 phonics and math educators. Supports customer success and product implementation while traveling occasionally.
Senior PACS/CPACS Consultant
Senior Consultant at Nordic providing PACS/CPACS-related consulting services to clients. Involves project management, mentoring, and direct client engagement.
Digital Shelf Consultant
Digital Category Consultant at Hershey responsible for driving digital shelf strategies. Collaborating with teams to optimize merchandising across major online platforms in the U.S.
Principal Extend Services Consultant
Workday Extend Services Consultant designing, developing, and deploying applications for Workday clients. Collaborating with customers to deliver innovative solutions and exceptional service.
Annuity Suitability Consultant
Annuity Processing/Suitability Consultant managing the lifecycle of annuity contracts at AAA Life. Performing suitability reviews and collaborating with internal teams to ensure compliance.
Senior Solution Consultant
Senior Solution Consultant driving client-focused solutions and supporting their sales enablement journey using Seismic products. Involves consulting, training, and project management for successful outcomes.
TPA Retirement Plan Consultant
Delivering client service for recordkeeping and administration at NBT Bank. Ensuring compliance and management of pension plans while promoting client satisfaction.
Senior Integration Consultant
Senior Integration Consultant working remotely to help clients connect systems, data, and processes efficiently. Involves system integrations and technical requirements mapping.
Senior Consultant
(Senior) Consultant role focusing on Digital Strategy and Digital Transformation Management at Xtentio. Supporting clients in digitalization projects including process optimization and project management.
Workforce Software Consultant, WFS Certified
Looking for a Workforce Software Consultant with strong hands-on experience in WFS solutions. Deep expertise in configuring, optimizing, and supporting Workforce Software environments.
Senior Data Visualization Consultant
Senior Consultant leading Power BI data visualization solutions at Stefanini. Collaborating with global teams to integrate AWS data solutions.
Senior Consultant, Technical IT Infrastructure
Leiter für IT-Sicherheit in den Bereichen Infrastruktur und Security Management bei einer Cybersecurity-Beratung. Verantwortlich für Sicherheit in Geschäftsprozessen und technische Assessments.
Senior Value Consultant – Firefly Enterprise Solutions
Senior Value Consultant shaping AI transformations for enterprises with Adobe's Firefly solutions. Delivering customer-specific roadmaps and compelling business cases in a dynamic consulting role.