Databricks Architect
Employment Information
Job Description
Senior Data Architect with deep experience in Databricks for US client. Involves architectural tasks for two projects starting in December.
Responsibilities:
- Projektowanie, wdrażanie i utrzymanie skalowalnych rozwiązań Data Lakehouse z wykorzystaniem Databricks, Delta Lake oraz standardów Medallion Architecture (Bronze/Silver/Gold).
- Wdrażanie mechanizmów zarządzania danymi (data governance) i bezpieczeństwa, w tym konfiguracja Unity Catalog, zarządzanie dostępem (RBAC) oraz implementacja IaC (Terraform) dla automatyzacji infrastruktury i audytowalności.
- Aktywny udział w projektach migracyjnych platformy (Synapse ->Databricks, JDE ->Databricks) oraz refaktoring złożonej, starszej logiki biznesowej (SSIS, Boomi) do nowoczesnych rozwiązań Spark/Python.
- Nadzór nad tworzeniem i optymalizacją zaawansowanych potoków ETL/ELT przy użyciu PySpark i Delta Live Tables (DLT), włączając w to mechanizmy przetwarzania danych wsadowych oraz strumieniowych/w czasie zbliżonym do rzeczywistego.
- Definiowanie strategii monitorowania, dostrajanie wydajności oraz automatyzacja procesów data engineering, aby spełniać krytyczne SLA (np. 4-godzinne okno odświeżania danych).
Requirements:
- Eksperckie doświadczenie (8+ lat) w pracy w roli Data Architekta oraz Data Engineera lub pokrewnych rolach, szczególnie w projektach transformacyjnych i migracyjnych
- Ekspercka znajomość platformy Databricks (architektura, multi-workspace, klastry, security) oraz Apache Spark (PySpark, optymalizacja zapytań).
- Praktyczne doświadczenie z Delta Lake i znajomość koncepcji zarządzania danymi, w tym wdrożenia Unity Catalog oraz kontroli dostępu
- Wieloletnie doświadczenie z Infrastrukturą jako Kodu (IaC) przy użyciu Terraform w kontekście zarządzania infrastrukturą chmurową i Databricks (audytowalność, powtarzalność)
- Biegła znajomość środowisk chmurowych, a w szczególności Microsoft Azure (ADLS, networking)
- Bardzo dobra znajomość Python i jego zastosowań w Data Engineering
- Umiejętność podejmowania inicjatywy, samodzielność i liderowanie technicznym decyzjom
- Angielski na poziomie C1 (płynna komunikacja) umożliwiający swobodną komunikację w zespole.
Benefits:
- Prywatna opieka medyczna (Medicover)
- Karta Multisport dla kontraktorów
Similar Jobs
Architecture Consultant
ELYON International
Architecture Consultant supporting M365 and Power Platform environments for government technology services. Responsible for troubleshooting, optimization, and providing technical support in cloud solutions.
WFM Manager – Snr Manager, WFM Optimization Architect
Teleperformance
Manager/Snr Manager responsible for WFM Optimization, leading initiatives at Teleperformance. Fostering collaboration and continuous improvement in workforce management processes.
Senior Application Architect
CG Infinity
Senior Application Architect leading design and implementation of enterprise applications at CG Infinity. Utilizing J2EE technologies and AWS cloud services while providing technical leadership.
Workforce Intelligence Architect
AAPC
Workforce Intelligence Architect developing frameworks for healthcare workforce insights at AAPC. Analyzing labor data and building dashboards to support strategic decisions remotely.
Integration Architect
Border States
Integration Architect managing integration architecture at Border States, focusing on API-first and event-driven designs. Leading integration strategy aligned with business priorities and digital transformation goals.
Product Architect
The Growth Partner
Product Engineer creating user-friendly applications using the Lovable platform for a fast-scaling AI startup. Collaborating with CMO to optimize tools for thousands of clients.
Windows Architect, German-speaking
Deutsche Telekom IT Solutions Slovakia
Senior technical expert responsible for IT services and infrastructure support at Deutsche Telekom. Requires experience in Microsoft environments and fluency in German for operations in Slovakia.
Lead Architect, SDN
Deutsche Telekom IT Solutions Slovakia
Senior technical expert responsible for designing and implementing technology for Deutsche Telekom IT Solutions. Requires postgraduate degree and 5 years of experience in information technologies.
Distinguished Architect – OneStream Consolidations
Edwards Lifesciences
Distinguished Architect leading OneStream Consolidations projects at Edwards Lifesciences. Managing design, integration, and architecture for financial systems to improve patient outcomes.
Microsoft Dynamics Architect
PhillyTech (SaaS Talent)
Microsoft Dynamics Architect leading solution strategy for a HealthTech project in a remote setting. Requires extensive experience in Dynamics 365 design, implementation, and client collaboration.
AVP, ALM Model Architect
F&G
AVP, ALM Model Architect leading design and implementation of ALM Model architecture. Collaborating with multiple departments and overseeing large-scale model development at Fidelity & Guaranty Life Insurance Company.
Design Architect
Utopia
Architect designing and developing boutique hospitality assets for real estate projects, managing early design stages and collaborating with a cross-functional design team.
OpenShift Infrastructure and Virtualization – Architect
Red Hat
OpenShift Architect tasked with designing Red Hat infrastructure projects and guiding implementations. Involves container and virtualization technologies with extensive customer engagement and collaboration.
Senior Architect, OpenShift – FSI
Red Hat
Senior Architect leading customer cloud solutions at Red Hat. Collaborating with cross-functional teams to ensure success in cloud implementations and customer satisfaction.
Senior Architect, Ansible – FSI
Red Hat
Senior Architect specializing in Red Hat Ansible Automation Platform at Red Hat. Driving enterprise-grade automation for financial services clients while mentoring teams.
OpenShift Infrastructure Baremetal Architect
Red Hat
OpenShift Infrastructure Architect specializing in automated container platforms and cloud application architectures at Red Hat. Implementing automated solutions and learning new technology in a supportive environment.
Customer Value Architect – Enterprise
CrowdStrike
Customer Value Manager driving customer success and value as part of CrowdStrike's sales team. Focusing on enterprise accounts with a mission to enhance customer satisfaction and cybersecurity maturity.
Business Central Strategy Advisor, Product Architect
CAVALLO
Business Central Strategy Advisor and Product Architect developing innovative ERP solutions for distributors. Driving product strategy and enhancing automation across Business Central ecosystems at Cavallo.
System Architect
WVU Medicine
System Architect designing and implementing architecture strategies for healthcare applications at WVU Health System. Collaborating with stakeholders to optimize business capabilities and system performance.
Software Application Architect
XTRM Inc.
Software Application Architect at a global fintech company designing cloud solutions on Azure. Collaborating with teams to ensure secure, efficient applications for clients across the world.