Azure Databricks Developer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Azure Databricks Developer building scalable Azure data pipelines for Atos’s AI-powered digital transformation services. Supporting ETL, analytics, governance, and operational data platform delivery.
Responsibilities:
- Design, develop, and optimise scalable data pipelines using Azure Databricks, PySpark, Spark SQL, and Delta Lake
- Build robust ETL/ELT solutions and data ingestion frameworks supporting batch and streaming workloads
- Integrate data from Azure SQL Database, Azure Data Lake Storage Gen2, Microsoft Fabric, APIs, SaaS platforms, and on-premise systems
- Implement data quality, validation, monitoring, and governance controls across the data lifecycle
- Support platform engineering activities, including CI/CD implementation, environment promotion, performance optimisation, and operational support
- Work closely with Data Architects, Data Engineers, Data Analysts, and Solution Architects
- Deliver trusted, high-quality data products while ensuring compliance with security, governance, and operational standards
Requirements:
- Expertise in Azure Databricks, Apache Spark, PySpark, and Spark SQL
- Experience building enterprise-scale ETL/ELT pipelines within Azure environments
- Strong Python and SQL development skills
- Experience with Azure Data Lake Storage Gen2 and Azure Data Factory or Microsoft Fabric Data Factory
- Git version control and software engineering best practices
- Candidates must be eligible to obtain and maintain SC and NPPV3 clearance
- Proven experience working with large-scale data processing and distributed computing technologies
- Experience working within Agile delivery teams
- UK-based
- National mobility required
Benefits:
- 25 days paid leave + National Holidays
- Pension Scheme - contributions matched up to 10%
- Private Medical Cover
- Income Protection
- Life Assurance
- Flex Benefits Program
- Remote working is available
- Care leaver friendly employer
- Reasonable adjustments to the application and assessment process
- Disability Confident employer
Similar Jobs
Senior iSeries / AS400 RPG Developer
Senior RPG Developer maintaining IBM i/AS400 Order Management applications for Workstate. Supporting CW Direct, production troubleshooting, and retail e-commerce operations remotely.
Software Engineer
Software Engineer developing secure, reliable applications for IPT Global’s well integrity and energy technology platforms. Supporting the full development lifecycle, testing, code reviews, and AI-enabled development.
Software Engineer
Software Engineer building payment, accounting, and card infrastructure at Griffin, a regulated UK bank. Owning architecture, delivery, and production systems end-to-end.
Applications Programmer
Applications Programmer developing Oracle EBS and EDI integrations for ICU Medical, a global IV therapy and critical care products manufacturer. Supporting enterprise applications, technical solutions, and production operations.
AI Agent Developer
AI Agent Developer building Microsoft Copilot Studio agents and RAG solutions for IT services. Integrating enterprise systems and automating business workflows with Azure and Power Automate.
Software Engineer
Software Engineer expanding Supporting Cast’s podcast subscription platform with PHP and Laravel. Building creator-facing features, integrations, and AI-assisted development tools for podcast publishers.
Software Engineer
Software Engineer building Hermes Agent, Nous Portal, and infrastructure for Nous Research. Developing product surfaces, backend services, cloud systems, and AI tooling.
Senior Statistical Programmer/Analyst Consultant – Oncology
Senior Statistical Programmer supporting oncology clinical trial programming for ClinChoice, a global full-service CRO. Delivering CDISC-compliant analyses, documentation, quality, and cross-functional study support.
Software Engineer
Software Engineer building Python MCP servers and integrating apps into Mercor’s RL Studio platform. Developing stable, testable applications for frontier AI training projects.
Software Engineer
Software Engineer building scalable software for Workiva’s AI-powered finance, risk, and sustainability platform. Collaborating on code, reviews, and product improvements.
Senior Mobile Engineer – iOS, Android
Senior Mobile Engineer building secure iOS and Android features for Cohere’s enterprise AI workspace platform. Productionizing AI capabilities with researchers and designers.
Bilingual T-SQL Programmer
T-SQL developer converting client data into TELUS Health’s Central Data Repository. Testing transformations, supporting implementations, and resolving data issues for enterprise health clients.
Pharmacometrics Support Programmer
Pharmacometrics programmer developing and validating NONMEM PK/PD datasets for ICON, a global healthcare intelligence and clinical research organisation. Supporting R-based standardisation and regulatory drug development programmes.
Principal Programmer, Statistical Programming
Principal Statistical Programmer leading SAS clinical-trial reporting and eCTD submissions at global biotechnology company Vertex. Supporting clinical teams, CDISC compliance, quality control, and regulatory submissions.
Enterprise Application Developer
Enterprise Application Developer building Workday Studio, EIB, PRISM, and API integrations. Supporting enterprise application managed services, cloud hosting, and consulting at ERPA.
Professional Services Engineer, SW Developer
Senior engineer building AI-powered integrations between Cellebrite platforms and enterprise customer environments. Owning global field deployment architecture, escalations, and automation.
AEP/CJA Developer
Lead Data Analyst migrating Adobe Analytics reporting to Customer Journey Analytics. Building Power BI dashboards and validating MarTech data for global marketing teams.
Docentric Developer – StaeDean Experience
Docentric Developer customizing reporting and document generation for Microsoft Dynamics 365 Finance and Operations. Building Word templates, configuring distribution, and troubleshooting X++-based document processes remotely.
Nuclear Engineering Specialist
New Nuclear Engineering Specialist supporting geological characterization, rock construction, and site logistics planning. Fortum generates low-carbon energy and develops nuclear projects across the Nordic region.
WordPress Developer, Technical Marketing Specialist
WordPress developer building fast, secure websites and marketing integrations for an Austrian digital sales agency. Supporting tracking, automation, CRM, and AI-enabled workflows.