Senior Data Engineer, Databricks
Posted 42mins ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Data Engineer building scalable Databricks lakehouse platforms for an international technology project. Designing cloud data pipelines with Python, SQL, and Apache Spark.
Responsibilities:
- Design, develop and maintain cloud-based data platforms using Databricks
- Build and optimise ETL/ELT pipelines and data transformation processes
- Implement scalable data lake and lakehouse architectures
- Develop data integration solutions using Python, SQL and Apache Spark
- Work with Delta Lake, Unity Catalog, Databricks Workflows and Databricks SQL
- Optimise data processing performance, reliability and scalability
- Apply best practices related to data governance, security and data quality
- Collaborate with engineering teams and business stakeholders to translate requirements into technical solutions
- Support continuous improvement of data engineering processes and cloud infrastructure
Requirements:
- 3–5 years of commercial experience with Databricks and cloud-based data platforms
- Strong practical knowledge of Python, SQL and Apache Spark (PySpark)
- Hands-on experience with Delta Lake and lakehouse architecture
- Experience with Databricks Unity Catalog, Workflows, SQL and Notebooks
- Practical experience with Azure Databricks
- Good understanding of ETL/ELT processes, data warehousing and data lakes
- Familiarity with Git, Terraform and CI/CD practices
- Experience designing and optimising scalable data pipelines
- Strong analytical and problem-solving skills
- Very good English communication skills
Benefits:
- Involvement in technically challenging international projects
- Opportunity to work with modern Databricks and cloud technologies
- Exposure to complex data engineering and architecture challenges
- Opportunities for technical development and certifications
- Remote or hybrid working possibilities within Poland















