Data Engineer

Posted 3hrs ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

Lead Data Engineer designing scalable data-processing systems for Kainos, a UK digital technology services company. Leading engineers, ensuring software quality, and delivering secure ETL/ELT solutions.

Responsibilities:

  • Design and develop data processing and data persistence software components for solutions handling data at scale
  • Provide strong development leadership for team members and take responsibility for codebase quality and alignment with user needs
  • Take responsibility for development of whole components or subsystems, including design, coding, testing and defect resolution
  • Perform hands-on design and development using open source and commercial platforms
  • Define and enforce development best practice and coach team members
  • Work with project architects on non-functional ETL/ELT pipeline needs such as robustness and performance
  • Own unit and integration testing standards and execution within the team
  • Take responsibility for software product due diligence and integration
  • Lead troubleshooting and tuning activities
  • Work with Operations teams to ensure application software is operationally ready
  • Work with Security Architects and accreditors to ensure compliance with legal and security requirements
  • Advise customers, managers and team members on estimated effort and technical implications of user stories and journeys
  • Contribute to technical proposals during the sales process
  • Manage, coach and develop a small number of staff, focusing on performance and career development
  • Provide direction for the team while solving problems collaboratively

Requirements:

  • Experience of leading a team of engineers in the implementation of data-intensive system components
  • Experience of applying standards for design (patterns), development (style guides) and operational readiness (automation, deployment)
  • Proficient software development experience in one of Java, Scala, or Python
  • Strong commercial experience of working with Palantir
  • Software development experience with data-processing platforms from vendors such as AWS, Azure, GCP, Databricks
  • Expert in SQL or SQL extensions for analytical use case
  • Expert understanding of distributed data stores and data processing frameworks
  • Ability to simply and clearly communicate technical design both written and verbally
  • Proficient in designing analytical and operational data models
  • Comfortable with Data Warehouse methods and techniques
  • AWS/Azure/GCP Certified in Data Services
  • Expertise in continuous improvement and sharing input on data best practice
  • Participation in development and/or technology communities

Benefits:

  • Diversity, equity and inclusion commitment
  • Accommodations or adjustments during the recruitment process
  • Recruitment process tailored to individual needs through private conversation