Data Engineer
Posted 3hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Lead Data Engineer designing scalable data-processing systems for Kainos, a UK digital technology services company. Leading engineers, ensuring software quality, and delivering secure ETL/ELT solutions.
Responsibilities:
- Design and develop data processing and data persistence software components for solutions handling data at scale
- Provide strong development leadership for team members and take responsibility for codebase quality and alignment with user needs
- Take responsibility for development of whole components or subsystems, including design, coding, testing and defect resolution
- Perform hands-on design and development using open source and commercial platforms
- Define and enforce development best practice and coach team members
- Work with project architects on non-functional ETL/ELT pipeline needs such as robustness and performance
- Own unit and integration testing standards and execution within the team
- Take responsibility for software product due diligence and integration
- Lead troubleshooting and tuning activities
- Work with Operations teams to ensure application software is operationally ready
- Work with Security Architects and accreditors to ensure compliance with legal and security requirements
- Advise customers, managers and team members on estimated effort and technical implications of user stories and journeys
- Contribute to technical proposals during the sales process
- Manage, coach and develop a small number of staff, focusing on performance and career development
- Provide direction for the team while solving problems collaboratively
Requirements:
- Experience of leading a team of engineers in the implementation of data-intensive system components
- Experience of applying standards for design (patterns), development (style guides) and operational readiness (automation, deployment)
- Proficient software development experience in one of Java, Scala, or Python
- Strong commercial experience of working with Palantir
- Software development experience with data-processing platforms from vendors such as AWS, Azure, GCP, Databricks
- Expert in SQL or SQL extensions for analytical use case
- Expert understanding of distributed data stores and data processing frameworks
- Ability to simply and clearly communicate technical design both written and verbally
- Proficient in designing analytical and operational data models
- Comfortable with Data Warehouse methods and techniques
- AWS/Azure/GCP Certified in Data Services
- Expertise in continuous improvement and sharing input on data best practice
- Participation in development and/or technology communities
Benefits:
- Diversity, equity and inclusion commitment
- Accommodations or adjustments during the recruitment process
- Recruitment process tailored to individual needs through private conversation















