Senior Data Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Data Engineer at Kainos designing and developing data processing software for large-scale data solutions. Collaborating with agile teams to ensure high code quality and solution effectiveness.
Responsibilities:
- Responsible for designing and developing data processing and data persistence software components for solutions which handle data at scale
- Develop data processing software primarily for deployment in Big Data technologies
- Encompasses the full software lifecycle including design, code, test and defect resolution
- Work with Architects and Lead Engineers to ensure the software supports non-functional needs
- Collaborate with colleagues to resolve implementation challenges and ensure code quality and maintainability remains high
- Leads by example in code quality
- Work with operations teams to ensure operational readiness
- Advise customers and managers on the estimated effort and technical implications of user stories and user journeys
- Coach and mentor team members
Requirements:
- Strong software development experience in one of Java, Scala, or Python
- Software development experience with data-processing platforms from vendors such as AWS, Azure, GCP, Databricks.
- Experience of developing substantial components for large-scale data processing solutions and deploying into a production environment
- Proficient in SQL and SQL extensions for analytical queries
- Solid understanding of ETL/ELT data processing pipelines and design patterns
- Aware of key features and pitfalls of distributed data processing frameworks, data stores and data serialisation formats
- Able to write quality, testable code and has experience of automated testing
- Experience with Continuous Integration and Continuous Deployment techniques
- A Keen interest in AI Technologies
Benefits:
- Health insurance
- Flexible working hours
- Professional development opportunities
Similar Jobs
Principal Data Architect
Principal Data Architect at Committee for Children, defining and evolving data architecture for a social enterprise. Collaborate with teams to ensure data governance and accessibility for child welfare programs.
Senior Data Engineer, Snowflake
Sr. Data Engineer designing and implementing scalable data solutions in Snowflake for clients. Collaborating with teams to translate requirements into actionable technical solutions and optimizations.
Data Engineer – DataOps, Infrastructure Focus
Data Engineer responsible for building and maintaining AWS data infrastructure for Guidewire. Collaborating with teams to support AI-driven analytics and operational excellence.
Data Architect III
Data Architect III managing data strategy and overseeing data collection and organization in a remote setting for Veterans Affairs. Leading data architecture and governance initiatives to improve Veteran services.
Senior Manager, Data Architecture
Senior Manager of Data Architecture ensuring enterprise data is standardized, secure, and well modeled. Overseeing data architecture across platforms and applications and translating business outcomes into data models.
Senior Data Engineer
Senior Data Engineer at Peek transforming data sources into actionable insights for analytics. Collaborating across teams to support business intelligence and enhance data infrastructure.
Senior Data Engineer
Senior Data Engineer building and scaling data infrastructure for Wagmo’s pet health solutions. Collaborate with multiple teams to ensure clean data flows across the business.
Senior Clinical Data Engineer
Senior Clinical Data Engineer overseeing clinical data lifecycle for Oura's research studies. Collaborating with teams to maintain data integrity and regulatory compliance in clinical trials.
Lead Data Engineer
Lead Data Engineer overseeing data platform and analytics engineering teams at OneOncology. Responsible for operational excellence and technical direction in data processing and management.
Lead Data Engineer
Lead Data Engineer at Mercator.ai building scalable data infrastructure and distributed data pipelines. Ensuring performance and reliability while mentoring junior engineers.
Data Engineer
Data Engineer at Egen designing and building data processing pipelines using advanced technologies. Collaborating with stakeholders to ensure data accessibility, security, and accuracy.
Data Architect
Data Architect providing data management and analytics support for HRSA's Organ Procurement program. Collaborating on patient safety performance, technical assistance, and data visualization.
AI Data Engineering Lead
AI Data Engineering Lead building data foundations for AI models at Ideagen. Leading a team to ensure data quality, compliance, and operational efficiency.
Cloud Data Architect
Cloud Data Architect at Hunter Strategy responsible for telemetry and data normalization in cybersecurity. Designs log collection and routing architectures for AWS and Azure environments.
Senior Data Engineering Analyst
Data Engineer managing data governance and modernization projects using Databricks at Keeggo. Collaborating with teams to enhance data pipeline architecture and performance.
Senior Data Engineer – AWS
Senior Data Analyst migrating data from SQL Server to AWS SaaS architecture, ensuring data integrity and developing reusable ETL processes.
Senior Data Engineer
Senior Data Engineer at Hyatt developing robust data pipelines and supporting data-driven decisions. Collaborating with cross-functional teams in a dynamic and fast-paced environment.
Senior Data Engineer
Senior Data Engineer designing, building, and maintaining data pipelines for global social discovery products. Collaborating with teams to turn data into insights and optimize data quality.
Staff Data Engineer
Staff Data Engineer at firsthand Health designing and optimizing data infrastructure. Engaging in impactful work supporting individuals living with serious mental illness with a modern technology stack.
Data Engineer, Databricks
Data Engineer overseeing data operations and solutions within Azure cloud environments. Collaborating on Databricks and ensuring reliable data processes and governance practices.