Senior Data Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Data Engineer designing and building streaming pipelines for Simple Life, an AI-powered health coaching app. Collaborate on ingesting and processing data to enhance user experience.
Responsibilities:
- Design, build, and maintain streaming pipelines.
- Develop custom ingestion pipelines from third-party APIs, webhooks, and SDKs.
- Migrate existing data ingestion pipelines from SaaS tools to our own infrastructure.
- Deliver data to the raw layer of our Snowflake warehouse with schema consistency, idempotency, and resilience to malformed or late data.
- Evolve the existing AWS streaming stack (Kinesis, SQS, Lambda, API Gateway), improving cost efficiency, observability, and resilience.
- Maintain infrastructure as code (Terraform) for ingestion and processing resources.
- Monitor pipelines, troubleshoot, and resolve incidents.
- Contribute to our ongoing work on safe data access for AI agents and tooling.
- Continuously improve ingestion architecture, tooling, and engineering practices.
Requirements:
- 5+ years of commercial Python experience in a backend or data engineering role.
- Solid understanding of distributed systems architecture, including load balancing, sharding, and trade-offs between synchronous and asynchronous processing.
- Hands-on experience with cloud services, preferably AWS (Lambda, API Gateway, containers in ECS/EKS).
- Experience building streaming pipelines (Kinesis, SQS, or equivalents).
- Experience with infrastructure as code (Terraform or equivalents).
- Working knowledge of SQL: ability to read and write queries, including joins and window functions.
- Commercial experience with real-world production data: ability to design systems that gracefully handle messy, duplicated, delayed, or malformed input.
- Solid understanding of how data flows through production systems, including the ability to anticipate and prevent downstream issues.
- Operational mindset: comfortable owning production systems and monitoring them.
- Ability to make architectural decisions independently and review the work of teammates.
Benefits:
- Open-minded teams, a welcoming and inclusive company culture, plus the opportunity to make a real difference with a game-changing health tech product.
- A competitive salary package based on your unique expertise, skillset, and impact on the product plus stock options.
- In-office, remote and hybrid work opportunities.
- The equipment whatever you need to be happy and productive.
- A premium SIMPLE subscription.
- 21 days annual leave, plus bank holidays (those observed where you live).
- Flexible hours. We focus on your results, not how long you spend at your desk.
Similar Jobs
Senior Data Engineer – AI
Senior Data Engineer at Anaplan building AI capabilities and solutions for business decision-making. Working across the full stack of Anaplan AI applications and developing innovative features.
Associate Data Engineer – Artificial Intelligence, AI
Data Engineer at Cotiviti managing data processes and implementations for operational excellence. Involves data analysis, pipeline creation, and troubleshooting in collaboration with Engineering teams.
Data Engineer – AI, Agents, Context – Revenue Cycle (Associate)
Data Engineer developing and maintaining AI/context data capabilities for healthcare innovation. Building data pipelines and collaborating to enhance operational efficiency and clinical outcomes.
Data Engineer – AI, Agents, Context, Clinical – Senior Associate
Data Engineer contributing to healthcare AI context platform at Huron. Implementing data products and ensuring operational excellence in a remote role.
Data Operations Engineer
Data Operations Engineer Associate managing Power BI datasets for healthcare organizations. Designing data models and ensuring data quality to optimize analytics and reporting processes.
Senior Data Engineer, AI & Context Platform, Healthcare Insights, Rev Cycle
Senior Data Engineer focused on AI context platform for healthcare insights. Leading technical delivery in building scalable data capabilities leveraging unstructured data.
Data Architect – Data Governance
Data Architect at Smarthis, focusing on defining efficient data architectures and supporting engineering teams in implementations. Collaborating on data solutions across cloud environments.
Data Engineer, L3
Data Engineer (L3) designing scalable data architecture and robust data pipelines for social marketing. Collaborate in a fintech initiative providing insights on personal finance and growth marketing.
Data Engineer – L2
Data Engineer building and maintaining data pipelines for marketing analytics and support across business teams. Contributing to data ingestion and modelling from various platforms with a focus on Meta Ads.
Data Architect, Information Strategy
Data Architecture & Information Strategy Engineer applying engineering principles and analytical skills at Ford Motor Company. Collaborating on data strategies and improving business processes.
Director, Data Engineering – AI Native
Director of Data Engineering leading engineering in the Data and Analytics organization at Life360. Managing data from end to end, collaborating with technical and business teams.
Enterprise Data Warehouse Developer – Microsoft Fabric
Enterprise Data Warehouse Developer utilizing Microsoft Fabric to design and implement data solutions for the healthcare sector. Collaborating with teams to ensure optimal data-driven decisions.
Staff Data Engineer, Ads
Staff Data Engineer at Discord driving technical vision for advertising products with a focus on data infrastructure. Leading cross-functional initiatives while collaborating with data science and product teams.
Data Engineer – Specialist
Data Engineer specializing in AI for data modernization and system optimization. Join Compass UOL in shaping next-gen data solutions and AI-driven outputs.
Enterprise Data Architect
Enterprise Data Architect managing and implementing data models for enterprise applications. Leading security and compliance strategies while overseeing development teams.
Data Engineer – Analytics, Modeling
Senior Data Engineer focusing on analytics and modeling to modernize data platforms in LATAM. Collaborating with engineering teams to build scalable data solutions for high-impact digital products.
Data Engineer
Data Engineer supporting data conversion and migration initiatives for a leading legal services client. Responsibilities include data cleansing, validation, and automation of processes for improved data quality.
Data Engineer
Data Engineer at MVB Financial Corp. responsible for designing scalable data infrastructure and automation solutions, collaborating with cross-functional teams to enhance data quality and delivery.
Data Engineer I
Data Engineer I responsible for designing and building data-centric applications using cloud technologies. Collaborating with teams to support clinical workflows in healthcare system.
Senior Data Engineer
Senior Data Engineer developing AI and machine learning infrastructure for healthcare data. Collaborating with engineers and scientists to support data-driven healthcare solutions.