Senior Data Engineer – Clinical Platforms, Databricks
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Data Engineer building Databricks-based clinical trial platforms at Muttdata. Designing compliant lakehouse pipelines and integrations for regulated clinical data.
Responsibilities:
- Design, build, and optimize enterprise data pipelines, lakehouse storage layers, and data models using Databricks (PySpark, Spark SQL, Delta Lake) to power custom clinical application backends.
- Collaborate with frontend developers, software architects, and clinical research teams to build API-driven endpoints, data ingestion engines, and query layers for proprietary clinical trial software.
- Build performant, standards-compliant data structures to store EDC outputs, audit trails, device telemetry, and patient-reported outcomes, enabling rapid querying and downstream analytics.
- Partner with Clinical QA and Validation teams to ensure database structures, data pipelines, and clinical data repositories comply with GxP, 21 CFR Part 11, HIPAA, and GDPR.
- Implement real-time and batch ingestion jobs connecting legacy clinical systems, central labs, EHRs, and wearable devices into a unified Databricks Lakehouse architecture.
- Monitor, troubleshoot, and optimize Spark jobs, Delta Lake tables, and query execution times to support high-throughput, low-latency clinical platform workflows.
Requirements:
- 4+ years of hands-on experience building production data pipelines and lakehouse architectures using Databricks, Delta Lake, and Apache Spark (PySpark or Scala).
- Demonstrated experience building, extending, or maintaining custom software applications for clinical trials (e.g., custom EDC, CTMS, Clinical Data Repositories, or eCOA/ePRO platforms).
- Deep understanding of clinical data standards and regulatory environments, including CDISC (SDTM, ADaM, CDASH), 21 CFR Part 11, GxP validation, and ICH-GCP guidelines.
- Strong experience with relational schema design, dimensional modeling, and unstructured data handling within Delta Lake environments.
- Proficiency in Python, SQL, RESTful API integrations, CI/CD pipelines, Git, and automated testing frameworks.
- Experience working in cloud environments (AWS preferred, Azure or GCP).
- Advanced English to discuss technical requirements and solutions with clients in the United States
Benefits:
- Remote-first culture – work from anywhere!
- AWS, DBT, Google Cloud, Azure & Databricks certifications fully covered
- In-Company English Lessons.
- Birthday off + an extra vacation week (Mutt Week! 🏖️)
- Referral bonuses – help us grow the team & get rewarded!
- Maslow: Monthly credits to spend in our benefits marketplace.
- Annual Mutters' Trip – an unforgettable getaway with the team!
- Monthly Childcare Reimbursement – Because supporting families matters too
Similar Jobs
Data Engineer – Mid-Level
Mid-level Data Engineer building AI/ML data systems for Ignite Digital’s national security and Navy IT clients. Designing pipelines, models, dashboards, and integrations using Python, SQL, and QLIK Advana.
Senior Data Platform Engineer
Senior Data Platform Engineer building DEFCON AI’s durable, explainable data platform for resilient optimization. Preserving provenance, uncertainty, source disagreements, and point-in-time entity histories.
Senior Data Engineer
Senior Data Engineer designing banking data pipelines across AWS, Oracle, Airflow, dbt, and SAP. Modernizing legacy systems through Data Mesh and Medallion architectures.
Senior Data Engineer
Senior Data Engineer building BigQuery and Dataform pipelines for Avenga, an AI-focused international engineering firm. Migrating ETL workflows and modernizing analytics across cloud and on-premises systems.
Senior Big Data Architect
Senior Big Data Architect designing Cloudera, Kafka, and AWS data platforms for banking clients. Leading enterprise-scale streaming, integration, governance, and architecture standards.
Senior EDW Data Architect
Senior EDW Data Architect designing Teradata enterprise data warehouses for regulated banking clients. Leading governance, data modelling, SQL validation, and delivery support in a remote EU contract.
Data Architect – Microsoft Fabric
Microsoft Fabric Data Architect designing secure enterprise data platforms for Argano, a digital consultancy. Leading Fabric landing zones, analytics, governance, and generative AI architecture.
Senior Data Platform Engineer, Enterprise Merchant Integrations
Senior Data Platform Engineer building reliable AWS merchant integrations for Extend’s AI-driven post-purchase retail platform. Developing event-driven data systems, onboarding tooling, and error reporting.
Senior Data Engineer
Senior Data Engineer building ingestion, data quality, and graph infrastructure for Inflect’s digital infrastructure marketplace. Scaling InfraSpec and RouteFinder platforms across global teams.
Data Engineer – Reporting & Analytics
Data Engineer modernizing enterprise reporting and analytics for a global technology team. Building Tableau solutions, SQL datasets, pipelines, and cloud data platforms.
Software Engineer – Research Data Platform
Software Engineer building scalable data systems and APIs for Bioptimus’s universal biology AI foundation model. Optimizing storage, databases, and infrastructure for research and product teams.
Data Engineer, Snowflake
Senior Backend/Data Engineer building scalable Python, Django, and Snowflake data platforms. Supporting Addepto’s AI consulting and data engineering solutions for global enterprises and startups.
Master’s Scholarship Fellow, Data Engineering
Bolsista de mestrado pesquisando timelines inteligentes, eventos temporais e engenharia de dados para o Itaú. Desenvolvendo arquiteturas e protótipos de contexto para oportunidades baseadas em eventos.
Master’s Scholarship Researcher – Customer Timeline, Temporal Events, Data Engineering
Master’s researcher developing temporal data and event-driven architectures for Itaú’s intelligent customer timeline. Supporting prototypes for event-based opportunities and customer journeys.
Senior AI/Data Engineer, Data Platforms, Machine Learning, Applied AI
Senior AI/Data Engineer leading Azure data platforms, machine learning, and LLM applications. Delivering secure, governed solutions for federal agencies and other clients.
AI/Data Engineer, Mid-Level – Python, Azure Data, ML Pipelines
AI/Data Engineer building Python ETL workflows, Azure data services, and ML-ready infrastructure. Supporting federal and regulated clients with scalable, governed data platforms.
Software Developer, Data Engineer
Software Developer & Data Engineer building WISEcode’s food intelligence lakehouse. Designing ingestion, entity resolution, and data pipelines powering food decisions.
Data Engineer, AI & Analytics
Data Engineer building unified, AI-ready marketing data foundations for Power Digital, an AI-native growth firm. Owning ingestion, dbt modeling, semantic layers, and production pipelines.
Lead Data Engineer
Lead Data Engineer directing Microsoft Fabric, Python, and PySpark data engagements for CreateFuture, an AI-native consulting partner. Leading teams, architecture, pipelines, and client delivery.
Senior Data Operations Engineer
Senior Data Operations Engineer managing Snowflake health, performance, and costs for Anvilogic’s AI cybersecurity platform. Onboarding customers and supporting Snowflake and Databricks production environments.