Senior Data Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Data Engineer developing scalable data pipelines and supporting AI/ML initiatives in digital healthcare space. Collaborating with cross-functional teams to deliver reliable data solutions.
Responsibilities:
- Design, build, and maintain scalable data pipelines using Python, Apache Airflow, and Apache Spark
- Analyze business and technical requirements and translate them into reliable, future-proof data solutions
- Develop, validate, deploy, and support complex ETL/ELT pipelines at scale
- Build clean, secure, and maintainable REST APIs following company standards
- Implement real-time and batch processing solutions for diverse data sources
- Develop reusable data engineering and AI frameworks for enterprise-wide adoption
- Define and manage domain-based “source of truth” data models, ensuring scalability and end-to-end data lineage
- Implement data governance practices, automate data quality checks, and enable pipeline testing
- Optimize data infrastructure for performance, cost efficiency, and reliability
- Manage source control, CI/CD pipelines, and production deployments
- Partner with data scientists and analysts to support AI/ML initiatives
Requirements:
- Bachelor’s degree (or higher) in Computer Science, Data Engineering, or a related field
- 10+ years of experience in data engineering or related roles
- Strong proficiency in Python and related libraries (Pandas, SQLAlchemy, Boto3, Paramiko, Flask, FastAPI)
- Advanced SQL skills with experience analyzing healthcare datasets (e.g., claims, provider directories)
- Hands-on experience with orchestration tools such as Apache Airflow and Databricks Workflows
- Strong experience with Apache Spark; exposure to Apache Flink is a plus
- Experience integrating with .NET applications and working with SQL Server
- Cloud platform experience (AWS, Azure, or GCP required)
- Experience with data warehousing solutions such as Amazon Redshift or Vertica
- Solid understanding of distributed systems and functional programming concepts
- Proficiency with Git and modern CI/CD practices
- Exposure to streaming technologies, containerization, and ML pipelines preferred
- Familiarity with AI tools and large language models is a plus
Benefits:
- Equal Opportunity Employer
- E-Verify user
- Work-life balance
Similar Jobs
Principal Data Engineer
Data Engineer leading teams to innovate technology in federal government. Working on scalable data pipelines using modern tech in an agile environment.
Staff Data Engineer
Staff Data Engineer at Zeta Global leading the design and implementation of a unified semantic data layer. Focused on integrating diverse data sources for enhanced AI and analytics capabilities.
Senior Data Engineer
Senior Data Engineer at Sightline Payments, overseeing data engineering and cloud-based solutions. Collaborating across teams to prepare and deliver complex data sets for improving customer-centric omnichannel experience.
Data Engineer
Júnior Data Engineer supporting SQL Server Data Warehouse, developing ETL routines and data models. Collaborating with Product, Engineering, and Analytics teams in a growing environment.
AVP, Data Engineering
AVP of Data Engineering owning Ensemble’s enterprise data platform strategy. Leading cloud-native data platform design on Azure and Databricks for scalable analytics and AI capabilities.
Data Engineer
Data Engineer developing and maintaining data pipelines and transformation models for analytics at Industrial Electric Manufacturing. Collaborating with stakeholders and ensuring data quality across business decisions.
Senior Data Engineering Manager
Senior Manager of Data Engineering leading a team that manages data at ReUp Education. Empowering adult learners and institutions by developing data solutions and pipelines.
Director, Data Engineering, ML – AI
Director of Data Engineering leading ML and AI initiatives for Measurabl. Responsible for data platform strategy and sustainability analytics in commercial real estate.
Data Engineer
Data Engineer responsible for building foundational infrastructure for AI deployments and product launches. Collaborating with top researchers and engineers in cutting-edge AI systems.
Data Engineer
Data Engineer at OrderlyMeds connecting multiple systems to BigQuery for strategic insights. Collaborating with a cross-functional team to enhance data utility and drive business decisions.
Data Engineer/Software Engineer
Data Engineer/Software Engineer responsible for implementing data-driven solutions and managing data pipelines. Join ALTEN Technology USA to work on challenging engineering projects.
Data Engineering Manager
Engineering leader managing Data Engineering team at Northrop Grumman. Overseeing data systems and leading a collaborative team to ensure engineering excellence.
Data Engineer
Senior Data Engineer serving in Prima's engineering team, building scalable data products and maintaining pipelines for optimal growth. Engaging in innovative solutions to transform motor insurance experience.
Senior Data Engineer
Senior Data Engineer leading design discussions and driving technical vision for healthcare data solutions. Collaborating cross-functionally to ensure high standards and timely project delivery.
Senior Analytics Data Engineer
Full Stack Engineer developing scalable applications for the largest real-world healthcare datasets provider. Collaborating with an international team under technical leadership for critical platform enhancements.
Director – Data Engineering
Director leading and scaling data engineering function for a Weekday's client. Building efficient data platforms powering analytics and business intelligence across the organization.
Data Engineer
Data Engineer building and maintaining data pipelines for marketing and analytics at an EdTech app with 70 million users. Collaborating with analysts and business teams for data quality and reporting.
Data Engineer
Data Engineer responsible for managing data infrastructure at Bemobi with innovative solutions for data access and analysis. Join the Data Platform team to enhance data lifecycle processes.
Senior Lead Software Engineer, Data Platform
Senior Software Engineer building scalable data and analytics platforms at Coupa. Focusing on advanced data ingestion and processing in a multi-cloud environment.
Workday/Fabric Data Engineer
Workday/Fabric Data Engineer supporting USNH's business intelligence initiatives by designing and maintaining data solutions. Collaborating with teams for effective reporting and analytics.