Data Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Data Engineer building Snowflake and Azure claims data infrastructure for ProgenyHealth. Supporting healthcare analytics, reporting, security, and reliable enterprise data pipelines.
Responsibilities:
- Design, build, and optimize the Claims Data Warehouse in Snowflake
- Build continuous and batch ingestion into Snowflake using Snowpipe, COPY INTO, external stages, and Azure Blob Storage/ADLS Gen2
- Implement incremental and near-real-time processing with Snowflake Streams, Tasks, and Dynamic Tables, including CDC, schema drift handling, and error recovery
- Implement medallion architecture from raw claim ingestion through standardized, deduplicated claim data to analytics-ready marts
- Tune Snowflake performance and cost using warehouse sizing, Query Profile, clustering keys, search optimization, materialized views, and resource monitors
- Enforce Snowflake security and governance, including RBAC, dynamic data masking, row access policies, object tagging, and secure data sharing
- Use Snowflake Time Travel, Fail-safe, zero-copy cloning, and replication for backup, recovery, testing, and BCDR
- Write SQL, Snowpark, and stored procedures for ETL/ELT of large claims data volumes
- Model claim header and claim line structures and manage the full claim lifecycle
- Apply and maintain healthcare code sets and reference data
- Develop claims-based data products for utilization management, case management, cost and trend analysis, PMPM reporting, provider and network analytics, quality measures, risk adjustment, and financial reporting
- Perform claims data quality and reconciliation checks, including financial balancing, duplicate detection, eligibility matching, and completeness/timeliness validation
- Partner with claims, medical management, actuarial, finance, and analytics stakeholders
- Build, schedule, and monitor ADF ETL/ELT pipelines with parameterization, alerting, and retry logic
- Use Azure services including ADLS Gen2/Blob Storage, Key Vault, Microsoft Entra ID, Azure Monitor, and Azure SQL/SQL Server
- Maintain and migrate SSIS packages and modernize them into ADF and Snowflake patterns
- Contribute to CI/CD, Git, Azure DevOps, and infrastructure-as-code practices
- Use AI tools such as Snowflake Cortex, GitHub Copilot, Microsoft Copilot in Fabric, and LLM-based assistants
- Optimize SQL queries and database structures across Snowflake and SQL Server
- Develop and maintain data pipelines between source systems and the EDW and integrate data services with applications and business systems
- Monitor platform health, performance, latency, data freshness, and storage; manage security, backup, and recovery
- Keep current with Snowflake, cloud data engineering, healthcare data standards, and SQL optimization best practices
Requirements:
- Bachelor's degree in computer science, Information Technology, or a related field
- 10 or more years of experience in a healthcare environment, with a focus on SQL and Enterprise Data Warehousing
- Hands-on experience with Snowflake, including Snowpipe, Streams and Tasks, Dynamic Tables, COPY INTO, RBAC, masking and row access policies, warehouse sizing and performance tuning, and secure data sharing
- Experience implementing medallion architecture (Bronze, Silver, and Gold layers) in Snowflake or another cloud data warehouse/lakehouse environment
- Extensive hands-on experience with medical claims data, including claim header/line structures, adjustments and reversals, and eligibility/enrollment data
- Working knowledge of X12 EDI healthcare transactions (837, 835, 834, 270/271, 276/277) and claim forms (CMS-1500, UB-04)
- Strong command of healthcare code sets and reference data, including ICD-10, CPT/HCPCS, revenue codes, DRG, NDC, and place of service
- Experience building claims-based analytics and reporting, such as utilization, cost and trend, PMPM, risk adjustment, and quality measures (e.g., HEDIS)
- Hands-on experience with Azure Data Factory (ADF) and Azure data services such as ADLS Gen2/Blob Storage, Key Vault, and Azure DevOps
- Experience with SQL Server Integration Services (SSIS) and SQL Server (preferred), particularly in maintaining or migrating legacy packages
- Strong knowledge of data modeling and database design principles, including dimensional modeling and handling slowly changing dimensions and claim versioning
- Understanding of data security, privacy, backup, and recovery procedures (i.e., BCDR), including HIPAA and handling of PHI/PII
- Experience with Git-based version control and CI/CD (Azure DevOps or similar)
- Knowledge of Agile methodologies and experience working in Agile environments
- Strong communication skills working across business functions, including clinical, claims, and finance teams
- Manage multiple projects, issues, and deliverables in a fast-paced environment
- Able to multi-task and prioritize work to meet deadlines
- Excellent listening, critical thinking, written and verbal skills
- Works well within a team environment
- Experience working in a professional environment with clinical managed care concepts, practices, and procedures preferred
Benefits:
- Paid Time Off
- Paid Parental Leave
- Medical, dental, vision benefits
- 401K with company match
- Short- and Long-Term Disability
- Group Life Insurance
- Tuition Reimbursement
- Pet Insurance
- Professional development opportunities
- Business Casual work environment
Similar Jobs
Data Engineer
Data Engineer building scalable pipelines and analytics warehouses for Troveo’s licensed AI training data platform. Supporting data modeling, quality, reporting, and reliable delivery to AI teams.
Data Engineering Lead
Data Engineering Lead guiding engineers and consolidating Oxford Global Resources’ Azure and Microsoft Fabric data platform. Owning architecture, ETL reliability, governance, and delivery.
Principal Engineer – Data Retrieval
Principal Engineer architecting web-scale crawling, ingestion, and retrieval infrastructure for NVIDIA’s foundation AI models. Leading distributed systems design, production scaling, and high-quality pretraining data delivery.
IT Data Science Principal, Data Warehouse
Leading enterprise data warehouse, analytics, and AI capabilities for Cornerstone Building Brands, a North American building-products manufacturer. Driving roadmaps, governance, modernization, and multidisciplinary delivery.
Data Engineer
Data Engineer building reliable pipelines for Branch’s fintech platform, which accelerates payments and provides financial services. Using Python, SQL, Airflow, Snowflake, DBT, and GCP.
Data Engineer
Data Engineer building reliable pipelines and transformations for Definitive Healthcare’s healthcare data products. Supporting Claims and Consumer domains with Python, SQL, Spark, and cloud platforms.
Senior Data Platform Engineer
Senior Data Platform Engineer building scalable data lakes, ingestion pipelines, and Kubernetes infrastructure. Supporting analytics, product applications, AI workloads, and large-scale model execution.
Medical Receptionist, Data Migration Specialist
Remote medical receptionist and data migration specialist transferring patient records from Elation Health to Dakota Health. Supporting U.S. practice scheduling, patient calls, and administrative workflows.
Data Engineer
Data Engineer building Azure Databricks pipelines for credit-card data at CGI, a global IT and business consulting firm. Modernizing financial data platforms and controls.
Working Student – Data Engineering
Working Student building Python and SQL data pipelines for AgentixLake’s cloud data and AI engineering projects. Supporting data quality, lakehouse platforms, testing, and monitoring.
Data Engineer – Temporary
Data Engineer building reliable Zuora-to-GCP ETL pipelines for Applaudo’s AI-powered solutions. Maintaining integrations, data quality, monitoring, and warehouse validation in an async distributed team.
WEKA Data Platform Administrator
WEKA Data Platform Administrator operating NeuralMesh enterprise AI data infrastructure for GPU-cloud customers. Managing storage, Kubernetes, networking, automation, and customer workload performance.
Analytics Engineer – Data Platform
Analytics Engineer building Snowflake and dbt models for Aline’s senior-living resident lifecycle platform. Creating governed data foundations for BI reporting and AI-driven care outcomes.
Senior Data Engineer – Mid Shift
Data Engineer building AWS and Snowflake platforms for Shore360, an Australian-owned Philippine staffing and administrative support firm. Developing reliable pipelines, APIs, and data quality controls.
Senior Software Engineer, Data Infrastructure – RDBMS
Senior engineer operating petabyte-scale PostgreSQL infrastructure for TRM Labs’ AI-powered crime-intelligence platforms. Automating database operations, optimizing performance, and managing CDC pipelines remotely across LATAM.
Data Architect
Databricks Data Architect designing secure Lakehouse architectures and AI-ready data platforms for Devoteam clients. Modernizing legacy systems across cloud and multi-cloud environments.
Senior Data Engineer
Senior Data Engineer building auditable GCP data pipelines for DysrupIT’s financial billing and invoicing platform. Ensuring accurate reconciliation, lineage, and trusted financial data.
Senior Software Engineer, Data Acquisition
Senior software engineer building distributed crawling and ingestion systems for People Data Labs, a provider of people and company data. Improving scalable backend services and data products.
IT Architect, Data Scientist
IT Architect/Data Scientist supporting DLH’s federal health and national-security programs. Leading cloud architecture, data science, interoperability, security engineering, and compliance for SCHARE.
Senior Business Data Engineer
Senior Business Data Engineer building AWS data infrastructure and automated reporting for Nex’s family motion-gaming platform. Improving pipeline reliability and supporting cross-functional business teams.