Data Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Data Engineer building scalable Azure and Snowflake data platforms for Datavail’s data management and cloud services. Developing pipelines, warehouses, lakes, and analytics solutions.
Responsibilities:
- Design, develop, and maintain scalable data engineering solutions on Azure and Snowflake platforms
- Build and optimize ETL/ELT pipelines using Azure Data Factory, Databricks, and Snowflake for structured and unstructured data
- Develop and maintain enterprise data warehouses, data marts, and analytical datasets for reporting, BI, and advanced analytics
- Implement data transformation and orchestration using PySpark, SQL, Python, and Snowflake stored procedures
- Design and manage cloud-based data lakes using ADLS Gen2 and Delta Lake
- Collaborate with business stakeholders, data analysts, and architects to translate requirements into scalable data solutions
- Monitor and optimize pipeline performance for reliability, scalability, and cost efficiency
- Implement data quality frameworks, validation rules, and monitoring processes
- Manage Snowflake databases, schemas, warehouses, tasks, streams, and data-sharing capabilities
- Develop dimensional and normalized data models
- Implement security controls, access management, encryption, and governance policies across Azure and Snowflake
- Support cloud migration and modernization from on-premises or legacy platforms
- Automate deployments using Azure DevOps, Git repositories, and CI/CD pipelines
- Troubleshoot production issues, perform root cause analysis, and resolve data-related challenges
- Participate in Agile ceremonies, code reviews, and technical design discussions
- Create technical documentation, architecture diagrams, operational runbooks, and knowledge-transfer materials
- Datavail provides data management, application development, analytics, and cloud services through a technology-enabled delivery platform
Requirements:
- 6+ years of experience designing, developing, and optimizing enterprise-scale data platforms using Microsoft Azure and Snowflake
- Proven expertise in building scalable data pipelines, data warehouses, and analytics solutions leveraging Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics, Snowflake, Python, SQL, and Spark
- Experience in data modeling, ETL/ELT development, cloud migration, performance tuning, data governance, and CI/CD practices
- Strong background integrating data from multiple sources and enabling business intelligence and advanced analytics solutions
- Knowledge of Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics, Snowflake Data Cloud, Python, PySpark, SQL, ADLS Gen2, Azure Functions, Delta Lake, data warehousing, data modeling, ETL/ELT, CI/CD, Azure DevOps, Git, performance tuning, data governance, security, Power BI integration, and Agile/Scrum methodologies
- Microsoft Certified: Azure Data Engineer Associate (DP-203) preferred
- SnowPro Core Certification preferred
Similar Jobs
Data Engineer II – Library Systems
Data Engineer II building ETL pipelines, metadata systems, and AI-ready data platforms for Johns Hopkins Libraries. Supporting research, analytics, data quality, and library operations.
Senior Data Engineer
Senior Data Engineer building clinical data pipelines and cloud applications for Providence’s healthcare system. Supporting data-driven operations with modern engineering, analytics, and AI technologies.
Data Engineering Analyst
Data Engineering Analyst optimizing Servus Credit Union’s data warehouse, pipelines, integrations, and analytics infrastructure. Supporting data-driven financial services for Alberta members.
Senior Cloud Data Engineer
Senior Cloud Data Engineer building secure cloud data systems for BMC. Designing pipelines, data warehouses, ETL processes, and cloud-based data solutions.
Senior Backend Engineer - Data Platform
Backend Developer building TypeScript and Node.js data services for NaNLABS’ insurance wildfire-risk platform. Designing integrations, ingestion pipelines, and reliable PostgreSQL systems.
Data Engineering Intern
Data Engineering Intern building scalable ELT pipelines and data models at Super.com, a consumer fintech platform. Ensuring data quality, governance, and operational reliability for high-volume datasets.
Data Warehouse, Analytics Architect
Data warehouse architect designing scalable lakehouse and analytics infrastructure for Virtru’s secure data-sharing platform. Leading SRE, technical architecture, and engineering mentorship.
Presales Data Architect, Modern Data Stack, AI
Presales Data Architect diseñando arquitecturas Modern Data Stack y AI para Reclut, marketplace de reclutamiento con IA. Liderando preventa, PoCs y conexión entre clientes y equipos de delivery.
Senior Data Engineer – MS Fabric
Senior Data Engineer building Azure data platforms and ETL pipelines for Keyrus, a global data, digital, and AI consulting company. Supporting enterprise analytics, reporting, and master data management.
Data Architect
Data Architect designing Lakeside's enterprise data architecture for BI, analytics, and AI. Leading Snowflake, data modeling, governance, and resilient integration solutions.
Software Engineer – Agentic Data Pipelines
Software engineer building agentic LLM systems for biomedical data acquisition, curation, and quality control. Supporting Iambic Therapeutics’ AI-driven drug discovery platform and Enchant model training.
Engineer III – Platform Data Engineer
Platform Data Engineer building and operating CrowdStrike's cybersecurity analytics infrastructure. Managing Airflow, Terraform, CI/CD, cloud platforms, and data security at scale.
Lead Forward Deployed Engineer – Data Science, Integration
Forward Deployed Engineer at Salesforce, the AI CRM company, building ML, API integrations, and workflows for defense and intelligence customers. Leading secure, customer-site mission delivery.
Principal Architect, Data Architecture
Principal Data Architect designing data platforms, models, and pipelines for Endava’s technology consulting clients. Translating business needs into scalable analytics and cloud architecture.
Senior Azure Data Architect
Azure Data Architect designing secure, scalable Azure warehouses, lakes, and pipelines for IT services company Exavalu. Leading ingestion, governance, and big-data processing architecture.
Data Engineer II
Data Engineer II building ETL pipelines, data models, and scalable platforms for Ncontracts’ financial risk and compliance solutions. Supporting analytics, reporting, performance, and team mentorship.
Data Engineer – Health Data Metrics
Data Engineer building AWS data pipelines and healthcare quality metrics infrastructure for Keebler Health’s value-based care platform. Integrating FHIR, population health, and HIPAA-compliant data systems.
Mid-Level Data Engineer
Engenheiro de Dados desenvolvendo pipelines batch e streaming na Spread Tecnologia. Otimizando data lakes, ETL/ELT e governança em ambientes GCP e AWS.
Senior Data Engineer
Engenheiro de Dados Sênior construindo pipelines Big Data para a Reply, multinacional de consultoria e soluções de TI. Processamento distribuído em AWS e colaboração com equipes de análise e ciência de dados.
Data Architect
Data Architect designing and building Databricks and Microsoft Fabric lakehouse platforms for Pythian’s data transformation clients. Owning ingestion, governance, modeling, pipelines, and analytics delivery.