Senior Data Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Data Engineer leading Microsoft Fabric pipelines, security, automation, and medallion architectures. Supporting Rackner’s mission-critical software systems for U.S. government agencies.
Responsibilities:
- Lead the design, development, and optimization of enterprise data ingestion pipelines, transformation logic, and data platform components within Microsoft Fabric
- Design and implement scalable ETL and ELT architectures for structured and semi-structured enterprise data
- Configure, administer, and maintain Microsoft Fabric tenants, workspaces, capacities, security, and governance
- Implement Bronze, Silver, and Gold medallion architecture layers
- Develop transformation processes with schema validation, cleansing, normalization, enrichment, and reconciliation
- Establish data quality monitoring, validation controls, automated testing, and alerting
- Design environment separation across development, test, staging, and production
- Build and maintain CI/CD deployment pipelines for data platform artifacts
- Implement infrastructure-as-code for repeatable, version-controlled deployments
- Develop and optimize Spark, PySpark, SQL, and related data-processing workloads
- Configure and maintain encryption, RBAC, Microsoft Entra ID integration, Privileged Identity Management, and least-privilege controls
- Support secure integration with enterprise source systems and hybrid on-premises/cloud connectivity
- Troubleshoot and optimize pipeline, platform, performance, connectivity, and data-quality issues
- Support disaster recovery and business continuity planning; develop and test rollback, recovery, and restoration procedures
- Establish reusable engineering patterns, standards, and technical documentation
- Collaborate with architects, governance specialists, cybersecurity teams, application teams, and source-system owners
- Participate in architecture reviews and recommend modernization and integration solutions
- Mentor Data Engineers and Associate Data Engineers; review implementations and provide technical guidance
- Provide senior-level problem-solving support and support knowledge transfer and operational transition
Requirements:
- Significant experience designing and implementing enterprise data pipelines, ETL/ELT processes, and cloud-based data platforms
- Hands-on experience with Microsoft Fabric
- Experience administering or configuring enterprise cloud data environments
- Strong experience with Azure Data Factory or comparable data integration technologies
- Strong SQL proficiency
- Experience with Spark and PySpark for large-scale data processing and transformation
- Experience implementing enterprise ETL/ELT frameworks
- Experience designing and implementing medallion architectures using Bronze, Silver, and Gold data layers
- Experience with schema validation, data cleansing, normalization, reconciliation, and data quality controls
- Experience developing CI/CD pipelines for data platform deployments
- Experience implementing infrastructure-as-code
- Experience with source control, automated deployment, and environment promotion processes
- Understanding of cloud security principles, including RBAC, identity integration, encryption, and least-privilege access
- Experience troubleshooting complex data pipeline, platform, and integration issues
- Experience supporting production data environments with availability, reliability, and performance requirements
- Strong technical documentation and communication skills
- Experience mentoring or providing technical leadership to other engineers
- Active Secret clearance
Benefits:
- Company-supported certifications aligned to current and future program work, including cloud, Kubernetes, DevSecOps, security, AI/ML, project management, and related technical areas
- Clear advancement tracks and future leadership opportunities
- 401(k) with 100% match up to 6%
- Comprehensive medical, dental, vision, life, and disability coverage
- Generous PTO and paid holidays
- Home-office equipment plan and remote work support
- Fitness and wellness reimbursement
- Weekly pay schedule
- Modern perks, including team events
Similar Jobs
Senior Data Engineer, Snowflake
Senior Data Engineer migrating Hadoop/Hive workflows into Snowflake for Keyrus, an international AI and data consulting group. Designing scalable cloud data platforms and automated migration processes.
Data Engineer
Data Engineer building Microsoft Fabric pipelines and Ed-Fi integrations. Supporting Rackner’s mission-critical U.S. government and national security systems.
Lead Data Engineer – Databricks
Data Engineer Lead leading cloud data migrations with Databricks, Python, and Spark. Building Big Data and Machine Learning systems for Muttdata’s clients.
Director of Data Engineering – M4
Director leading secure data platforms and AI-enabled engineering for ClassLink’s education technology products. Building engineering teams, cloud architectures, governance, and reliable data services for schools.
Principal Data Platform Engineer – Swedish Ad Platform
Principal Data Platform Engineer building an AI-first event-driven lakehouse for a global AdTech company. Defining scalable data architecture, governance, pipelines, and AI-ready data products.
Principal Data Platform Engineer – Swedish Ad Platform
Principal Data Platform Engineer building an AI-first data platform for a global AdTech company. Designing event-driven lakehouse architecture, governed data products, and scalable analytics infrastructure.
Senior Clinical Data Engineer
Senior Clinical Data Engineer designing regulated data solutions for Parexel's clinical trials. Leading ingestion, validation, reporting, and technical teams in Hyderabad.
Cúram Technical Consultant – Data Migration
Cúram Technical Consultant designing and testing data migrations for PLATO, Canada’s Indigenous-owned software testing and technology services company. Supporting Agile delivery, Azure DevOps, CI/CD, and test automation.
Senior Data Engineer
Senior Data Engineer building scalable pipelines and data platforms for Moniepoint, Africa’s all-in-one financial platform. Optimising cloud data systems, accuracy, and model performance.
Staff Data Engineer – Mission Data Platform
Staff Data Engineer architecting scalable pipelines and data products for LMI’s secure U.S. Army platform. Integrating distributed systems and mentoring engineers.
Senior Data Engineer
Senior Data Engineer leading Azure data architecture, pipelines, and warehouse implementations. Mentoring technical teams and delivering cloud data solutions for clients in the Philippines.
Lead Consultant, Data Architecture – Engineering
Lead consultant designing Azure data architectures, data warehouses, and pipelines. Providing technical leadership and engineering solutions for clients in the Philippines.
Talent Acquisition Data Engineering & Analytics Intern
Graduate intern building Snowflake data pipelines, dimensional models, and Power BI dashboards for Solidigm’s global memory business. Automating Talent Acquisition reporting and analytics.
Senior Data Engineer
Senior Data Engineer building scalable data infrastructure for Atom Learning’s personalised education products. Developing pipelines, models and predictive learning features used by students, teachers and schools.
Senior Staff Data Engineer
Senior Staff Data Engineer shaping distributed data systems for SmithRx’s pharmacy benefits platform. Driving data strategy, governance, quality, and engineering-wide technical excellence.
Data Engineer
Data Engineer building scalable pipelines and centralized data platforms for XTB’s online financial trading business. Developing integrations, infrastructure, and data quality standards.
Associate Data Engineer
Associate Data Engineer building data pipelines, warehouses, and BI datasets for TaskUs’s outsourced digital services. Supporting ETL automation, data quality, modeling, testing, and monitoring.
Senior Rust Data Engineer
Senior Rust Data Engineer architecting high-throughput data services and ingestion pipelines for Nagarro’s digital product engineering company. Building low-latency infrastructure integrated with cloud warehouses and lakehouses.
Software Engineer, Data Systems/ETL
Software Engineer developing data systems and ETL software remotely from India. Producing code, unit tests, documentation, technical specifications, and proof of concepts.
Data Engineer – Databricks, Power BI
Data Engineer building Databricks applications and Power BI dashboards for Qualysoft, an international IT consulting and services company. Automating enterprise data integrations for energy and other industry clients.