Data Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Data Engineer building Microsoft Fabric pipelines and Ed-Fi integrations. Supporting Rackner’s mission-critical U.S. government and national security systems.
Responsibilities:
- Develop and maintain data ingestion pipelines, transformation logic, and data quality processes within Microsoft Fabric
- Implement and maintain Bronze, Silver, and Gold medallion architecture layers for assigned data domains
- Extract, transform, and load data from student information, HR/personnel, financial, logistics, IT service management, and operational systems
- Develop ETL and ELT pipelines into the Microsoft Fabric Lakehouse
- Build and maintain data integration pipelines, API connections, and automated synchronization processes
- Develop Ed-Fi REST API integrations and Aspen-to-Ed-Fi mappings, descriptor customization, transformation logic, and synchronization
- Perform source-system data profiling, mapping, cleansing, transformation, reconciliation testing, and validation
- Troubleshoot and resolve data quality, pipeline, and integration issues
- Develop SQL queries, Python or PySpark processing logic, and reusable transformation components
- Support data population, migration, and Ed-Fi Data Management Service migration planning
- Produce and maintain technical documentation
- Collaborate with data architects, analysts, governance specialists, application teams, and source-system owners
- Support knowledge transfer and operational transition activities
Requirements:
- Experience developing data pipelines, ETL/ELT processes, and data integrations
- Experience with Microsoft Fabric, Azure Data Factory, or comparable cloud data platforms
- Strong SQL proficiency, including querying, transformation, validation, and troubleshooting
- Experience with Python and/or PySpark for data engineering workloads
- Experience working with structured and semi-structured enterprise data
- Understanding of cloud-based data lake, lakehouse, or data warehouse architectures
- Experience with data mapping, data profiling, reconciliation testing, and data quality processes
- Experience integrating systems through REST APIs or similar application interfaces
- Ability to document data flows, pipeline configurations, mappings, and technical processes
- Strong troubleshooting, analytical, and communication skills
- Active Secret clearance
- Preferred: Experience with Microsoft Fabric Lakehouse architecture
- Preferred: Experience implementing Bronze, Silver, and Gold medallion data architectures
- Preferred: Experience with the Ed-Fi Data Standard, Ed-Fi ODS/API, or Ed-Fi REST APIs
- Preferred: Experience performing Aspen-to-Ed-Fi mapping or integrating other student information systems with Ed-Fi
- Preferred: Experience with HR/DCPDS, financial, logistics, or IT service management data
- Preferred: Experience supporting large-scale cloud data migrations or modernization initiatives
- Preferred: Familiarity with data governance, metadata management, lineage, and enterprise data quality practices
Benefits:
- Company-supported certifications aligned to current and future program work, including cloud, Kubernetes, DevSecOps, security, AI/ML, project management, and related technical areas
- Clear advancement tracks and future leadership opportunities
- 401(k) with 100% match up to 6%
- Comprehensive medical, dental, vision, life, and disability coverage
- Generous PTO and paid holidays
- Home-office equipment plan and remote work support
- Fitness and wellness reimbursement
- Weekly pay schedule
- Modern perks, including team events
Similar Jobs
Senior Data Engineer, Snowflake
Senior Data Engineer migrating Hadoop/Hive workflows into Snowflake for Keyrus, an international AI and data consulting group. Designing scalable cloud data platforms and automated migration processes.
Senior Data Engineer
Senior Data Engineer leading Microsoft Fabric pipelines, security, automation, and medallion architectures. Supporting Rackner’s mission-critical software systems for U.S. government agencies.
Lead Data Engineer – Databricks
Data Engineer Lead leading cloud data migrations with Databricks, Python, and Spark. Building Big Data and Machine Learning systems for Muttdata’s clients.
Director of Data Engineering – M4
Director leading secure data platforms and AI-enabled engineering for ClassLink’s education technology products. Building engineering teams, cloud architectures, governance, and reliable data services for schools.
Principal Data Platform Engineer – Swedish Ad Platform
Principal Data Platform Engineer building an AI-first event-driven lakehouse for a global AdTech company. Defining scalable data architecture, governance, pipelines, and AI-ready data products.
Principal Data Platform Engineer – Swedish Ad Platform
Principal Data Platform Engineer building an AI-first data platform for a global AdTech company. Designing event-driven lakehouse architecture, governed data products, and scalable analytics infrastructure.
Senior Clinical Data Engineer
Senior Clinical Data Engineer designing regulated data solutions for Parexel's clinical trials. Leading ingestion, validation, reporting, and technical teams in Hyderabad.
Cúram Technical Consultant – Data Migration
Cúram Technical Consultant designing and testing data migrations for PLATO, Canada’s Indigenous-owned software testing and technology services company. Supporting Agile delivery, Azure DevOps, CI/CD, and test automation.
Senior Data Engineer
Senior Data Engineer building scalable pipelines and data platforms for Moniepoint, Africa’s all-in-one financial platform. Optimising cloud data systems, accuracy, and model performance.
Staff Data Engineer – Mission Data Platform
Staff Data Engineer architecting scalable pipelines and data products for LMI’s secure U.S. Army platform. Integrating distributed systems and mentoring engineers.
Senior Data Engineer
Senior Data Engineer leading Azure data architecture, pipelines, and warehouse implementations. Mentoring technical teams and delivering cloud data solutions for clients in the Philippines.
Lead Consultant, Data Architecture – Engineering
Lead consultant designing Azure data architectures, data warehouses, and pipelines. Providing technical leadership and engineering solutions for clients in the Philippines.
Talent Acquisition Data Engineering & Analytics Intern
Graduate intern building Snowflake data pipelines, dimensional models, and Power BI dashboards for Solidigm’s global memory business. Automating Talent Acquisition reporting and analytics.
Senior Data Engineer
Senior Data Engineer building scalable data infrastructure for Atom Learning’s personalised education products. Developing pipelines, models and predictive learning features used by students, teachers and schools.
Senior Staff Data Engineer
Senior Staff Data Engineer shaping distributed data systems for SmithRx’s pharmacy benefits platform. Driving data strategy, governance, quality, and engineering-wide technical excellence.
Data Engineer
Data Engineer building scalable pipelines and centralized data platforms for XTB’s online financial trading business. Developing integrations, infrastructure, and data quality standards.
Associate Data Engineer
Associate Data Engineer building data pipelines, warehouses, and BI datasets for TaskUs’s outsourced digital services. Supporting ETL automation, data quality, modeling, testing, and monitoring.
Senior Rust Data Engineer
Senior Rust Data Engineer architecting high-throughput data services and ingestion pipelines for Nagarro’s digital product engineering company. Building low-latency infrastructure integrated with cloud warehouses and lakehouses.
Software Engineer, Data Systems/ETL
Software Engineer developing data systems and ETL software remotely from India. Producing code, unit tests, documentation, technical specifications, and proof of concepts.
Data Engineer – Databricks, Power BI
Data Engineer building Databricks applications and Power BI dashboards for Qualysoft, an international IT consulting and services company. Automating enterprise data integrations for energy and other industry clients.