Data Engineer, Data Quality & Automation
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Data Engineer developing automated data quality pipelines supporting federal programs. Collaborating with data teams to ensure scalable and reliable data solutions within a DevSecOps framework.
Responsibilities:
- Design, develop, and maintain ETL/ELT data pipelines supporting enterprise data platforms.
- Implement and enhance data ingestion, transformation, and integration processes using SQL and modern programming languages.
- Design and implement automated data quality and validation checks (e.g., schema integrity, completeness, freshness, volume).
- Embed data validation and testing logic directly into data pipelines and CI/CD workflows.
- Refactor and modernize existing data pipelines to improve reliability, performance, and maintainability.
- Collaborate with technical leads, architects, and engineering teams to define and promote standard data engineering and quality practices.
- Support deployment, monitoring, and troubleshooting of data pipelines across development, test, and production environments.
- Contribute to technical documentation, runbooks, and reusable components to improve team efficiency and consistency.
- Participate in design and code reviews with a focus on sustainability, automation, and operational excellence.
Requirements:
- Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field, or equivalent experience.
- 5+ years of experience in data engineering, ETL development, or related roles.
- Strong experience with Microsoft SQL Server and enterprise data warehouse or data lake platforms.
- Proficiency in Python or similar scripting languages for automation.
- Hands-on experience building and supporting ETL/ELT pipelines.
- Experience implementing automated data validation or data quality checks within data pipelines.
- Familiarity with CI/CD concepts and tools as applied to data engineering workflows.
- Strong analytical and problem-solving skills.
- Excellent written and verbal communication skills.
- Must be a U.S. Citizen with the ability to obtain a secret clearance.
Benefits:
- bonuses
- employer-paid health care
- training and development funds
- 401(k) match
Similar Jobs
GCP API Data Engineer
Senior Staff Data Engineer designing and building API-driven data platforms on Google Cloud Platform. Collaborating with engineers and scientists to implement best practices and mentor team members.
Principal Data Architect
Principal Data Architect at Committee for Children, defining and evolving data architecture for a social enterprise. Collaborate with teams to ensure data governance and accessibility for child welfare programs.
Senior Data Engineer, Snowflake
Sr. Data Engineer designing and implementing scalable data solutions in Snowflake for clients. Collaborating with teams to translate requirements into actionable technical solutions and optimizations.
Data Engineer – DataOps, Infrastructure Focus
Data Engineer responsible for building and maintaining AWS data infrastructure for Guidewire. Collaborating with teams to support AI-driven analytics and operational excellence.
Data Architect III
Data Architect III managing data strategy and overseeing data collection and organization in a remote setting for Veterans Affairs. Leading data architecture and governance initiatives to improve Veteran services.
Senior Manager, Data Architecture
Senior Manager of Data Architecture ensuring enterprise data is standardized, secure, and well modeled. Overseeing data architecture across platforms and applications and translating business outcomes into data models.
Senior Data Engineer
Senior Data Engineer at Peek transforming data sources into actionable insights for analytics. Collaborating across teams to support business intelligence and enhance data infrastructure.
Senior Data Engineer
Senior Data Engineer building and scaling data infrastructure for Wagmo’s pet health solutions. Collaborate with multiple teams to ensure clean data flows across the business.
Senior Clinical Data Engineer
Senior Clinical Data Engineer overseeing clinical data lifecycle for Oura's research studies. Collaborating with teams to maintain data integrity and regulatory compliance in clinical trials.
Lead Data Engineer
Lead Data Engineer overseeing data platform and analytics engineering teams at OneOncology. Responsible for operational excellence and technical direction in data processing and management.
Senior Data Engineer
Senior Data Engineer at Kainos designing and developing data processing software for large-scale data solutions. Collaborating with agile teams to ensure high code quality and solution effectiveness.
Lead Data Engineer
Lead Data Engineer at Mercator.ai building scalable data infrastructure and distributed data pipelines. Ensuring performance and reliability while mentoring junior engineers.
Data Engineer
Data Engineer at Egen designing and building data processing pipelines using advanced technologies. Collaborating with stakeholders to ensure data accessibility, security, and accuracy.
Data Architect
Data Architect providing data management and analytics support for HRSA's Organ Procurement program. Collaborating on patient safety performance, technical assistance, and data visualization.
AI Data Engineering Lead
AI Data Engineering Lead building data foundations for AI models at Ideagen. Leading a team to ensure data quality, compliance, and operational efficiency.
Cloud Data Architect
Cloud Data Architect at Hunter Strategy responsible for telemetry and data normalization in cybersecurity. Designs log collection and routing architectures for AWS and Azure environments.
Senior Data Engineering Analyst
Data Engineer managing data governance and modernization projects using Databricks at Keeggo. Collaborating with teams to enhance data pipeline architecture and performance.
Senior Data Engineer – AWS
Senior Data Analyst migrating data from SQL Server to AWS SaaS architecture, ensuring data integrity and developing reusable ETL processes.
Senior Data Engineer
Senior Data Engineer at Hyatt developing robust data pipelines and supporting data-driven decisions. Collaborating with cross-functional teams in a dynamic and fast-paced environment.
Senior Data Engineer
Senior Data Engineer designing, building, and maintaining data pipelines for global social discovery products. Collaborating with teams to turn data into insights and optimize data quality.