Data QA Engineer – Microsoft Fabric
Posted 10hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Data QA Engineer validating Microsoft Fabric pipelines, lakehouses, warehouses, and reporting models. Ensuring enterprise data quality through SQL, PySpark, ETL testing, and automation.
Responsibilities:
- Develop test strategies, test plans, test cases, and test scripts based on business and technical requirements
- Ensure testing activities cover key requirements, business rules, and implementation risks
- Use SQL and PySpark to validate source-to-target mappings, data transformations, data types, aggregations, business rules, duplicates, null values, and reconciliation results
- Test data pipelines and integration processes to ensure data is properly extracted, transformed, and loaded into the target environment
- Perform functional, integration, and regression testing across Microsoft Fabric pipelines, notebooks, lakehouses, warehouses, SQL analytics endpoints, and semantic models
- Verify data completeness, accuracy, consistency, referential integrity, and incremental-load behavior across source and target systems
- Validate pipeline performance, processing times, scalability, error handling, logging, monitoring, and recovery processes
- Identify, document, and track defects using Azure DevOps or other approved QA tools
- Work with developers to reproduce issues, validate fixes, and perform retesting
- Develop reusable SQL scripts, PySpark notebooks, reconciliation utilities, and automated regression tests
- Maintain test plans, test cases, traceability matrices, test evidence, defect reports, and testing summaries
- Collaborate with QA, data engineering, development, data analytics, and project management teams to clarify requirements, communicate testing progress, and address data quality issues
Requirements:
- 4+ years of experience in software quality assurance, particularly in data warehouse, ETL/ELT, data integration, or analytics testing
- At least 1 year of hands-on experience testing or validating Microsoft Fabric solutions
- Strong SQL skills, including complex joins, common table expressions (CTEs), aggregations, reconciliation queries, and query troubleshooting
- Hands-on experience with Python or PySpark for data validation, transformations, dataset comparisons, and automated testing
- Experience developing and executing test strategies, test plans, test cases, test scripts, and test reports
- Strong understanding of ETL/ELT processes, data warehousing concepts, data lake/lakehouse architecture, and dimensional modeling
- Experience validating source-to-target mappings, data transformations, and business rules
- Familiarity with Microsoft Fabric components such as Data Factory pipelines, notebooks, lakehouses, warehouses, and SQL analytics endpoints
- Experience identifying, documenting, tracking, and retesting defects using Azure DevOps or similar tools
- Strong analytical and problem-solving skills, with the ability to investigate data discrepancies and communicate findings clearly
- Experience testing Delta Lake tables and medallion architecture (Bronze, Silver, and Gold layers)
- Experience with Azure services such as Azure Data Lake Storage, Azure SQL Database, Azure Synapse Analytics, Azure Key Vault, or Azure DevOps
- Experience working with different data sources and formats, including Oracle, SQL Server, APIs, CSV, XML, JSON, and Parquet
- Experience building automated SQL/PySpark validation or reconciliation frameworks
- Familiarity with performance testing, data pipeline monitoring, and production readiness validation
Benefits:
- 100% remote work setup
- Work from anywhere in the Philippines
- Opportunity to work on a Microsoft Fabric implementation project
- Hands-on experience with modern data engineering and cloud data technologies
- Collaboration with experienced QA, data engineering, and development teams
- Opportunity to contribute to improving enterprise data quality, reliability, and automation


















