Senior Data Quality Engineer

Job description

We are seeking a highly skilled and detail-oriented **Data Quality Engineer (Automation)** to join our data engineering team. The ideal candidate will have a strong background in ETL automation, data warehouse testing, and cloud data services, along with hands-on experience in test automation frameworks and CI/CD practices. **Responsibilities** - Design, develop, and execute automated test scripts for validating ETL workflows and data pipelines - Perform end-to-end data validation, reconciliation, and DWH/DB testing across large datasets - Collaborate with data engineers, analysts, and stakeholders to define test strategies and ensure data quality standards are met - Develop reusable and scalable test automation frameworks using Python and SQL - Integrate automated tests into CI/CD pipelines to ensure continuous testing and delivery - Validate data transformation logic and completeness across different cloud platforms (Azure, AWS, GCP) - Participate in Agile ceremonies and contribute to sprint planning, retrospectives, and story grooming **Requirements** - Experience: 5.5 + Years - Strong hands-on experience in ETL automation and Data Warehouse/Data Lake testing - Proficient in SQL for data validation and test automation - Good knowledge of Python for scripting and framework development - Experience with one or more Test Automation Frameworks - Exposure to Cloud Data Services across major platforms - Azure (ADF, ADB) - AWS (Glue, Lambda, Redshift) - GCP (BigQuery) - Understanding of CI/CD tools and practices (e.g., Jenkins, Git, Azure DevOps) - Familiarity with Agile/Scrum methodologies **Nice to have** - Experience working with data observability or data quality tools (e.g., Great Expectations, Deequ) - Basic understanding of data governance and metadata management concepts - Certification in cloud platforms (Azure/AWS/GCP) is a plus