Data Engineer-Shifali

Job description

**Roles and Responsibilities :** - Design, develop, test, deploy and maintain large-scale data pipelines using Airflow to extract, transform, load (ETL) data from various sources into a centralized repository. - Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs through ETL processes. - Develop complex SQL queries to optimize database performance and troubleshoot issues related to data quality, integrity, and availability. - Ensure compliance with security standards by implementing access controls on sensitive data assets. **Job Requirements :** - 6-10 years of experience in Data Engineering with expertise in Airflow for building scalable ETL workflows. - Strong understanding of Python programming language for developing custom scripts and integrations. - Experience working with relational databases such as MySQL or PostgreSQL for querying large datasets.