Aws Data Engineer

Job description

**Role & responsibilities** We are looking for a highly skilled Python Developer with 4.58 years of experience in building scalable data engineering and analytics solutions. The ideal candidate should have strong expertise in Python, PySpark, Azure Data Services, and ETL/Data Pipeline development. The role involves designing, developing, and optimizing large-scale data processing systems in a cloud environment **Preferred candidate profile** - Design, develop, and maintain scalable data pipelines using Python and PySpark. - Build and optimize ETL/ELT processes for large-scale data ingestion and transformation. - Develop data solutions on Azure cloud platforms. - Work with structured and unstructured datasets from multiple sources. - Optimize Spark jobs for performance, scalability, and reliability. - Implement data quality, validation, and monitoring frameworks. - Collaborate with Data Architects, Data Scientists, Business Analysts, and DevOps teams. - Troubleshoot production issues and provide timely resolutions. - Participate in code reviews and ensure adherence to coding standards and best practices. - Support CI/CD implementation and deployment automation. - **Python, PySpark, Azure Databricks, Azure Data Factory, Azure Data Lake, Azure Synapse, ETL, ELT, Data Engineering, Spark SQL, Delta Lake, Azure DevOps, CI/CD, SQL, Big Data, Kafka, Cloud Computing**.