Data Engineer - scheduled Face To Face Interview

Job description

**Roles and Responsibilities :** - Design, develop, test, deploy and maintain large-scale data pipelines using Hadoop ecosystem (HDFS, YARN, Oozie) to process and analyze big data. - Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs. - Develop scalable architectures for storing and processing massive datasets using PySpark on Scala. - Troubleshoot complex issues related to data quality, performance tuning, and system reliability. **Job Requirements :** - 6-12 years of experience in Data Engineering with expertise in Big Data technologies such as Hadoop ecosystem. - Strong proficiency in Python programming language with experience working with libraries like NumPy, Pandas, Matplotlib. - Experience with distributed computing frameworks like Spark (PySpark) running on Hadoop Distributed File System (HDFS). - Knowledge of cloud-based platforms like AWS or GCP.