Python+sparkscala(2-9 yrs)-s

Job description

**Roles and Responsibilities** - Design, develop, test, deploy and maintain large-scale data processing pipelines using Spark Scala. - Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs. - Develop high-quality code that is efficient, scalable, and easy to maintain. - Troubleshoot issues related to data processing workflows and resolve them promptly. - Stay up-to-date with industry trends and best practices in big data technologies such as Hadoop ecosystem (HDFS), Spark Core & MLlib. **Desired Candidate Profile** - 2-9 years of experience in Big Data development using Spark Scala programming language. - Strong understanding of SQL concepts including joins, aggregations, window functions etc. . - Experience working on AWS cloud platform is an added advantage. - Bachelor's degree in Any Specialization (B.C.A. / B.Sc.,B.Tech). - Proficiency in writing complex queries involving multiple tables/views/functions.