python+pyspark(5-9yrs)ss

Job description

**Roles and Responsibilities** - Design, develop, test, deploy, and maintain large-scale data processing pipelines using Python and PySpark. - Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs. - Develop complex ETL processes to extract, transform, and load data from various sources into a centralized repository. - Ensure high-quality data processing by implementing robust testing frameworks and monitoring dashboards. **Desired Candidate Profile** - 5-8 years of experience in Big Data technologies such as Hadoop ecosystem (HDFS, MapReduce), Spark (PySpark), Kafka Streams). - Strong proficiency in programming languages like Python with hands-on experience working on big data projects. - Bachelor's degree in Any Specialization (B.C.A. or B.Sc.,B.Tech.,).