Senior Engineer, Big Data Engineer

Job description

**We're Nagarro.** We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale across all devices and digital mediums, and our people exist everywhere in the world (17500 experts across 39 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues. That is where you come in! **REQUIREMENTS:** - Total experience: 3+ years. - Excellent knowledge and experience in Bigdata Engineer role. - Strong working experience with architecture and development in **Spark, Python/Pyspark, AWS (EMR, Glue, Lambda etc.), Databricks, ETL, SQL.** - Design, develop, and maintain scalable data pipelines using Python, Spark, and Databricks. - Build and optimize batch and real-time data processing solutions on AWS. - Develop ETL/ELT workflows using AWS services such as Glue, EMR, Redshift, and S3. - Write efficient, reusable, and scalable code for data processing and automation. - Implement advanced data transformations, validations, and quality checks and hands-on experience in data ingestion pipelines. - Integrate data workflows with APIs, microservices, and third-party systems. - Partner with data scientists, analysts, and business stakeholders to deliver data-driven solutions. - Develop ETL/ELT workflows to ingest, transform, and process structured and unstructured data. - Good communication and interpersonal skills. **RESPONSIBILITIES:** - Writing and reviewing great quality code. - Understanding the clients business use cases and technical requirements and be able to convert them into technical design which elegantly meets the requirements. - Mapping decisions with requirements and be able to translate the same to developers. - Identifying different solutions and being able to narrow down the best option that meets the clients requirements. - Defining guidelines and benchmarks for NFR considerations during project implementation. - Writing and reviewing design document explaining overall architecture, framework, and high-level design of the application for the developers. - Reviewing architecture and design on various aspects like extensibility, scalability, security, design patterns, user experience, NFRs, etc., and ensure that all relevant best practices are followed. - Developing and designing the overall solution for defined functional and non-functional requirements; and defining technologies, patterns, and frameworks to materialize it. - Understanding and relating technology integration scenarios and applying these learnings in projects.