Senior/Lead Data Engineer with Kafka

Job description

**Job Title: Data Engineer with Kafka Position: Lead/Senior Software Engineer Experience: 7+ Years Category: Software Development/ Engineering Location: Hyderabad Employment Type: Full Time Essential skills:** CGI is looking for a Data Engineer to join us our offshore team in India. This candidate should seamlessly utilize Hadoop, Hive, Impala and Python. The candidate should have hands on experience with Kafka streaming platform and ELK (Elastic) stack. The ideal candidate will have a can-do attitude, passion for technology, extensive analysis coding. This candidate will serve as a technical expert of a large-scale digital development project consisting of both on-shore and off-shore developers. .8+ years of professional experience in: software development and/or data engineering; and in working with relational databases including Oracle, Teradata, MySQL. 8+ years+ of experience in working with Hadoop ecosystem, i.e. Hadoop, Hive, Spark, Scala, Sqoop, Flume, . Programming experience in Python, shell scripting (Mandatory) . Hands on Experience with Kafka Streaming Platform (Mandatory . Hands on Experience with ELK Stack and building reporting dashboards (Mandatory) . Experience in Data Analysis . Knowledge on Banking Domain/Products . Experience with modern workflow/orchestration tools (e.g. Apache Airflow, Oozie, etc.) . Experience working Data Observability within streaming platform would be a plus. . Learning knowledge in GenAI, Azure Open AI, GPT . Strong analytical abilities. . Agile experience is required with Version One or Jira tool expertise . Provide hands-on technical solutions to business challenges & translates them into process/ technical solutions . Good knowledge of CI/CD and DevOps principles . Deliver high quality work and adapt to new challenges, as an individual or as part of a team . Excellent communication and thought leadership skills Excellent interpersonal skills including the ability to work with diverse personality types and understand technical issues.