Confluent Kafka Designer

Job description

**Greetings from TCS!!** **TCS hiring for Confluent Kafka Designer** **Job Title:** **Confluent Kafka Designer** **Experience Range: 6- 15 Years** **Location: Hyderabad/Mumbai/Pan India** **Minimum Qualification: 15 years of full-time education** **Job Description** **Architecture & Design** - Design **end-to-end Kafka-based streaming architectures** using Confluent Platform (Kafka, Schema Registry, ksqlDB, Kafka Connect). - Define **topic strategies, partitioning, replication, retention policies**, and data flow patterns. - Establish **event-driven architecture (EDA)** best practices and reusable design patterns. **Development & Implementation** - Build and design **producers, consumers, and stream processing applications**. - Use **Kafka Streams / ksqlDB / Apache Flink or Spark Streaming** for real-time processing. - Develop integration pipelines using **Kafka Connect (source/sink connectors)**. **Platform Engineering** - Configure and manage **Confluent Platform components** (Control Center, REST Proxy, Schema Registry). - Work with **Confluent Cloud or self-managed clusters** (on-prem / cloud like AWS, Azure, GCP). - Ensure system **scalability, fault tolerance, and high availability**. **Performance & Optimization** - Monitor cluster performance and optimize **throughput, latency, and resource utilization**. - Tune Kafka configurations (broker, producers, consumers). - Manage **capacity planning and cluster upgrades**. **Data Governance & Security** - Implement **data governance using Schema Registry (Avro/JSON/Protobuf)**. - Ensure **data security** using SSL/TLS, SASL, RBAC, ACLs. - Maintain compliance with enterprise data standards. **Collaboration** - Work with **data engineering, DevOps, and application teams**. - Guide developers on **Kafka usage, standards, and best practices**. - Act as a **technical SME** for event streaming solutions.