Scala Data Engineer

Job description

Walk in Kolkata TCS Delta park 8 TH august 2026 Experience range 6+ years Job Summary We are seeking a highly skilled Scala Data Engineer with 6+ years of experience in designing, developing, and maintaining large-scale data processing applications and distributed data platforms. The ideal candidate should possess strong expertise in Scala, Apache Spark, Big Data technologies, Data Engineering, Cloud Platforms, and Data Warehousing. The role involves building scalable data pipelines, optimizing data processing frameworks, and enabling advanced analytics across enterprise environments. Key Responsibilities - Design, develop, and maintain large-scale data processing applications using Scala and Apache Spark. - Build robust ETL/ELT pipelines for batch and real-time data processing. - Develop high-performance Spark applications using Spark Core, Spark SQL, Structured Streaming, and DataFrames. - Design and implement scalable data lake and lakehouse architectures. - Integrate data from multiple sources including databases, APIs, messaging systems, and cloud storage. - Optimize Spark jobs for performance, scalability, and resource utilization. - Collaborate with Data Scientists, Analysts, Architects, and Business stakeholders to deliver data solutions. - Implement data validation, monitoring, and quality controls. - Support CI/CD processes and automate deployment workflows. - Ensure data security, governance, and compliance standards are maintained. - Troubleshoot production issues and perform root cause analysis. - Mentor junior engineers and contribute to technical best practices.