Databricks developer
Tata Consultancy Services · Noida, Uttar Pradesh, India
Tata Consultancy Services · Noida, Uttar Pradesh, India
**Job description** **In person Interview - Face to Face.** **Job Title: Databricks Developer** **Location: Noida** **Experience range : 5- 10 years** **Walk In Drive Date : 20th Jun (Saturday)** **Walk In Drive Time : 09:30 AM 2:00 PM** **Venue:** **TCS - Noida** **TCS Yamuna Park, Plot No. 20 & 21, Building B2, 4th to 7th Floor, Seaview Developers SEZ, Sector 135, Noida - 201304, Uttar Pradesh.** **Things to carry for interview:** **1. TCS Registration No. (Mandatory)** **2. Completed TCS Application Form (Mandatory)** **3. PAN Card (Original - Both Hard & Soft Copy)(Mandatory)** **4. Aadhaar Card (Original - Both Hard & Soft Copy)(Mandatory)** **Eligibility Criteria:** **Minimum 15 years of regular education (10th + 12th + 3 years graduation or Diploma of 3 years (Fulltime only))** **Only Full Time courses would be considered.** **Job Description:** - **Pipeline Development:** **Design, build, and optimize scalable ETL/ELT data pipelines using PySpark, Spark SQL, and Databricks Workflows.** - **Lakehouse Architecture:** **Implement medallion architectures (Bronze, Silver, Gold layers) leveraging Delta Lake for ACID transactions and data versioning.** - **Performance Tuning:** **Optimize Spark workloads for cost and efficiency using caching, partitioning, and Z-ordering.** - **Data Governance:** **Enforce security and compliance using Databricks Unity Catalog for fine-grained access control, data masking, and lineage tracking.** - **DevOps Integration:** **Implement CI/CD best practices using Git, automated testing frameworks, and Infrastructure-as-Code tools like Terraform.** **Core Required Skills** - **Programming Languages:** **Advanced proficiency in** **Python** **and** **SQL.** - **Data Processing:** **Mastery of** **PySpark / Spark SQL** **for production-grade data manipulation.** - **Databricks Stack:** **Deep experience with** **Delta Lake,** **Unity Catalog, and** **Databricks Workflows/Jobs.** - **Cloud Platforms:** **Strong hands-on experience integrating Databricks within cloud ecosystems like** **AWS** **(S3, Glue) or** **Azure** **(Azure Data Factory, Azure Synapse).** - **DevOps:** **Working knowledge of** **Git, CI/CD pipelines, and basic containerization tools.** **Preferred Qualifications** - **Certifications:** **Databricks Certified Data Engineer (Associate or Professional) or Databricks Certified Developer.**