Data Bricks ETL AWS Engineer

Job description

Dear Candidate, We are hiring for the below skill , kindly share the below details . Skill : ETL+ DataBricks+ AWS Exp : 9-12 yrs Location : Chennai/ Bangalore/ Ahmedabad JD BIG DATA LEAD • Domain Expertise Clinical research Data (Good to have) • Develop / Build high-performance and maintain ETL/ELT pipelines using Databricks (PySpark, SQL, Notebooks). Handson development of Batch and incremental pipelines, streaming pipelines (Kafka, etc) Ensure high code quality and reusability • Proficiency in AWS (S3, Glue) • Perform advanced Spark optimization and cluster sizing • Implement CI/CD, version control, and DevOps best practices within Databricks. • Execute and Maintain data governance framework, scripts and Data lineage reports & Data Quality reports • Perform Technical Tests before UAT and provide sign-off (Bronze layer) • Plan and execute sprint deliveries • Review code, enforce standards • Act as the primary technical point of contact for delivery Kindly share the below details : Name : Skill: Exp : Rel Exp: C Location: P Location: NP: C CTC : Exp CTC : Freelancing done : Reach via : "sandhyas5@hexaware.com" or 9092448466 Regards, Sandhya Shree Srinivasan