Lead AWS Data Engineer

Job description

Key Skills: Pyspark, AWS, Databricks, Data Modelling, SQL, Python, Airflow, GIT, CICD Roles and Responsibilities: • Design and build scalable data pipelines and transformation workflows on AWS and Databricks • Develop efficient Python, SQL, and PySpark solutions for batch data processing and data preparation • Implement robust data models and warehouse-ready datasets to support reporting and analytics use cases • Orchestrate and maintain scheduled data workflows using Airflow and related cloud services • Partner with engineering and analytics teams to deliver trusted, reusable data assets across the platform Skills Required: • 6-12 years of relevant data engineering experience • Strong hands-on experience with AWS, Python, PySpark, SQL, Databricks, data modelling, and Airflow • Experience designing cloud-based data platforms and building scalable data processing solutions • Ability to write complex SQL and optimize data transformations for large datasets • Experience delivering production-grade data pipelines and integrating data from multiple sources Good to Have: • Git • CI/CD Education: Bachelor's degree in Computer Science or related field; Master's degree preferred