Data Engineer - GCH

Job description

1. Data Engineer: Core Skills and Knowledge: • 5-8 years of experience in data engineering. • Hands-on experience with Databricks (Delta Lake, notebooks, Databricks Workflows). • Strong programming skills in Python and SQL. • Working knowledge of Apache Spark (PySpark preferred) for data transformation. • Experience with either AWS (S3, Glue, EMR) or Azure (ADLS Gen2, Data Factory, Synapse) services. • Understanding of data modeling concepts (star schema, dimensional modeling). • Familiarity with version control (Git) and basic CI/CD practices. Desirable Skills: • Databricks Certified Data Engineer Associate (or working toward it). • Exposure to streaming data pipelines (Structured Streaming, Kafka, Kinesis, or Event Hubs). • Familiarity with orchestration tools (Airflow, Databricks Workflows). • Basic understanding of data governance and security practices (PII masking, access control). • Exposure to Power BI or other BI tools for understanding downstream