Data Engineer-Azure Databricks

Job description

Role: Associate Data Engineer -Azure Databricks Exp Level: 1-2 Yrs Work Location: Bangalore Notice Period: Immediate We are looking for a Data Engineer to design, build, and maintain robust data pipelines and infrastructure. You will enable reliable, scalable, and high-quality data flows that power analytics and machine learning across the organization. Key Responsibilities • Design, build, and maintain scalable ETL/ELT pipelines to ingest data from diverse sources. • Develop and optimize data models and schemas for analytics and reporting use cases. • Build and maintain data infrastructure on cloud platforms (Azure, AWS, or GCP). • Ensure data quality, reliability, and observability through monitoring, testing, and validation frameworks. • Collaborate with data scientists and analysts to provision clean, well-structured datasets. • Implement data governance, security, and access control best practices. • Optimize pipeline performance and manage cost efficiency of data processing workloads. • Contribute to CI/CD practices for data pipeline deployment and version control. Required Skills & Qualifications • 1-2 years of experience in data engineering or a related field. • Strong proficiency in SQL and at least one programming language (Python, Pyspark). • Hands-on experience with distributed data processing frameworks (Apache Spark, or similar). • Experience building pipelines using orchestration tools (Airflow, Azure Data Factory, or similar). • Experience working with cloud data platforms (Azure) and modern data warehouses (Snowflake, BigQuery, Redshift, or Databricks). • Solid understanding of data modeling concepts (dimensional modeling, star/snowflake schemas). • Familiarity with version control (Git) and CI/CD practices.