Data Engineer

Job description

Job Description About the Role We are looking for a motivated and detail-oriented Data Engineer with 3–4 years of experience in data engineering and analytics solutions. The ideal candidate should have hands-on experience with Microsoft Fabric, strong PySpark skills, and a foundational understanding of Databricks. The candidate should be eager to learn, adaptable to new technologies, and passionate about building scalable data solutions. Key Responsibilities • Design, develop, and maintain data pipelines using Microsoft Fabric. • Build and optimize ETL/ELT processes for ingesting, transforming, and loading data from multiple sources. • Develop and maintain data transformation workflows using PySpark. • Work with Lakehouse, Data Warehouse, and Data Factory components within Microsoft Fabric. • Collaborate with business stakeholders, analysts, and data teams to understand data requirements. • Ensure data quality, consistency, and reliability across data platforms. • Monitor and troubleshoot data pipeline performance and resolve issues proactively. • Support data modeling and reporting requirements for analytics and business intelligence initiatives. • Participate in code reviews, testing, and deployment activities. • Stay updated with emerging technologies and best practices in data engineering. Required Skills • 3–4 years of experience in Data Engineering or related roles. • Hands-on experience with Microsoft Fabric (Data Factory, Lakehouse, Data Warehouse, Notebooks, etc.). • Strong proficiency in PySpark for data processing and transformation. • Good understanding of ETL/ELT concepts and data pipeline development. • Experience working with SQL and relational databases. • Basic understanding of Databricks and Spark ecosystem. • Familiarity with data lakes and modern cloud-based data architectures. • Knowledge of data quality, performance tuning, and optimization techniques. • Experience with version control tools such as Git. Preferred Skills • Exposure to Azure Data Services. • Understanding of Delta Lake concepts. • Experience with Power BI integration and reporting. • Knowledge of CI/CD practices for data engineering projects. • Familiarity with Agile/Scrum methodologies. Educational Qualifications • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field. Desired Candidate Profile • Strong analytical and problem-solving skills. • Eagerness to learn and work on new technologies. • Good communication and stakeholder management skills. • Self-motivated, proactive, and a strong team player. • Ability to work in a fast-paced and collaborative environment. Nice to Have • Microsoft Fabric certifications. • Exposure to cloud platforms such as Microsoft Azure. • Basic experience with Databricks notebooks and workflows.