Pyspark Data Engineer

Job description

**Roles and Responsibilities :** - Design, develop, test, deploy and maintain large-scale data pipelines using HL7 standards for healthcare industry clients. - Collaborate with cross-functional teams to gather requirements and deliver high-quality ETL solutions that meet business needs. - Develop complex SQL queries to extract insights from large datasets using PySpark on AWS Glue. - Troubleshoot issues related to data processing pipeline failures and implement fixes in a timely manner. **Job Requirements :** - 6-9 years of experience in Data Engineering with expertise in HL7 ETL/ELT processes. - Strong understanding of Python programming language and its applications in big data processing (PySpark). - Experience working with cloud-based technologies such as AWS Glue for building scalable data pipelines. - Proficiency in designing efficient database schema's using relational databases like MySQL or PostgreSQL.