Data Scientist II

Job description

**Key Responsibilities** 1. Design, develop, and maintain scalable ETL/ELT pipelines using **Azure Data Factory (ADF)** 2. Configure and manage **Linked Services, Datasets, and Pipelines** in ADF 3. Develop and optimize data transformation workflows using **Azure Databricks (PySpark)** 4. Work across Lakehouse architecture layers (Bronze/Silver/Gold), storage accounts, Unity Catalog, and support metadata\\u2011driven design (control tables, mappings). 5. Strong technical expertise across **Power BI, SQL, Power Platform tools**, and **Azure services** 6. Build and manage **dbt models** for data transformation, testing, and documentation 7. Implement real-time data ingestion using **Azure Event Hub** 8. Integrate data from multiple sources (databases, APIs, cloud storage, on-prem systems) 9. Ensure data quality by implementing **dbt tests and validations** 10. Monitor, troubleshoot, and optimize data workflows 11. Collaborate with cross-functional teams to understand business data requirements 12. Maintain data governance, security, and performance standards 13. Strong understanding of data warehousing concepts and ELT methodologies 14. Experience working with Azure Data Lake Storage (ADLS) or similar storage solutions 15. Knowledge of version control (Git) and CI/CD processes 16. Willing to work in production support