Senior Data Engineer

Job description

Roles and Responsibilities : • As a Senior Data Engineer, you will be involved in data Lakehouse development including requirements gathering, database modeling, ETL job design & development, and dashboard/report development activities. • You will be working with the Customer Experience team to build and enhance a cloud-based warehouse of operational data to drive analytics. • You will be responsible for developing ETL/data pipelines using Talend, SQL, and Python, and ingesting data from various external sources into large MPP data warehouses such as Azure Synapse, Hive, Snowflake, or similar platforms. • You will frequently conduct data analysis, ingest data from various internal and external sources, write advanced SQL queries, and optimize data storage needed by business and executive operations. • You will partner with business stakeholders to analyze operational data, investigate trends, answer ad hoc business questions, and provide data-driven recommendations that support strategic and operational decision-making. • You will perform exploratory data analysis, validate data quality, identify anomalies, reconcile data across multiple sources, and translate business requirements into SQL-based analyses and actionable insights. • You will develop complex SQL queries to extract, profile, reconcile, and analyze large datasets, helping stakeholders understand business performance, customer behavior, operational metrics, and data quality issues. • You will enable daily business activities by providing the foundation for all federated querying and analysis produced by the BI and Data Science teams. • You will collaborate closely with Product Managers, Business Analysts, BI Developers, and Data Scientists to ensure data is accurate, reliable, and optimized for reporting, advanced analytics, and machine learning initiatives. • You will have the opportunity to work with modern data stack components and continuously grow by learning new tools and technologies in a collaborative, data-driven environment. Job Requirements : • Bachelor's/Master's degree in Computer Science, Mathematics, or Science. • Minimum 5 years of experience in ETL development and coding, including validation of complex data mappings. • Hands-on experience with ETL Tool Talend (minimum 5 years). • Proficient in SQL with at least 8 years of experience developing complex SQL queries for data validation, troubleshooting, and business analysis. • Experience in Python for data processing and transformation tasks. • Strong experience with data warehouse databases such as Azure Synapse, Hive, Snowflake, SQL Server, or Redshift. • Experience and knowledge in ingesting data from various external sources is a must-have. • Strong analytical and problem-solving skills with the ability to analyze large datasets and translate findings into meaningful business insights. • Experience performing data profiling, data quality analysis, data reconciliation, and root cause analysis using SQL. • Experience working with business stakeholders to understand analytical requirements and support data-driven decision-making. • Excellent oral and written communication skills. • Experience working with cloud-based data platforms.