T

Python developer+ Sql

Tata Consultancy Services · Bengaluru, Karnataka, India - Hyderabad, Telangana, India

2–8 yrs experiencefull_timePosted 3w ago
Apply now →

Job description

**Role: Data Engineer/Data warehouse operations Engineers (Python+ SQL)** **Experience:5-10Years** **Locations: Hyderabad, Bangalore** **Job Desription:** \\* Seeking a \\*\\*Data Warehouse Operations Engineer\\*\\*. \\* Strong expertise in \\*\\*Advanced SQL\\*\\* and \\*\\*Python scripting\\*\\*. \\* Support and maintain \\*\\*data warehouse pipelines\\*\\*. \\* Monitor data pipelines to ensure smooth operations. \\* Analyze logs during pipeline failures. \\* Troubleshoot and resolve data processing issues. \\* Experience with \\*\\*DAG-based workflows\\*\\*. \\* Experience with \\*\\*API integrations\\*\\*. \\* Hands-on experience using \\*\\*Pandas DataFrames\\*\\* for data processing. \\* Snowflake experience is preferred. Key Responsibilities: \\* Monitor and manage data pipelines to ensure reliable and timely data processing. \\* Investigate pipeline failures by analyzing logs, job runs, and system errors. \\* Perform root cause analysis and resolve data pipeline issues. \\* Develop and maintain Python scripts for: \\* Data extraction and loading \\* Data cleansing and transformation \\* API integrations \\* Use Pandas DataFrames for data manipulation, transformation, and validation. \\* Build and maintain DAG-based workflows for scheduling and orchestrating pipelines. \\* Write advanced SQL queries for data validation, analysis, and troubleshooting. \\* Ensure data quality and integrity across the data warehouse. \\* Optimize queries and pipeline workflows for performance and scalability. Required Skills: \\* Strong experience with Advanced SQL: \\* Joins \\* Window Functions \\* Aggregations \\* Query Optimization \\* Strong Python scripting experience. \\* Experience using Pandas DataFrames for data manipulation and analysis. \\* Experience with API integrations using Python. \\* Experience working with DAG-based orchestration tools (e.g., Airflow or similar). \\* Experience with data pipeline monitoring and log analysis. \\* Experience with Snowflake or other cloud data warehouse platforms.