W

Batch Scheduling Engineer (Airflow Migration & Automation) required @ Wipro with quick joining

Wipro · Chennai, Tamil Nadu, India

~₹12L (est.)3–8 yrs experiencefull_timePosted 4w ago
Apply now →

Job description

Job description: Job Description **ROLE:** Batch Scheduling Engineer (Airflow Migration & Automation) **LOCATION:** IND – Chennai **TERMS:** Local **Scope of Role:** We are seeking an experienced **Batch Scheduling & Automation Engineer** to support an enterprise-wide migration from legacy schedulers (e.g., Control-M / BMC / Cron-based workloads) to **Apache Airflow based orchestration platform** . The role involves workflow analysis, DAG development, Python automation, API integrations, and operational support across Linux and Windows environments. The engineer will work closely with application teams, infrastructure teams, and platform engineering to onboard applications onto the new orchestration platform while maintaining production stability. This is a hands-on technical role requiring strong troubleshooting, scripting, and platform integration skills. **Key Responsibilities** - Analyse existing batch workloads from legacy schedulers (Control-M / BMC / Cron) - Design Airflow DAGs replicating enterprise scheduling logic: - Dependencies - Calendars / holidays - Cyclic schedules - File triggers - Conditional workflows - Convert jobs/scripts into standardized Airflow-compatible workflows - Develop reusable operators/plugins for enterprise integrations - Implement job parameterization, rerun, hold/release logic - Build scheduling wrappers for legacy applications during transition phase **Python Development & Automation** - Develop production-grade Python code for: - DAG development - Operators & Sensors - REST API integrations - Job automation frameworks - Write modular and reusable libraries for job execution and monitoring - Handle exception management, retries, logging, and alerting logic - Integrate Airflow with external systems using APIs (e.g., Kong Gateway / Service APIs) **API & Integration (minimum knowledge)** - Work with API gateways (Kong or similar) for job triggering and monitoring - Implement REST-based job execution - Integrate schedulers with: - Ticketing tools - Monitoring platforms - External application APIs - Secure API communication using authentication tokens and certificates **Production Support & Troubleshooting** - Investigate batch failures, delays, and performance issues - Perform root cause analysis across: - Airflow platform - OS level - Network/API layer - Application scripts - Support high-availability scheduling environments - Handle incident, problem, and change management activities Profile description: **Selection Criteria** Candidates must have: - Minimum **4+ years experience in batch scheduling & troubleshooting** - Experience working in production support environments - Hands-on scripting and debugging ability - Ability to independently analyze and resolve job failures - Good understanding of job dependency workflows - Self-starter mindset with ownership attitude - Ability to work with multiple teams during migration **Technical Skills Required** **Scheduling Platforms** - Apache Airflow (mandatory or willing to learn deeply) - Control-M / BMC / Autosys / TWS / other enterprise schedulers - Cron based scheduling concepts **Programming & Automation** - Strong Python scripting (mandatory) - Shell scripting (Bash/KSH) - Windows batch / PowerShell (basic operational knowledge) - REST API integration **Operating Systems** - Strong Unix/Linux troubleshooting skills - Understanding of Windows job execution environment Process monitoring, permissions, networking basics