Platform Eng(Ingesion Jobs, Integration)

Job description

****Job Title: Integration Engineer (Offshore)**** **Role Overview** ****This is an offshore role responsible for building and operating the integration layer that connects an enterprise Agentic AI platform to messaging, external APIs, enterprise systems, and downstream data platforms — Kafka, API gateways, on-premises connectivity, and streaming into the lakehouse — ensuring reliable, secure, and observable data flow across non-production and production within a follow-the-sun delivery model.**** **Key Responsibilities** - Build and operate Kafka / Confluent integrations, including consumers and producers, SASL/OAUTHBEARER authentication, and offset management. - Configure and maintain API gateway integrations across APIGEE and Azure API Management — proxies, policies, rate limiting, and runtime credential management. - Implement and operate Azure Service Bus messaging topologies, including topics, queues, sessions, and dead-letter queues. - Support integration with on-premises systems via enterprise API gateways using OAuth 2.0 token exchange. - Stream integrated data into downstream data platforms, including Databricks and Delta tables via Kafka or Azure Event Hubs. - Build integration error-handling, retry, and dead-letter replay patterns, and develop integration tests covering happy and unhappy paths. - Build and maintain Terraform Infrastructure-as-Code for integration and related platform services, and implement CI/CD using GitHub Actions. - Monitor integration health using Application Insights and Dynatrace, and troubleshoot connectivity, authentication, and throughput issues. - Maintain operational runbooks and provide follow-the-sun / on-call support. **Qualifications & Experience** - 4+ years experience in integration engineering. - Hands-on experience with Kafka (Confluent) — consumer development, authentication, and offset management. - Experience with API gateways (APIGEE and/or Azure API Management), including policy authoring. - Experience with Azure Service Bus — topics, queues, sessions, and dead-letter handling. - Strong understanding of OAuth 2.0 / OpenID Connect and token-exchange flows. - Experience with REST API integration, Python development, and Terraform Infrastructure as Code. - Awareness of streaming into data platforms such as Databricks or Delta Lake. - Strong troubleshooting and analytical skills. - Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related discipline. **Preferred Skills** - Experience with IBM DataPower and IBM App Connect Enterprise. - Experience with Spark Structured Streaming or Delta Lake ingestion. - Experience with Azure Managed Identity and MSAL for credential-free authentication. - Familiarity with Confluent Schema Registry and GitHub Actions CI/CD. - Familiarity with ITIL-based enterprise service management processes.