Data Pipeline Engineer (OT-IT Integration)

Job description

Educational Requirements Bachelor of Engineering, Bachelor Of Science, Bachelor Of Technology, Bachelor Of Comp. Applications Service Line Engineering Services Responsibilities - Design, develop, and operate end-to-end data pipelines for batch and real-time (streaming) data from industrial systems such as SCADA, MES, and Historians to enterprise or cloud platforms. - Implement Unified Namespace (UNS) architecture aligned with ISA 95/88 standards. - Model, transform, and govern industrial data ensuring quality, lineage, and metadata management. - Develop and integrate solutions using APIs, connectors, and industrial protocols. - Optimize database schemas and performance across SQL and NoSQL databases. - Ensure data security, authentication, and authorization (AuthN/AuthZ) best practices are implemented. - Build scalable, resilient, and cost-efficient data solutions in on-premises and cloud environments. - Collaborate with cross-functional teams to design architecture, workflows, and technical documentation. - Maintain version control and CI/CD practices using Git/GitHub (branching, reviews, releases). Additional Responsibilities - Industry experience in manufacturing, life sciences, or industrial environments with OTIT integration exposure is highly preferred. - Familiarity with regulated environments (GxP) and enterprise data governance frameworks is an advantage. - Strong analytical, problem-solving, and troubleshooting skills. - Excellent communication and stakeholder management abilities. Technical and Professional Requirements - Strong experience in data engineering and pipeline development (batch streaming). - Hands-on expertise with SCADA, MES, Historians, and industrial data systems. - Knowledge of cloud platforms (Azure, AWS, or GCP); experience with Azure Event Hubs/Event Grid is a plus. - Familiarity with industrial communication protocols such as OPC UA, MQTT, BACnet, Modbus. - Experience with integration platforms (HighByte preferred) and RESTful APIs. - Proficiency in data modeling, database design, and performance tuning. - Experience implementing data governance, security, and compliance frameworks. - Understanding of DevOps practices and version control tools (Git/GitHub). Preferred Skills - Technology->Industrial IOT Embedded Software->Control Systems Acquisition Systems->SCADA - Technology->Industrial IOT Embedded Software->MES - Technology->Industrial IOT Embedded Software->OPC Standards for process control->OPC UA - Domain->IOT->Azure IoT - Technology->Data Engineering->Databricks