IT Analyst Applications ( Data Engineer – AI & Analytics )

Job description

Career Area: Technology, Digital and Data Job Description: Your Work Shapes the World at Caterpillar Inc. When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it. Your Impact Shapes the World at Caterpillar Inc When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it. Job Summary We are seeking a skilled and experienced IT Analyst Applications ( Data Engineer – AI & Analytics ) to join our India GCC – GCIO ETL Services -CAT IT Division. Caterpillar is accelerating data‑driven decision making across engineering, manufacturing, supply chain, services, and digital products. As a Data Engineer with AI skillset, you will design and build robust data pipelines, features, and platforms that power analytics, machine learning, and GenAI use cases—such as predictive maintenance, parts demand forecasting, warranty analytics, and intelligent knowledge retrieval. The preference for this role is to be based out of Bangalore – Caterpillar PSN What you will do Data Pipelines & Integration • Design, build, and maintain scalable batch/streaming pipelines (e.g., telematics/IoT, SAP, PLM, MES, service/warranty, dealer systems). • Implement CDC, schema evolution, and data quality checks (Great Expectations/Deequ/custom). • Develop feature pipelines for ML and analytics (feature stores, time-series transformations). Data Modelling & Storage • Model data for lakes/lakehouses/warehouses (Delta/Parquet/Iceberg) following medallion or similar architectures. • Optimize partitioning, compaction, and performance for large datasets. AI/ML Enablement • Partner with Data Scientists to productionize models (batch/real-time), build inference pipelines/APIs, and manage feature stores. • Contribute to MLOps (CI/CD for models and data, model versioning, monitoring, drift detection). • Support GenAI use cases (RAG pipelines, vector indexing, prompt orchestration, governance). Platform & DevOps • Implement infrastructure‑as‑code, CI/CD and observability (lineage, cataloging, logging/metrics). • Enforce security, privacy, and compliance (PII handling, role-based access, data contracts). What you will have • Bachelor’s or master’s degree in computer science, Data Engineering, Industrial Engineering, or related field. • Overall, at least 7+ years of experience in Data engineering • Strong proficiency in Snowflake, SQL, Python, and ETL tools (e.g. Snaplogic). • Familiarity with cloud platforms (AWS, Azure, GCP) and data warehousing solutions (e.g., Snowflake, Redshift). AI/MLOps Exposure: • Building feature pipelines, packaging and deploying models (batch/real‑time). • Model serving (Databricks Model Serving, MLflow, Azure ML etc), model registry, experiment tracking. • Familiarity with vector databases and RAG patterns. Behavioural Competencies • Ownership & bias for action; thrives in a product operating model. • Clear communicator who can bridge business and engineering. • Pragmatic, security‑first, automation‑oriented mindset. • Collaborative partner across global, cross‑functional teams. • This position requires candidate to work a 5-day -a -week schedule in the office • Shift Timing-01:00PM-10:00PM IST Skills desired: Core Application Systems: Knowledge of major production application systems used for delivery of services to internal and external clients; ability to leverage major production application systems in diverse situations. Level Working Knowledge: • Helps create contingency plans to mitigate impact of disruption on core applications. • Identifies key players, criticalities, roles, and responsibilities. • Investigates application-related issues with both business and IT professionals. • Recommends enhancements for a major application system or related subsystems. • Works with core application systems for a major business unit or function. Problem Solving: Knowledge of approaches, tools, techniques for recognizing, anticipating, and resolving organizational, operational or process problems; ability to apply knowledge of problem solving appropriately to diverse situations. Level Working Knowledge: • Identifies and documents specific problems and resolution alternatives. • Examines a specific problem and understands the perspective of each involved stakeholder. • Develops alternative techniques for assessing accuracy and relevance of information. • Helps to analyze risks and benefits of alternative approaches and obtain decision on resolution. • Uses fact-finding techniques and diagnostic tools to identify problems. Application Design, Architecture: Knowledge of basic activities and deliverables of application design; ability to utilize application design methodologies, tools and techniques to convert business requirements and logical models into a technical application design. Level Extensive Experience: • Facilitates in application design reviews and walkthroughs. • Creates and evaluates technical alternatives for complex applications. • Interprets application services such as API; integrates them with technical design. • Develops various, distinct and multiple technical application designs. • Prepares technical design docum