Senior Software Engineer - Generative AI Solutions

Job description

Software Engineer II A - GBS IND Job Description: About Us At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. We do this by driving Responsible Growth and delivering for our clients, teammates, communities and shareholders every day. Being a Great Place to Work and providing a culture of caring is core to how we drive Responsible Growth. We are intentional about fostering an inclusive workplace where every teammate has the opportunity to succeed, build a career and contribute to our shared success. This includes attracting and developing exceptional talent, recognizing and rewarding performance, and supporting our teammates' physical, emotional, and financial wellness through affordable, competitive and flexible benefits. We value the unique perspectives individuals bring from all backgrounds and career paths - whether shaped by military service, community college education, or a wide range of work and life experiences. These journeys foster resilience, leadership and innovation, strengthening our workforce and positively impact the communities we serve. Bank of America is committed to an in-office culture that supports collaboration, engagement, and career development. Our approach includes clear in-office expectations, while providing an appropriate level of flexibility based on role-specific responsibilities and business needs. At Bank of America, you can build a successful career with opportunities to learn, grow, and make an impact. Join us! Global Business Services Global Business Services delivers Technology and Operations capabilities to Lines of Business and Staff Support Functions of Bank of America through a centrally managed, globally integrated delivery model and globally resilient operations. Global Business Services is recognized for flawless execution, sound risk management, operational resiliency, operational excellence and innovation. In India, we are present in five locations and operate as BA Continuum India Private Limited (BACI), a non-banking subsidiary of Bank of America Corporation and the operating company for India operations of Global Business Services. Process Overview As part of Global Markets Technology Strategy \& Innovation , working closely with the Quantitative Strategies \& Data Group (QSDG) and Platform teams, this organization is chartered with driving the firm's AI-first transformation across trading, research, and client engagement. Our mission is to build enterprise-grade GenAI capabilities that unlock new insights from structured and unstructured data, accelerate revenue growth, and enhance operational efficiency across Global Markets. We are building a platform that serves a rapidly growing pipeline of GenAI use cases, leveraging both proprietary and open-source Large Language Models (LLMs) alongside the firm's vast data assets. Job Description Generative AI (GenAI) presents a transformational opportunity to derive deeper insights from data, accelerate revenue growth, and enhance business processes. We are seeking a Senior Software Engineer to design, build, and deploy production-grade GenAI solutions on our Global Markets platform. As a Senior Software Engineer, you will be hands-on building RAG pipelines, integrating LLMs, developing model serving infrastructure, and implementing MLOps workflows. You will work across the full stack---from data ingestion and embeddings to model deployment and monitoring---delivering AI-powered capabilities that directly impact traders, researchers, and clients. This role requires strong software engineering fundamentals combined with deep expertise in GenAI technologies. You will collaborate with cross-functional teams, mentor junior engineers, and drive innovation through rapid prototyping and production delivery. Responsibilities: - GenAI Development \& Implementation Design and implement end-to-end Retrieval-Augmented Generation (RAG) pipelines including document processing, embedding generation, vector storage, and retrieval optimization Build and deploy LLM-based applications using frameworks like LangChain, LlamaIndex, or Haystack Develop prompt engineering workflows, template libraries, and prompt optimization strategies for enterprise use cases Implement fine-tuning pipelines using LoRA, QLoRA, Adapters, or instruction tuning methodologies Build agent-based architectures with tool augmentation and multi-step reasoning capabilities Integrate multimodal models handling text, tabular data, and unstructured content Platform \& Infrastructure Develop production-grade model serving infrastructure using Docker, Kubernetes/OpenShift, and model frameworks Build scalable inference APIs with load balancing, caching, and request routing Implement vector database solutions with optimized indexing and search Design and deploy microservices for data preprocessing, feature extraction, and post-processing Optimize model inference performance through quantization, batching, and hardware acceleration MLOps \& Model Lifecycle Build CI/CD pipelines for model deployment, versioning, and rollback Implement model monitoring, drift detection, and automated evaluation frameworks Develop A/B testing infrastructure for model comparison and champion/challenger strategies Create logging and observability solutions for LLM requests, responses, and performance metrics Build hallucination detection, factuality checks, and safety guardrails into production pipelines Collaboration \& Delivery Partner with business stakeholders, quants, and product managers to translate requirements into technical solutions Conduct code reviews and provide technical mentorship to junior engineers Participate in architecture discussions and contribute to platform design decisions Drive agile delivery with sprint planning, estimation, and on-time execution Document technical designs, APIs, and operational runbooks Innovation \& Quality Research and prototype emerging GenAI technol