Lead Software Engineer

Job description

**About this role:** Wells Fargo is seeking an experienced **Lead Software Engineer** to lead the design, development, and evolution of our **enterprise observability and telemetry platforms** . This role is critical to driving modern logging, monitoring, and AI‑driven insights using **Splunk, Cribl, IT Service Intelligence (ITSI)** , and **agentic AI systems** . You will play a hands‑on technical leadership role---owning architecture decisions, driving automation, mentoring engineers, and partnering with platform, SRE, and security teams to deliver **scalable, resilient, and intelligent observability solutions** across hybrid and cloud environments. **In this role, you will:** * Own the **architecture, reliability, and scalability** of enterprise logging platforms. * Lead design and implementation of **high‑volume, resilient log ingestion pipelines** across hybrid and cloud environments. * Define and enforce **logging standards, schemas, and governance** aligned with enterprise observability strategy. * Design and integrate **AI/ML models** for anomaly detection, log classification, predictive alerting, and signal enrichment. * Build and operationalize **agentic AI systems** capable of: * Autonomous log analysis and root‑cause hypothesis generation * Context‑aware remediation recommendations * Intelligent correlation across logs, metrics, and traces * Partner with platform and SRE teams to embed **AI‑driven insights into incident response workflows** . * Partner with security and compliance teams to support **auditability, retention, and access controls** . **Required Qualifications:** * 5+ years of Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education **Desired Qualifications:** * 5+ years of experience in **software engineering or platform engineering** * Deep expertise with **Splunk Enterprise / Splunk Cloud** , including search optimization, index design, and platform operations. * Proven hands‑on experience with **Cribl (Stream / Edge)** for telemetry pipeline optimization. * Strong experience with **Splunk ITSI** , service modelling, KPIs, and episode management * Hands‑on experience with **agentic AI frameworks** or autonomous agents (LLM‑based or rule‑driven). * Strong understanding of **prompt engineering, tool‑using agents, feedback loops, and guardrails** . * Proficiency in one or more languages: **Python, Java, Go, or Scala** . * Experience with **cloud platforms** , containerization, and Kubernetes/OpenShift. * Familiarity with **Open Telemetry** , observability standards, and telemetry correlation. * Worked on a large Splunk infrastructure, including clustered environments, multi-site deployments, and cloud/SAAS deployment. * Exposure to containerization and orchestration tools (Docker, Kubernetes). * Familiarity with DevOps practices and CI/CD pipelines. * Certifications in Splunk, Cribl, or cloud technologies (AWS, Azure). * Experience applying **AI/ML techniques** to operational or telemetry data. **Job Expectations:** * Develop complex dashboards, reports, and alerts tailored to business and operational needs. * Develop migration strategies, including data ingestion, configuration, and app compatibility assessments. * Design data pipelines to optimize Splunk ingestion, reduce licensing costs, and improve system performance. * Proactively identify and resolve bottlenecks in ingestion, indexing, and search processes. **Posting End Date:** 2 Aug 2026 **_*Job posting may come down early due to volume of applicants._*\* **We Value Equal Opportunity** Wells Fargo is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other legally protected characteristic. Employees support our focus on building strong customer relationships balanced with a strong risk mitigating and compliance-driven culture which firmly establishes those disciplines as critical to the success of our customers and company. They are accountable for execution of all applicable risk programs (Credit, Market, Financial Crimes, Operational, Regulatory Compliance), which includes effectively following and adhering to applicable Wells Fargo policies and procedures, appropriately fulfilling risk and compliance obligations, timely and effective escalation and remediation of issues, and making sound risk decisions. There is emphasis on proactive monitoring, governance, risk identification and escalation, as well as making sound risk decisions commensurate with the business unit's risk appetite and all risk and compliance program requirements. Candidates applying to job openings posted in Canada: Applications for employment are encouraged from all qualified candidates, including women, persons with disabilities, aboriginal peoples and visible minorities. Accommodation for applicants with disabilities is available upon request in connection with the recruitment process. **Applicants with Disabilities** To request a medical accommodation during the application or interview process, visit Disability Inclusion at Wells Fargo (https://www.wellsfargojobs.com/en/diversity/disability-inclusion/) . **Drug and Alcohol Policy** Wells Fargo maintains a drug free workplace. Please see our Drug and Alcohol Policy (https://www.wellsfargojobs.com/en/wells-fargo-drug-and-alcohol-policy) to learn more. **Wells Fargo Recruitment and Hiring Requirements:** a. Third-Party recordings are prohibited unless authorized by Wells Fargo. b. Wells Fargo requires you to directly represent your own experiences during the recruiting and hiring process. **Req Number:** R-563400