Senior Principal Systems Software Engineer

Job description

Job Description Sets technical direction for key systems areas (e.g., provisioning frameworks, driver stacks, platform diagnostics) and aligns cross-team roadmaps. Decomposes ambiguous, multi-domain problems into tractable workstreams; mentors engineers across teams. Establishes best practices for cross-layer debugging and resiliency; introduces automation and tooling that raise operational maturity. Partners with hardware/firmware architects to influence platform design for serviceability, observability, and performance. Leads complex bring-up efforts and incident postmortems; drives systemic reliability improvements and SLO/SLA adherence. Responsibilities Key Responsibilities Systems Software Development: • Design, develop, and maintain highly complex system software modules for managing, monitoring, and provisioning computer servers, storage, networking, and GPU subsystems in hyperscale environment. • Uses deep knowledge to design, develop, and deploy software layers and tooling to automate hardware provisioning and onboarding of servers to large-scale fleet. • Diagnose and resolve highly complex issues across software, firmware, and hardware layers, working in DevOps and incident response paradigms to maintain reliability and availability. Software Development and Coding: • Designs innovative software solutions and identifies requirements to achieve business and operational goals. • Adheres to and optimizes execution of all phases of the software development lifecycle; coaches engineers to drive improvements. • Utilizes depth and breadth of expert knowledge to develop and guide new software features and enhancements leading design specifications, ensuring accessibility, and documentation for software design and code. • Leads process, architecture, and/or code reviews across a project and/or complete product/service to drive improvements. • Conducts debugging and troubleshooting to identify and fix highly complex software issues. Develops fixes for identified issues. • Implements comprehensive software testing (e.g., functional and non-functional testing), quality assurance processes, software error logging, monitoring, and observability for effective debugging, reporting results to manager and/or lead upon completion. • Conducts performance profiling and optimization of coding that may require innovation. • Troubleshoots and resolves highly complex issues related to application programming interface (API) functionality and integration. • Implements API versioning, lifecycle, and interoperability strategies that may require innovation. Software Architecture - Software System Structural Design: • Designs and develops software, systems, and services, reporting results to manager and/or senior technical leaders upon completion. Defines project or design scope. • Provides technical guidance and domain expertise to suggest software architecture decisions that impact organizational success, mentoring peers and contributing to team development through role modeling and decision-making. • Conducts periodic reviews and ensures adherence to architectural standards. • Collaborates across lines of business and may communicate externally to align and build a narrow scope of software architecture with business and/or customer goals and priorities. • Implements highly complex performance optimization and scalability strategies in software design within scope. • Conducts regular technology research and evaluation for architectural enhancements having a moderate impact on the organization. Issue/Defect Collaboration - Software Products Support: • Collaborates with stakeholders across business lines and drives efforts to understand customer issues, root causes, and mitigation to align and explain rationale behind solutions. • Can provide advanced technical guidance and support to customers regarding customer-reported issues to mitigate recurrence. • Contributes to strategies to advocate for customers' interests and suggests product enhancements based on feedback. • Influences strategies to ensure customer satisfaction through timely resolution of issues and effective communication. • Implements and provides guidance on customer issue and/or defect handling and training processes. • Investigates and troubleshoots the most complex and broadly reaching product maintenance issues to ensure customer agreement on short- and long-term solutions (e.g., future enhancements). Practices and Standards Compliance - Security and Compliance: • Collaborates with the team and cross-functionally to follow and suggest improvements to development practices and coding standards, providing coaching to less experienced team members. • Participates in peer review processes, provides technical leadership, and ensures quality and adherence to broad acceptance criteria during development, reporting results to management. • Demonstrates and shares expert knowledge of and contributes to industry best practices and applies them to software development processes. • Implements highly complex secure coding practices to prevent security vulnerabilities, leveraging automated solutions to augment the manual review process. Development Operations - System Maintenance: • Utilizes innovation to perform periodic maintenance and testing operations for systems that require upgrading or patching (e.g., for critical vulnerabilities). • Utilizes expert knowledge to drive improvements, ensures automation, testing, and debugging of systems to ensure service/product availability, health, support, and reliability. Core Responsibilities Planning & Execution: • Oversees and tracks timelines and/or budgets for large-scale projects or initiatives to ensure timely progress and adherence to requirements. • Strategically balances multiple projects and adjusts plans to accommodate shifts in resources or schedules, mitigating risks to project outcomes. Collaboration & Partnership: • Fosters