Staff Engineer

Job description

General Summary **Role Overview** We are hiring a **Rack Software Engineer** to build and validate software for AI infrastructure racks. The role focuses on **rack bring-up, Kubernetes orchestration, AI workload deployment, and system-level validation** across multi-node environments. Key Responsibilities - **Rack Bring-up Provisioning** - Automate network, storage, and bare-metal provisioning (e.g., MAAS) - Bring up clusters and validate end-to-end rack readiness - **Kubernetes Platform** - Deploy and manage services on K3S/Kubernetes using Helm - Ensure HA, scheduling constraints, and zero-downtime upgrades - **AI Workloads** - Deploy and benchmark large models (vLLM, disaggregated serving) - Analyze latency, throughput, and scaling behavior - **Accelerator Integration** - Validate AI accelerator (AI100/AI200) lifecycle, health, and allocation - Debug performance and hardware-software interaction issues - **Observability Debugging** - Work on telemetry (in-band + OOB), metrics, and monitoring - Debug system, performance, and infra-level issues - **Automation Reliability** - Build automation for testing, deployment, and operations - Improve system stability and reliability - **Multi-Tenancy Security** - Implement RBAC, authentication (LDAP/OIDC), and tenant isolation Requirements - 512+ years in systems / infrastructure software - Strong in: - Kubernetes, Linux, networking - Python / Go / scripting - Distributed systems debugging Preferred - Experience in AI/ML infra or inference systems - Familiarity with MAAS, Helm, Ansible, Prometheus/Grafana - Exposure to accelerators (GPU / AI ASICs) What We Look For - Strong debugging skills across HWSW stack - Experience in bring-up and scaling of complex systems - Ownership mindset for end-to-end stability Minimum Qualifications: Bachelor's degree in Engineering, Information Systems, Computer Science, or related field and 4+ years of Systems Test Engineering or related work experience. OR Master's degree in Engineering, Information Systems, Computer Science, or related field and 3+ years of Systems Test Engineering or related work experience. OR PhD in Engineering, Information Systems, Computer Science, or related field and 2+ years of Systems Test Engineering or related work experience.