Ai Performance Analyst

Job description

**Your Role and Responsibilities:** Your Role and Responsibilities\\* As a AI Performance Analyst you will be responsible for: - Design and implement benchmarks and stress workloads for AIU IO Cards, ensuring they remain current and relevant. - Set up benchmarks and stress workloads, including configuring the underlying AIU IO Card for various performance scenarios. - Automate performance measurements and streamline data collection processes for benchmarks and stress workloads. - Develop and enhance data collection and analysis tools to improve efficiency and accuracy. - Execute performance benchmarks and stress workloads to validate system performance. - Analyze performance measurements and collected data to identify bottlenecks and resolve performance issues. - Collaborate with development teams across the stack (IBM Z Hardware, IBM Research, IBM AIU application stack, Middleware/Applications) to guide and support performance optimization efforts related to configurations. **Required Education:** Bachelor's Degree **Preferred education** Master's Degree **Required Technical and Professional Expertise:** - Overall Experience: 2 to 5 years in performance measurement, analysis, and system testing. - Education: Bachelors degree in Computer Science or Information Science. Technical Skills AI/ML Knowledge: Basic understanding of ML/AI model architecture, training, and inferencing. 2+ years of experience with PyTorch, Tensorflow, vLLM Development & Automation: Proficiency in source code repository systems (e.g., Git). Strong scripting and test automation skills. System & Containerization: Basic Linux administration skills. Hands-on experience with Docker and Podman containers. Solid understanding of Operating System fundamentals and Computer Architecture concepts. Basic experience in performance analysis of applications/systems and familiarity with performance tools. Hands-on experience in functional and performance testing of multi-tiered applications. Additional Skills: Exposure to Agile methodologies and ability to apply agile concepts effectively. Strong presentation skills and ability to communicate technical concepts clearly. Collaborative team player with excellent interpersonal and communication skills. Programming Languages and scripts: Python, C/C++, Bash, Ansible, Java **Preferred Technical and Professional Experience:** - Masters degree in Information Technology, Computer Science, or Computer Engineering. - AI/ML & Model Serving - Knowhow in Transformer model design and modification (architecture tuning, finetuning, optimization). - Hands-on experience with TensorFlow and model inference serving using TensorFlow Serving, NVIDIA Triton Inference Server, and vLLM. - Systems Performance & Observability - Performance profiling and tracing (e.g., Linux perf, flame graphs, instrumentation). - Advanced Linux administration skills (networking, storage, process management, kernel parameters, automation). - Hardware & Accelerators - Experience in hardware design and debugging (board bring-up, driver interactions, performance counters). - Working knowledge of AI accelerator architecturesGPU, TPU, AMX (capabilities, memory hierarchies, scheduling/tiling considerations). - Programming Languages - CUDA (kernel development, memory optimization, streams/concurrency) and Java (services, tooling, SDK integration). ****Years of Experience:**** 2 - 5