Senior Site Reliability Engineer - HPC
NVIDIANVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were once science fiction inventions from artificial intelligence to autonomous cars. NVIDIA is looking for phenomenal people like you to help us accelerate the next wave of artificial intelligence.
We’re looking for a Senior SRE to join our Compute Farm team and help build the next generation of our global services platform. At NVIDIA, you’ll keep critically important systems running while working on the technologies that are redefining computing. You’ll harness the power of AI to deliver groundbreaking solutions to some of the world’s toughest problems—and see your work have real, lasting impact!
What you'll be doing:
Own SRE solutions end‑to‑end, from design and implementation to operation and continuous improvement, ensuring they integrate cleanly with HPC schedulers, storage, and network fabrics.
Use IaC(Infrastructure‑as‑Code) and config management to standardize and automate provisioning everywhere.
Deliver solutions in a globally distributed, multi‑cloud hybrid environment – On‑prem, AWS, GCP, and OCI.
Design for failure with redundancy, failure domains, progressive delivery, and strict change control.
Ensure the highest level of uptime and Quality of Service (QoS) for internal customers through operational excellence.
Conduct capacity management and planning to meet ongoing operational needs.
Detects performance issues and recommends solutions to maintain world‑class service quality.
Collaborate with various teams in a fast‑paced environment to ensure seamless project completion.
Participate in on-call, incident reviews, assist in root cause identification, and produce high-quality RCA reports.
What we need to see:
B.S. degree in Computer Science or related technical field (or equivalent experience) with 5+ years professional experience building and supporting critical services.
Experience supporting large‑scale HPC clusters using Slurm, LSF or Kubernetes clusters, including setup, tuning, and troubleshooting.
Proficiency in modern CI/CD techniques, and Infrastructure as Code (IaC) for managing services.
Strong experience crafting large-scale infrastructure platforms for automated host lifecycle management, fleet reliability/auto-healing, E2E observability or data-driven operations (AIOps/ML-driven signals) that materially reduce manual intervention.
Proficient in monitoring, metrics, container management, and log collection tools.
5+ years of coding/scripting experience in at least two high‑level programming languages such as Python, Go, Perl, or Ruby.
Mentored other engineers and influenced technical direction through design reviews, architecture documents, and strong partnership with product and leadership.
Creative problem solver with excellent debugging skills and strong communication and documentation abilities.
Ways to stand out from the crowd:
Published technical write‑ups or talks (conference presentations, meetups, engineering blogs) that deep‑dive into real‑world reliability, observability, or large‑scale HPC/SRE problems and their solutions.
Maintainer or co‑maintainer responsibilities for an open source component used in production (plugins, operators, exporters, controllers, or SDKs) at large scale.
Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. We have some of the most brilliant and talented people in the world working for us and, due to unprecedented growth, our world-class engineering teams are growing fast. If you're a creative and autonomous engineer with real passion for technology, we want to hear from you.
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.You will also be eligible for equity and benefits.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.