Nvidia brand banner

Senior HPC Cluster Engineer - AI, ML

NvidiaBengaluru, IndiaPosted 3d ago
via Workday

NVIDIA is a pioneer in accelerated computing, known for inventing the GPU and driving breakthroughs in gaming, computer graphics, high-performance computing, and artificial intelligence. Our technology powers everything from generative AI to autonomous systems, and we continue to shape the future of computing through innovation and collaboration. Within this mission, our team, Managed AI Superclusters (MARS) builds and scales the infrastructure, platforms, and tools that enable researchers and engineers to develop the next generation of AI/ML systems. By joining us, you’ll help design solutions that power some of the world’s most advanced computing workloads.

NVIDIA is looking for a Senior AI/ML HPC Cluster Engineer to join our MARS team. You will provide leadership and strategic guidance on the management of large-scale HPC systems including the deployment of compute, networking, and storage. You will be working with a team of passionate and skilled engineers across NVIDIA that are continuously working to provide better tools to build and manage this infrastructure. Ideal candidate is strong in building and maintaining distributed clusters, driving improvements, and has the ability to understand researcher computing needs. 

What you'll be doing:

  • Provide leadership in systems administration and service delivery on our AI/HPC fleet by coordinating system upgrades, responding to incidents, and delivering reliability improvements.

  • Collaborate closely with global teams to deliver a world class user experience in AI and HPC research. 

  • Own day-to-day operations of production AI/HPC clusters, ensuring system health, user satisfaction, and efficient resource utilization.

  • Develop and improve our ecosystem around GPU-accelerated computing including developing scalable automation solutions.

  • Build and maintain heterogeneous AI/ML clusters on-premises and in the cloud.

  • Create and cultivate customer and cross-team relationships to meet user evolving user needs.

  • Support our researchers to run their workloads including performance analysis and optimizations

  • Analyze and optimize cluster efficiency, job fragmentation, and GPU waste to meet internal SLA targets.

  • Conduct root cause analysis and suggest corrective action Proactively find and fix issues before they occur.

  • Lead SEV triage and postmortems for reliability incidents affecting users or infrastructure.

  • Participate in on-call rotation and incident response for critical production GPU clusters.

What we need to see:

  • Bachelor’s degree in Computer Science, Electrical Engineering or related field or equivalent experience

  • Minimum 5 years of experience designing and operating large scale compute infrastructure

  • Experience with AI/HPC advanced job schedulers, such as Slurm, K8s, PBS, RTDA, BCM, or LSF

  • Proficient in administering Centos/RHEL and/or Ubuntu Linux distributions

  • Solid understanding of cluster configuration management tools (BCM, Terraform, Ansible, Puppet, Salt, etc.), container technologies (Docker, Singularity, Podman, Shifter, Charliecloud), Python programming, and bash scripting. 

  • Applied experience with AI/HPC workflows that use MPI

  • Experience analyzing and tuning performance for a variety of AI/HPC workloads.

  • Passion for continual learning and staying ahead of emerging technologies and effective approaches in the HPC and AI/ML infrastructure fields.

Ways to stand out from the crowd:

  • Background with NVIDIA GPUs, CUDA Programming, NCCL and MLPerf benchmarking

  • Experience with AI/ML concepts, algorithms, models, and frameworks (PyTorch, Tensorflow)

  • Experience with InfiniBand with IPoIB and RDMA

  • Understanding of fast, distributed storage systems such as Lustre and GPFS for AI/HPC workloads

Similar roles

  • 360Learning logo

    Solutions Engineer DACH (m/f/d)

    360Learning·Berlin, Germany

    As a Solutions Engineer, you will be working at the intersection of Sales, Product and Customer Success, working with top learning and development organizations to align their growth objectives to 360learning capabilities. As the first Solutions Engineer for the German market, you will play a crucial role in ensuring the region’s success, but you will have the support from the…

    • On-site
    • Full-time
    • Blue Cardtied; settle 21–33mo
  • The Exploration Company logo

    Avionics Manufacturing Team Lead

    The Exploration Company·Munich, Germany

    Here at The Exploration Company, we are developing, producing, and operating Nyx, a modular and reusable space orbital vehicle that can eventually be refuelled in orbit and that can carry cargo - and potentially humans in the longer run. The Avionics Manufacturing Team Lead will be responsible for managing a team of technicians to assemble, integrate, and test avionics equipment…

    • On-site
    • Full-time
    • Blue Cardtied; settle 21–33mo
  • The Exploration Company logo

    EGSE Engineer

    The Exploration Company·Munich, Germany

    Here at The Exploration Company, we are developing, producing, and operating Nyx, a modular and reusable space orbital vehicle that can eventually be refuelled in orbit and that can carry cargo - and potentially humans in the longer run. Key Responsibilities: * Design, develop, and maintain Electrical Ground Support Equipment (EGSE) sub-system and system level testing * Define and implement…

    • On-site
    • Full-time
    • Blue Cardtied; settle 21–33mo
  • The Exploration Company logo

    Launcher Propulsion Engineer

    The Exploration Company·Munich, Germany

    Here at The Exploration Company, we are developing, producing, and operating Nyx, a modular and reusable space orbital vehicle that can eventually be refuelled in orbit and that can carry cargo - and potentially humans in the longer run. Our Future Projects unit is dedicated to expanding and complementing these capabilities by conceptualizing and pre-developing new technologies, products and programs.…

    • On-site
    • Full-time
    • Blue Cardtied; settle 21–33mo
  • Nirman Consultants logo

    Project Manager

    Nirman Consultants·New Delhi, India

    Company Description: Nirman Consultants is an ISO 9001:2015 certified, award-winning full-service architecture consultancy established in 1990. The firm operates as a total project management organization, offering single-window consulting across architecture, engineering, sustainability, landscape, and urban planning. Nirman Consultants has successfully delivered projects across India and internationally, spanning industrial, commercial, institutional, residential, and mixed-use developments. …

    • Full-time
  • Right Advisors Private Limited logo

    Real Estate Sales Manager

    Right Advisors Private Limited·Faridabad, India

    Real Estate Sales Manager Location: Faridabad Work Mode: Work from Office Experience: 3–5 Years Please Note: The maximum budget for this position is ₹6.5 LPA . Candidates with higher CTC expectations are kindly requested not to apply . Key Responsibilities: Drive sales for residential/commercial real estate projects. Generate leads, develop client relationships, and convert prospects. Conduct client meetings, property/site visits,…

    • Full-time
  • Emoha Eldercare logo

    Telemedicine Doctor (MBBS)

    Emoha Eldercare·Gurugram, India

    We're looking for an MBBS-qualified physician to deliver online consultations to patients through our platform. You'll manage a full consultation load independently — history taking, assessment, prescribing where appropriate, and knowing when a case needs in-person or specialist care. This is a clinical role, not an advisory one. You will be responsible for patient outcomes. WHAT YOU'LL DO * Conduct…

    • Full-time
  • Clera logo

    Head of GTM

    Clera·Worldwide

    ABOUT THE ROLE An early-stage ambient AI / personal productivity startup is hiring a Head of GTM to fully own go-to-market strategy and brand — from funnel logic to narrative — across both strategy and execution. This is a founding-level, player/coach role that is critical to launching and scaling the product, driving acquisition, and building market presence from zero. The…

    • On-site
    • Full-time