Nvidia brand banner

Senior Solution Architect, Generative AI - CSP

NvidiaBengaluru, IndiaPosted just now
via Workday

NVIDIA’s Solution Architect team is looking for a AI-focused Solution Architect with expertise in Large Language Model, generative AI, agentic AI. We work with the most exciting computing hardware and software, driving the latest breakthroughs in artificial intelligence. We need individuals who can enable customer productivity and develop lasting relationships with our technology partners, making NVIDIA an integral part of end-user solutions. We are looking for someone always thinking about artificial intelligence, someone who can maintain constructive collaboration in a fast paced, rapidly evolving field, someone able to coordinate efforts between corporate marketing, industry business development and engineering. You will be working with the latest AI architecture coupled with the most advanced neural network models, changing the way people interact with technology.
 

What You Will Be Doing:

  • Architect end-to-end generative AI solutions with a focus on LLMs training , deployment and RAG workflows.

  • Collaborate closely with customers to understand their language-related business challenges and design tailored solutions.

  • Work closely with NVIDIA engineering teams to provide feedback and contribute to the evolution of generative AI software.

  • Engage directly with customers/partners to understand their requirements and challenges.

  • Lead workshops and design sessions to define and refine generative AI solutions focused on LLMs and RAG workflows and lead the training and optimization of Large Language Models using NVIDIA’s hardware and software platforms.

  • Implement strategies for efficient and effective training of LLMs to achieve optimal performance.

  • Provide technical leadership and guidance on best practices for training LLMs and implementing RAG-based solutions.

What We Need To See:

  • Master's or Ph.D. in Computer Science, Artificial Intelligence, or equivalent experience

  • 7+ years of hands-on experience in a technical AI role, specifically focusing on generative AI, with a strong emphasis on training Large Language Models (LLMs).

  • Proven track record of successfully deploying and optimizing LLM models for inference in production environments.

  • Expertise in training and fine-tuning LLMs using popular frameworks such as Megatron-LM, Megatron-Bridge, AutoModel and PyTorch.

  • Proficiency in model deployment and optimization techniques for efficient inference on various hardware platforms, with a focus on GPUs.

  • Strong knowledge of GPU cluster architecture and the ability to leverage parallel processing for accelerated model training and inference.

  • Excellent communication and collaboration skills with the ability to articulate complex technical concepts to both technical and non-technical stakeholders.

  • Experience leading workshops, training sessions, and presenting technical solutions to diverse audiences.

Ways To Stand Out From The Crowd:

  • Experience in deploying LLM models in cloud environments (e.g., AWS, Azure, GCP) and on-premises infrastructure.

  • Proven ability to optimize LLM models for inference speed, memory efficiency, and resource utilization.

  • Familiarity with containerization technologies (e.g., Docker) and orchestration tools (e.g., Kubernetes) for scalable and efficient model deployment.

  • Deep understanding of GPU cluster architecture, parallel computing, and distributed computing concepts.

  • Hands-on experience with NVIDIA GPU technologies, and GPU cluster management and ability to design and implement scalable and efficient workflows for LLM training and inference on GPU clusters

Similar roles

  • Nvidia logo

    Senior Developer Relations Manager - Conglomerates

    Nvidia·Mumbai, India

    NVIDIA is the leading full-stack accelerated computing company, powering the next wave of generative AI, agentic AI, deep learning, data science, cloud-native AI, and edge AI. This role will lead hands-on Developer Relations with India's AI Labs, helping researchers, ML infrastructure teams, and startup CTOs adopt NVIDIA platforms for model development, training, optimization, deployment, and production inference. The ideal candidate…

    • Full-time
  • Associa logo

    Strata Manager

    Associa·Vancouver, Canada

    Looking for a Fresh Start in Property Management? If you're a top performer in property management, but feel like your current office environment isn't supporting your growth, it might be time for a change. Join the dynamic team at Associa Vancouver, where we’ve built a fully functional, collaborative workplace, with no office politics, just professionals doing great work together. This…

    • Hybrid
    • Full-time
    • Express EntryPR day one, no employer
  • Rubrik Job Board logo

    Senior Product Designer II

    Rubrik Job Board·India

    SENIOR PRODUCT DESIGNER II Location: Bangalore,India About Rubrik Join the public powerhouse that is securing the future of AI. Rubrik has officially entered a new era. Fresh off a headline-making successful IPO and boasting over $1.57 Billion in ARR, we have the market stability of a giant and the hunger of a startup. We’ve already conquered Data Security—now, we are…

    • Full-time
  • Airbnb logo

    Disaster Response Coordinator

    Airbnb·United States

    Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a…

    • Remote
    • Full-time
  • JOEY Restaurants logo

    Private Events Manager - JOEY Markville

    JOEY Restaurants·Markham, Canada

    This is about you. Your passion, purpose and potential. In you we see care, drive, confidence and curiosity. When you join our team, you can expect intensity, excitement and energy. Through our culture of people development, we are committed to the continuous learning and growth of our teams. As the Private Events Manager, you'll support exceptional private event experiences through…

    • Full-time
    • Express EntryPR day one, no employer
  • WFYI Public Media logo

    Reporter, Health

    WFYI Public Media·Indianapolis, United States

    JOB POSTING Title: Reporter, Health Location: Indianapolis, IN Department: News ABOUT WFYI WFYI is a nonprofit organization that, for more than 50 years, has been providing trusted journalism, inspiring stories, and lifelong learning to Central Indiana with a vision of an informed, inspired, and inclusive Indiana. JOB SUMMARY WFYI Public Media seeks an experienced health reporter to contribute to its…

    • On-site
    • Full-time
  • South Country Equipment logo

    Parts Supervisor

    South Country Equipment·Regina, Canada

    Are you looking to work with a family-owned business with corporate resources? Does working with innovation and cutting edge technology excite you? Would you like working in an environment where you have the freedom to achieve your career goals? Then look no further than South Country Equipment! We are a family-owned, 8-location John Deere dealer network that operates through southern…

    • Full-time
    • Express EntryPR day one, no employer
  • South Country Equipment logo

    Agriculture Equipment Mechanic

    South Country Equipment·Raymore, Canada

    Are you looking to work with a family-owned business with corporate resources? Does working with innovation and cutting edge technology excite you? Would you like working in an environment where you have the freedom to achieve your career goals? Then look no further than South Country Equipment! We are a family-owned, 8-location John Deere dealer network that operates through southern…

    • Full-time
    • Express EntryPR day one, no employer