Developer Technology Engineer - AI
NVIDIA is seeking a passionate, world-class software engineer to join its Compute Developer Technology team(DevTech). Our team has over 150 engineers across Beijing, Shanghai, Shenzhen, Taipei, Seoul, and Sydney. We understand algorithms, GPU, and real-world applications. Our mission is to connect the NVIDIA platform with developers worldwide. We dive deep into customer projects to solve performance bottlenecks. We use insights from workloads to guide next-generation NVIDIA hardware and software. If you are driven by innovation and ambition, this is the team for you!
What you'll be doing:
Working directly with key application developers to understand the current and future problems they are solving. You will build and optimize core parallel algorithms and data structures to deliver the most effective solutions using GPUs, through both library development and direct contribution to applications. This includes training and inference optimization for large language models (LLM), contributing to frameworks and open-source projects in the large language models ecosystem, such as Megatron and TRTLLM, SGLang, vLLM...
Collaborating closely with the architecture, research, libraries, tools, and system software teams at NVIDIA to influence the build of next-generation architectures, software platforms, and programming models. This includes investigating impact on application performance and developer efficiency, and turning real-world developer feedback into actionable platform improvements.
Engaging in deep optimization of high-performance operators, involving but not limited to GPU kernel optimization, instruction-level tuning, and compiler optimization. These optimizations will directly support customers or be coordinated within computation libraries and open-source projects across the community, like cuDNN, cuBLAS, and CUTLASS and Open- source libs like DeepGEMM, FlashMLA, FlashAttention, Flashinfer...
Improving communication for broad distributed large language models workloads. You will spearhead advancements in distributed training and inference by refining communication libraries(NCCL，NCCL GIN , NVSHMEM) and engaging in open-source communication libraries(like DeepEP, NCCL EP). This demands in-depth study of interconnect topologies(NVLINK) and network protocols(InfiniBand/RoCE) to design efficient data transfer strategies and methods for compute-communication overlap.
What we need to see:
A degree or equivalent experience from a university in an engineering or computer science related field. A masters or doctoral degree is preferred.
2+ years of work experience.
Solid understanding of C, C++, Python, or Fortran.
Strong knowledge of software development, programming techniques, and algorithms.
Strong mathematical fundamentals, including linear algebra and numerical methods.
Background in parallel programming and accelerated computing, with comprehensive knowledge of parallel architectures and methods for performance analysis and tuning. Experience in GPU programming is desirable.
Experience in full-stack performance analysis and optimization within at least one of these areas: large language models and high-performance computing. Having expertise ranging from operator-level through framework-level to algorithm-level optimization is strongly preferred.
Experience in distributed communication optimization is highly advantageous. This involves familiarity with remote direct memory access, GPU interconnects, collective communication algorithms, and associated open-source libraries used in large-scale model training and inference.
Solid software engineering fundamentals and system architecture thinking, with the ability to build modules and drive engineering practices in complex systems.
Strong communication and cooperation abilities, with the capability to work efficiently alongside architecture, research, and software product teams to promote optimization from concept to production.
Similar roles
Senior System Software Engineer, Modeling and Validation
Nvidia·Shanghai, China
NVIDIA is looking for a System Software Engineer to help build the modeling, validation, and bringup infrastructure that enables next-generation SoC and GPU platforms from early pre-silicon development through post-silicon debug. This role combines low-level platform software development with system-level validation and execution workflows across C-model, emulation, and silicon environments. We are looking for engineers with strong software fundamentals, hands-on…
- Full-time
Software Test Engineer (m/w/d)
FoxTalent·Nuremberg, Germany
TASKS ▪ Du unterstützt das Team im Bereich Software-Testing und Software-Qualitätssicherung ▪ Du bist verantwortlich für die Sicherstellung unseres hohen Software-Qualitätsanspruchs hinsichtlich Funktionalität, UX, Sicherheit, Performance und Zuverlässigkeit ▪ Du führst manuelle und automatisierte Software-Tests (Unit, Integration, End-to-End, System, Regression) basierend auf Anforderungen sowie Risiken durch und übernimmst die eigenständige Planung des Testumfangs ▪ Du definierst und pflegst Testfälle, Testpläne…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
C++ Software Engineer - Data Platform
Worldquant·London, Canada
<div class="content-intro"><p>WorldQuant develops and deploys systematic financial strategies across a broad range of asset classes and global markets. We seek to produce high-quality predictive signals (alphas) through our proprietary research platform to employ financial strategies focused on market inefficiencies. Our teams work collaboratively to drive the production of alphas and financial strategies – the foundation of a balanced, global investment…
- On-site
- Full-time
- Express Entry — PR day one, no employer
Senior Python / C++ Software Engineer
Worldquant·London, Canada
<div class="content-intro"><p>WorldQuant develops and deploys systematic financial strategies across a broad range of asset classes and global markets. We seek to produce high-quality predictive signals (alphas) through our proprietary research platform to employ financial strategies focused on market inefficiencies. Our teams work collaboratively to drive the production of alphas and financial strategies – the foundation of a balanced, global investment…
- On-site
- Full-time
- Express Entry — PR day one, no employer
Full-Stack Software Engineer - AI Native Startup (m/f/d)
Auxilius.ai·Munich, Germany
You'll join an early-stage, AI-native startup with a product that has already proven market fit. We build cutting-edge AI solutions for Governance, Risk and Compliance (GRC) for enterprises around the world. Our customers are auditors, risk managers, and compliance teams, which means evaluation rigor, auditability, and EU AI Act readiness aren't afterthoughts for us. They're product requirements. TASKS As a…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Full Stack Developer
Akkodis·Italy
Akkodis è un'azienda leader che opera nel settore della consulenza e dei servizi tecnologici. È specializzata in soluzioni di ingegneria, IT e digitalizzazione, offrendo supporto a diverse industrie, tra cui automotive, aerospaziale, energia, life sciences e telecomunicazioni. Akkodis si concentra sull'innovazione e sulla trasformazione digitale, aiutando le aziende a ottimizzare i loro processi e a implementare nuove tecnologie. Con la…
- Full-time
Engineering Manager
Digital Zone·United Arab Emirates
You will build and lead the engineering team behind new online stock trading product, from zero to launch and beyond. This is a founding engineering leadership role on a greenfield product in a domain where correctness is not negotiable: orders, positions, and money must be right every time, under latency and market-hours pressure. You will hire the team, set the…
- Remote
- Full-time
- Green Visa — self-sponsored, no tie
Staff Software Engineer, Time and Scheduling
Gusto, Inc.·Worldwide
---------------------------------------- About Gusto At Gusto, we're on a mission to grow the small business economy. We handle the hard stuff — payroll, health insurance, 401(k)s, and HR — so owners can focus on their craft and their customers. With teams in Denver, San Francisco, and New York, we support more than 500,000 small businesses nationwide and are building a workplace…
- Remote
- Full-time
