Senior Solutions Architect - Large Scale AI Training

Stack

Responsibilities

• ▹Build and manage strategic technical relationships with leading EMEA AI model builders
• ▹Work with customers to define the software stack and infrastructure for large-scale training and post-training workflows, including Reinforcement Learning (RL)
• ▹Serve as the go-to expert on distributed training strategies, guiding customers through efficient training and post-training recipes with PyTorch, Megatron-LM or NeMo (RL/Gym)
• ▹Help customers optimize training/finetuning efficiency at scale: GPU utilization, communication overlap, memory management
• ▹Present customer needs to NVIDIA's product and research teams
• ▹Animate the developer community by building or supporting hackathons, demos and technical conferences

Requirements

• ▹MS or PhD in Computer Science, Engineering, or equivalent experience
• ▹Over 7 years of practical experience in distributed AI training, including direct involvement with HPC and/or AI environments with multi-node GPU clusters
• ▹Solid understanding of training infrastructure and how it affects efficiency and scalability
• ▹Strong proficiency with Megatron-LM, NeMo, or equivalent distributed training frameworks
• ▹Excellent communication skills with research scientists and infrastructure engineers

Nice to have

• ▹Experience fine-tuning with Reinforcement Learning (RLVR, RLHF) at scale
• ▹Experience with LatentMoE, expert load balancing and speculative decoding for MoE inference
• ▹Prior experience in an AI datacenter/HPC center, national lab or frontier AI lab
• ▹Published work or open-source contributions in distributed training

Soft skills

What we offer

• ▹Highly competitive salary and comprehensive benefits package
• ▹For Poland the base salary range is 292,500 - 507,000 PLN

About the company

NVIDIA is widely considered one of the technology world's most desirable employers and is committed to a diverse work environment.