Staff Research Engineer (LLM Pre-Training)

Stack

Responsibilities

• ▹Work with stakeholders to convert business requirements into technical specifications
• ▹Train LLMs from scratch on a large GPU cluster
• ▹Collect and process pre-training and fine-tuning datasets
• ▹Support and improve existing subsystems

Requirements

• ▹Experience in design, deployment and support of production ML systems
• ▹Strong theoretical background in NLP and transformer-based approaches
• ▹Proficiency with modern deep learning frameworks such as PyTorch and common NLP libraries
• ▹Experience in distributed training of multi-billion parameter models
• ▹Attention to detail and great communication skills

Nice to have

• ▹LLM inference frameworks such as vLLM, DeepSpeed, TensorRT
• ▹LLM alignment techniques such as RLHF/RLAIF
• ▹MLOps tools and practices, including CI/CD for ML
• ▹K8s and Kubeflow
• ▹Scientific publications in the NLP field

Soft skills

About the company

JetBrains has been building robust and effective developer tools since 2000. It is now working on a platform that provides AI capabilities to all JetBrains products, based on in-house models and integration with strategic partners.