Research Engineer/Research Scientist, Pre-training

Stack

Responsibilities

• ▹Research and implement solutions in model architecture, algorithms, data processing, and optimizer development
• ▹Independently lead small research projects and collaborate on larger initiatives
• ▹Design, run, and analyze scientific experiments on large language models
• ▹Optimize and scale training infrastructure for efficiency and reliability
• ▹Develop and improve dev tooling to boost team productivity
• ▹Contribute across the stack, from low-level optimizations to high-level model design

Requirements

• ▹Advanced degree (MS or PhD) in Computer Science, Machine Learning, or a related field
• ▹Strong software engineering skills with a track record of building complex systems
• ▹Expertise in Python and deep learning frameworks (PyTorch preferred)
• ▹Familiarity with large-scale machine learning, particularly language models
• ▹Ability to balance research goals with practical engineering constraints

Nice to have

• ▹Experience with high-performance, large-scale ML systems
• ▹Familiarity with GPUs, Kubernetes, and OS internals
• ▹Experience with transformer-based language modeling
• ▹Knowledge of reinforcement learning techniques
• ▹Background in large-scale ETL processes

Soft skills

What we offer

• ▹Annual salary $350,000-$850,000 USD
• ▹Optional equity donation matching
• ▹Generous vacation and parental leave
• ▹Flexible working hours
• ▹Office space for in-person collaboration
• ▹Visa sponsorship considered

About the company

Anthropic is a public benefit corporation building reliable, interpretable, and steerable AI systems, with the mission of ensuring AI is safe and beneficial for society; the team spans research, engineering, policy, and business.