← Back to list
Job
Member of Engineering (Pre-training / Data Research)
AI / ML Engineer
• Remote
• Full-time
• 📍 Remote (EMEA
Poolside, a company building frontier coding-focused LLMs and agentic systems on its path to AGI, is hiring an engineer for its data team. The hands-on role centers on improving the quality of pretraining datasets through synthetic data generation and data mix optimization, leading time-bounded research experiments while deploying production-grade engineering solutions on a distributed data pipeline and large GPU cluster. The team is fully remote across Europe and North America, meeting in Paris three days each month.
Responsibilities
- ▹Improve the quality of the pretraining datasets used to train Poolside's models and coding agents, including synthetic data generation and data mix optimization
- ▹Design and implement complex pipelines that generate large amounts of data while maintaining high diversity and optimizing available resources
- ▹Lead original research initiatives through short, time-bounded experiments and deploy highly technical engineering solutions into production
- ▹Suggest, conduct and analyze data ablations and training experiments that improve dataset quality through quantitative insights
- ▹Collaborate closely with the Pretraining, Posttraining, Evals and Product teams to ensure short feedback loops on model quality
- ▹Follow the latest research on LLMs and data quality, and stay familiar with the most relevant open-source datasets and models
Requirements
- ▹Strong machine learning and engineering background
- ▹Experience with Large Language Models (LLMs): understanding of transformer architectures and how LLMs learn, data ablations and scaling laws, mid-training and post-training techniques, training reasoning and agentic models
- ▹Experience with evals tracking model capabilities (general knowledge, reasoning, math, coding, long-context, etc.)
- ▹Experience building trillion-scale pretraining datasets and familiarity with data curation, deduplication, data mixing, tokenization, curriculum, and the impact of data repetition
- ▹Excellent programming skills in Python
- ▹Strong prompt engineering skills
- ▹Experience working with large-scale GPU clusters and distributed data pipelines
- ▹Strong obsession with data quality
- ▹Ability to freely discuss the latest papers down to fine details and be reasonably opinionated
Nice to have
- ▹Author of scientific papers on applied deep learning, LLMs, source code generation or related topics
Soft skills
Intellectual curiosityStrong work ethic and obsession with qualityCollaborative, low-ego mindsetReasonably opinionated
What we offer
- ▹Fully remote work and flexible hours
- ▹37 days/year of vacation and holidays
- ▹Health insurance allowance for you and dependents
- ▹Company-provided equipment
- ▹Well-being, always-be-learning and home office allowances
- ▹Frequent team get-togethers (monthly 3-day gathering in Paris, yearly off-site)
- ▹Diverse and inclusive, people-first culture