Senior Machine Learning Engineer: Search Quality

Stack

Responsibilities

• ▹LLM-based evaluation: fine-tune in-house models to assess relevance, understand query intent, represent items from messy catalog data and align model judgments with real user behavior
• ▹Real-time quality in production: reranking, filtering and signal computation under strict latency requirements
• ▹Automated quality monitoring and agentic insights: pipelines to detect degradations and find underperforming patterns
• ▹Agent-based systems that generate actionable recommendations for product data and search configurations
• ▹Optimize and scale LLM inference across the entire customer base

Requirements

• ▹4+ years shipping production ML systems
• ▹Experience with search, information retrieval or recommendation systems
• ▹Hands-on experience with fine-tuning, evaluation frameworks and scaling LLM deployments
• ▹Strong Python and PyTorch
• ▹Fluency in SQL and data orchestration tools (Spark, Airflow)
• ▹Experience designing and running A/B tests to validate model impact
• ▹Excellent English communication skills
• ▹Experience collaborating in cross-functional teams (ranking, product, data engineering)

Soft skills

What we offer

• ▹Work with smart and empathetic people
• ▹Regular team offsite events
• ▹Fully remote team, choose where you live
• ▹Unlimited vacation time (at least 3 weeks per year encouraged)
• ▹Work from home stipend
• ▹Apple laptops for new employees
• ▹Annual training and development budget
• ▹Maternity and paternity leave
• ▹Stock options on top of base salary

About the company

Constructor, launched in 2019, is an AI-first ecommerce search and discovery platform that helps leading global e-commerce brands drive meaningful revenue and conversion gains.