Engineering Manager - AI Product (100% Remote EMEA)

Stack

Responsibilities

• ▹Lead, mentor, and grow a small, high-performing AI platform and product engineering team
• ▹Drive architectural direction for the AI product, focused on inference performance, reliability, cost efficiency, and developer experience
• ▹Contribute hands-on to the design and implementation of core AI systems (model serving, inference pipelines, retrieval, orchestration, evaluation)
• ▹Own the AI/ML platform end to end: GPU capacity and scheduling, model deployment and versioning, data and embedding pipelines, monitoring and quality evaluation
• ▹Collaborate closely with Product, Infrastructure, Security, and Backend teams
• ▹Conduct regular 1:1s, performance reviews, and technical coaching
• ▹Foster a culture of ownership and engineering excellence
• ▹Translate strategic objectives into actionable execution plans
• ▹Influence the evolution of the AI platform through pragmatic, forward-looking technical decisions
• ▹Champion best practices across development, automation, evaluation, and operations

Requirements

• ▹7+ years of software engineering experience, including 2+ years in a technical leadership or engineering management role
• ▹Proven experience building and operating an AI/ML platform or inference infrastructure in production (model serving, GPU workloads, latency and cost optimization)
• ▹Experience building distributed backend systems, strong Python skills
• ▹Hands-on familiarity with the modern LLM stack: model APIs and open-weight models, serving frameworks (vLLM, TGI, Triton or similar), retrieval/vector databases, prompt and context engineering
• ▹Strong grasp of AI product quality: evaluation frameworks, benchmarking, regression testing, observability for non-deterministic systems
• ▹Strong expertise in cloud platforms (AWS preferred: EC2, ECS, Lambda, IAM, CloudWatch) and GPU compute
• ▹Familiarity with Kubernetes, containerization, and Infrastructure-as-Code (Terraform, Pulumi, AWS CDK)
• ▹Understanding of CI/CD automation (GitHub Actions, CircleCI, or similar)
• ▹Strong knowledge of Linux systems, networking fundamentals, and monitoring/alerting best practices
• ▹Excellent communication and leadership skills
• ▹Strong technical judgment balancing hands-on coding with strategic and people responsibilities

Nice to have

• ▹A systems language such as Go or Rust alongside Python

Soft skills

About the company

The client is a European technology company operating a cloud and infrastructure platform.