Senior AI Product Engineer, Backend

Stack

Responsibilities

• ▹Write maintainable, scalable, and performant backend code primarily in Go, Java, and Python, with opportunities to work in TypeScript
• ▹Build high-volume and highly available analytics systems
• ▹Design and build APIs specific to customers' machine learning and LLM workflows
• ▹Prototype, optimize, and maintain scalable backend services powering the Arize core platform
• ▹Extend and contribute back to open source OLAP databases and distributed message queue frameworks
• ▹Develop and integrate collection tools for robust monitoring of ML and LLM pipelines
• ▹Research and implement cutting-edge visualization and dimensionality reduction algorithms in a distributed environment
• ▹Collaborate with product, design, and customer engineering teams
• ▹Contribute to building Arize's own in-house AI agents

Requirements

• ▹5+ years of experience working with high-performance backend systems
• ▹Strong experience writing Go, Python, TypeScript/Node, Java, or similar server programming languages
• ▹Enthusiasm and interest in the AI and LLM ecosystem, with a desire to learn and stay updated on emerging technologies
• ▹Previous work building and operating highly complex SaaS platforms/systems
• ▹Knowledge of working with public clouds and container orchestration - AWS, GCP, Azure, Kubernetes, etc.

Nice to have

• ▹Experience with distributed stream processing - Kafka, Gazette, or similar
• ▹Experience with OLAP systems
• ▹Familiarity with system observability tooling like Prometheus
• ▹Working knowledge of machine learning and/or data science
• ▹First-hand experience working with large language models (LLMs) or developing AI products

Soft skills

What we offer

• ▹Estimated annual salary of $125,000-$225,000, plus a competitive equity package
• ▹Comprehensive benefits: medical, dental, vision, 401(k) plan
• ▹Unlimited paid time off, generous parental leave, and mental health/wellness support
• ▹Remote-first company with optional offices in New York City and the San Francisco Bay Area, plus a WFH stipend for co-working spaces

About the company

Arize AI is the leading AI & Agent Engineering observability and evaluation platform, helping AI engineers ship high-performing, reliable agents and applications from first prototype to production scale. The Series C company is backed by over $135M in funding and serves 150+ leading enterprises and Fortune 500 companies, including Booking.com, Uber, Siemens, and PepsiCo.