Senior Engineering Manager, AI

Responsibilities

• ▹Manage, mentor and grow a team of up to 10 senior/staff engineers (mostly in North America)
• ▹Own the strategy and architecture of the AI Gateway, currently processing up to 1 trillion LLM tokens/week with projected 10x growth
• ▹Ensure high availability, sub-millisecond routing, caching, queueing and robust fallback mechanisms
• ▹Strategically guide integration, evaluation and management of 6+ LLM vendors and 50+ models
• ▹Partner with product management, AI research teams and executives to align the gateway roadmap
• ▹Define engineering best practices, architectural standards and token-based cost-tracking telemetry

Requirements

• ▹Proven track record managing and growing high-performing teams of senior and staff engineers
• ▹Experience designing and operating high-throughput, low-latency distributed systems (routing, caching, queueing, rate limiting)
• ▹Ability to engage in high-level architectural discussions and provide technical direction
• ▹Exceptional communication and strategic partnership skills to align engineering, product and executive stakeholders
• ▹Active embrace of AI tools in developer workflows

Nice to have

• ▹Experience in applied AI, with frameworks such as LangChain, LangGraph, LiteLLM or OpenRouter
• ▹Experience with orchestrators and proxies (Temporal, Envoy or similar enterprise gateway technologies)
• ▹Experience with Python, Java and highly distributed caching/queueing systems

Soft skills

What we offer

• ▹Equity compensation
• ▹Generous benefits program

About the company

AlphaSense delivers market intelligence and search built on trusted AI, drawing on public and private content such as equity research, company filings, expert calls and news. Following the 2024 acquisition of Tegus, it serves over 6,000 enterprise customers, headquartered in New York with 2,000+ employees across the US, UK, Finland, India, Singapore, Canada and Ireland.