Software Engineer (Backend), Enterprise

Stack

Responsibilities

• ▹Design, build, and scale backend systems that power enterprise GenAI products, focusing on reliability, performance, and deployment across both Scale's and customers' infrastructure
• ▹Develop core services and APIs that securely and efficiently integrate AI models and enterprise data sources
• ▹Architect scalable distributed systems for data processing, inference, and orchestration of large-scale GenAI workloads
• ▹Optimize backend performance for latency, throughput, and cost across hybrid and multi-cloud environments
• ▹Manage and evolve cloud infrastructure (AWS, Azure, or GCP), driving automation, observability, and security for large-scale AI deployments
• ▹Collaborate with ML and product teams to bring cutting-edge GenAI models into production through efficient APIs, model serving systems, and evaluation frameworks
• ▹Continuously improve reliability and scalability by applying strong engineering practices

Requirements

• ▹4+ years of experience developing large-scale backend or infrastructure systems
• ▹Proficiency in Python or TypeScript
• ▹Experience designing high-performance APIs using frameworks such as FastAPI, Flask, Express, or NestJS
• ▹Deep familiarity with cloud infrastructure (AWS and Azure preferred)

Soft skills

About the company

Scale AI is pioneering the next era of enterprise AI, with the Scale Generative AI Platform (SGP) providing foundational services and APIs that let businesses seamlessly integrate AI into their operations at production scale.