Software Quality Engineer (US)

Stack

Responsibilities

• ▹Define and implement comprehensive QA strategies and test plans for AI agents and LLM-powered applications
• ▹Design and develop robust, scalable automated test frameworks from scratch or enhance existing ones
• ▹Collaborate closely with product managers, ML engineers, and data scientists to translate AI features into effective test cases
• ▹Drive continuous improvement of testing processes and infrastructure, integrating automated checks into CI/CD pipelines
• ▹Identify, document, and track software defects, performing root cause analysis
• ▹Monitor production systems and AI model performance, contributing to post-release quality validation
• ▹Champion quality best practices, manage test data strategies and mock services for stable, repeatable test execution

Requirements

• ▹5+ years of hands-on experience in software QA or engineering, with a strong focus on testing complex distributed systems or AI/ML applications
• ▹5+ years of experience working with GitHub Actions
• ▹Proficiency in Python or TypeScript for test automation, experience with modern testing frameworks such as Playwright
• ▹Solid understanding of AI/ML concepts, including model evaluation metrics, data pipelines, and testing generative AI outputs
• ▹Exceptional analytical skills and a keen eye for detail
• ▹A collaborative spirit that connects cross-functional teams and challenges existing assumptions
• ▹Demonstrated ability to drive initiatives independently in a fast-paced, evolving startup environment

Nice to have

• ▹Experience with cloud platforms (AWS, Azure, GCP) and containerization technologies (Docker, Kubernetes) in a CI/CD environment

Soft skills

What we offer

• ▹Generous PTO, plus company holidays
• ▹Medical, dental, and vision coverage for you and your family
• ▹Paid parental leave for all parents (16 weeks)
• ▹Fertility and family planning support
• ▹Early-detection cancer testing through Galleri
• ▹Flexible spending account and dependent FSA options
• ▹Health savings account with company contribution
• ▹Annual wellness and learning & development stipends
• ▹Company-wide and team off-sites
• ▹Competitive compensation, stock options, and 401k

About the company

WRITER builds the platform that lets the world's leading enterprises orchestrate AI-powered work, with a mission to expand human capacity through superintelligence. Its trustworthy, enterprise-grade LLMs and AI agents power companies like Mars, Marriott, Uber, and Vanguard. Founded in 2020 and valued at $1.9B, backed by investors including Premji Invest, Radical Ventures, and ICONIQ Growth, WRITER has office hubs in San Francisco, New York City, Seattle, Austin, Chicago, and London. This hybrid role is based out of the London, San Francisco, Seattle, or New York City hubs, reporting to the director of engineering.