← Zurück zur Liste
Stelle · Lead

GenAI Test Manager

Morgan Stanley
QA / Test Engineer • Lead • Vor Ort • Vollzeit • 📍 Budapest
📄 Originalanzeige ansehen (EN)

A GenAI Test Manager role in Morgan Stanley's HR AI Model Validation team, leading the execution and evolution of HR's GenAI testing and release-readiness approach. The role ensures agentic AI capabilities perform reliably and meet oversight standards, partnering with global risk, governance, product and engineering teams.

Stack

AI/ML

Responsibilities

  • ▹Run structured end-to-end testing and regression cycles for agent-based, workflow-driven AI tools as models and prompts evolve
  • ▹Coordinate cross-functional testing activities, ensuring findings are documented, triaged and driven to closure
  • ▹Maintain and refine the testing framework, including test artifacts and evaluation criteria
  • ▹Develop assessments, defect summaries and risk indicators to support evidence-based release decisions
  • ▹Partner with global risk, governance, product and engineering teams to align testing with GenAI oversight standards

Requirements

  • ▹Around five or more years of experience testing complex or evolving systems (AI, ML, workflow automation, or multi-step digital products)
  • ▹Ability to design, execute and improve structured test plans, regression suites and scenario-based evaluations
  • ▹Demonstrated ability coordinating across global stakeholders, engineering and control partners
  • ▹Understanding of data quality dependencies, model behavior variability and AI operational risks
  • ▹Familiarity with GenAI behaviors, prompt variability, agent frameworks or evaluation methodologies

Soft skills

Cross-functional coordinationClear documentation and communicationDriving alignment across teamsAttention to detail

What we offer

  • ▹Comprehensive employee benefits and perks
  • ▹Hybrid working arrangement
Languages: angol