Test Lead (AI Validation & Integration)

Stack

Responsibilities

• ▹Design, plan and develop the comprehensive Testing and AI Validation Strategy (functional, unit, E2E, integration, regression and user acceptance testing), address NFRs and align with standards (e.g. GDPR, HIPAA, HITRUST)
• ▹Define validation plans for AI components: what constitutes correct output, success thresholds and evaluation methods (including handling hallucinations and grounding rules)
• ▹Create detailed plans for test environments (Dev/Test/Prod) and the test data strategy, ensuring coverage of standard scenarios, edge cases and ingestion failures
• ▹Execute functional, regression, exploratory, performance and load tests
• ▹Coordinate Joint End-to-End Validation with the client team, managing testing of the Salesforce integration
• ▹Integrate testing activities into the CI/CD pipeline for continuous quality assurance
• ▹Manage Jira test case structures aligned to user stories and acceptance criteria
• ▹Provide regular reporting, tracking key QA metrics such as defect ratios

Requirements

• ▹Fluent English
• ▹Experience defining end-to-end testing strategies for complex solutions
• ▹Experience designing and executing E2E tests for complex, integrated systems using any modern testing technology
• ▹Proven ability to validate AI models (AI/ML/LLM testing experience)
• ▹Experience strategizing and managing test data across multiple environments (Dev/Test/Prod)
• ▹Traceability mindset: linking requirements, test cases, evidence, defects and release decisions
• ▹Experience testing NFRs: performance, reliability, auditability, security basics
• ▹Strong understanding of privacy and sensitive data handling in testing (PII/PHI minimization, masking and anonymization)
• ▹Hands-on automation experience in at least one strong stack, e.g. Python/Java/JS with frameworks (pytest, JUnit etc.)
• ▹Ability to track and report QA metrics such as defect ratios
• ▹Good written and verbal communication skills
• ▹Jira proficiency
• ▹Full-time availability, with overlap during 14:00-18:00 for collaboration with the US-based client

Nice to have

• ▹Familiarity with the AWS platform
• ▹ISTQB or similar certifications
• ▹Previous experience in fast-paced consulting or client-facing projects

Soft skills

About the company

The project is a new solution for an existing client in a highly regulated industry: a data validation and automation engine that processes structured and unstructured inputs against a complex logic framework, using AI models to interpret user-submitted data and integrating with the existing enterprise architecture.