Manager, AI Benchmarking and Evaluation Research (Remote, ROU)

Stack

Responsibilities

• ▹Leading, mentoring and growing a team of researchers and engineers focused on evaluating AI models applied to cybersecurity tasks
• ▹Defining the strategy, roadmap and success metrics for evaluating AI/LLM and agentic systems across security use cases (incident response, threat hunting, alert triage, investigation)
• ▹Designing and standardizing evaluation methodologies, benchmark datasets and reproducible testing pipelines rooted in real SOC workflows
• ▹Assessing models for accuracy, robustness, reliability and operational effectiveness in security-analyst scenarios
• ▹Establishing quantitative and qualitative metrics reflecting how AI models and agentic systems perform against genuine threat-detection and response challenges
• ▹Collaborating cross-functionally with engineering, product and threat-research teams to translate evaluation findings into scalable improvements
• ▹Communicating results, trade-offs and recommendations clearly to both technical and executive audiences

Requirements

• ▹Hands-on SOC experience with a strong understanding of day-to-day security operations
• ▹At least 3 years in a management or team-leadership position, with a proven track record of mentoring and growing technical teams (formal manager experience is a plus)
• ▹Strong knowledge of incident response and threat hunting, including detection, investigation and remediation workflows
• ▹Broad knowledge of the cybersecurity landscape

About the company

CrowdStrike is a global leader in cybersecurity, working since 2011 to stop breaches and building one of the world's most advanced AI-native platforms. The company runs large-scale distributed systems processing almost 3 trillion events per day, with customers spanning all industries.