Student Assistant - LLM Security

Stack

Responsibilities

• ▹Develop methods to improve the security of LLMs, with a strong focus on defending against common attacks such as backdoor attacks and the jailbreaks that follow from them
• ▹Systematically evaluate the robustness of LLMs against established and novel attack scenarios, such as backdoor attacks, divergence attacks, or membership inference attacks
• ▹Investigate, apply, and evaluate post-hoc explainability methods to analyze model behavior, aiming for a deeper understanding of the underlying attack mechanisms and the effectiveness and limits of corresponding defense strategies

Requirements

• ▹Very good Python skills (verified in the interview)
• ▹Basic understanding of AI/ML, mainly with regard to transformers
• ▹Enrolled student (computer science, data science, mathematics, or similar)
• ▹Structured, independent way of working and team spirit
• ▹Strong analytical thinking

Nice to have

• ▹Experience with PyTorch and transformer architectures is desirable

Soft skills

What we offer

• ▹Attractive pay: EUR 18.06/hour for bachelor's students, EUR 18.78/hour for master's students
• ▹Flexible working hours that fit well alongside your studies
• ▹An inspiring working environment with state-of-the-art infrastructure
• ▹The opportunity to gain practical experience and build valuable research contacts
• ▹The chance to contribute to academic papers and later write a bachelor's or master's thesis
• ▹The position can be done remotely or hybrid

About the company

Fraunhofer SIT (Institute for Secure Information Technology) is one of Germany's and Europe's leading cybersecurity research institutes, part of ATHENE, the national research center for applied cybersecurity, working to make tomorrow's digital world more secure.