← Zurück zur Liste
Stelle · Senior

Senior Prompt Engineer – Project Lion – Italy (Remote, Part-Time)

Sonstige • Senior • Remote • Teilzeit Italien Italien

Senior Prompt Engineer role responsible for the end-to-end technical migration of templates to LLM autoraters, owning prompt optimization and quality-control workflows for the Italian market, remote and part-time.

Responsibilities

  • Use Automatic Prompt Generation (APG) tools to create baseline prompts for complex parent-child template clusters
  • Run and supervise the Automated Prompt Optimization (APO) tool, review outputs, and flag deadlocks or plateaus
  • Manually draft, test and refine prompts to navigate complex template architectures and handle edge cases
  • Monitor shadowbot runs to ensure sufficient human-LLM disagreements are captured
  • Run prompt versions against gold data to measure autorater quality against the human baseline (F1, precision, recall)
  • Draft launch readiness documentation (Launch Certification Documentation)

Requirements

  • Native fluency in Italian and fluent English
  • Based in Italy
  • Bachelor's, Master's or Doctorate degree in Computer Science, Data Science, Computational Linguistics, HCI, Cognitive Science or a related field
  • At least 4 years of experience as a Prompt Engineer
  • Experience tuning LLMs for structured outputs and classification tasks, familiarity with chain-of-thought and few-shot learning
  • Strong data analysis skills, proficiency in SQL or other analytics tools
  • Ability to quickly master proprietary tools with minimal supervision
  • Excellent verbal and written communication skills

Nice to have

  • Familiarity with enterprise-grade LLM interfaces such as the Goose API
  • Experience in AI model evaluation, data science, computational linguistics or software engineering
  • Hands-on experience with Automated Prompt Optimization systems or tuning workflows
  • Linguistic expertise, including semantics and logic

Soft skills

Independent problem-solving on edge casesFast learning with minimal supervisionExcellent communication
Languages: Olasz: Anyanyelvi szint, Angol: Felsőfok
Education: Számítástudomány, adattudomány, számítási nyelvészet, HCI, kognitív tudomány vagy kapcsolódó terület egyetemi diplomája (BSc/MSc/PhD)

Ähnliche Stellen