← Back to list
Job · Senior

Senior Prompt Engineer – Project Lion – Italy (Remote, Part-Time)

Other • Senior • Remote • Part-time • Italy Italy

Senior Prompt Engineer role responsible for the end-to-end technical migration of templates to LLM autoraters, owning prompt optimization and quality-control workflows for the Italian market, remote and part-time.

Responsibilities

  • ▹Use Automatic Prompt Generation (APG) tools to create baseline prompts for complex parent-child template clusters
  • ▹Run and supervise the Automated Prompt Optimization (APO) tool, review outputs, and flag deadlocks or plateaus
  • ▹Manually draft, test and refine prompts to navigate complex template architectures and handle edge cases
  • ▹Monitor shadowbot runs to ensure sufficient human-LLM disagreements are captured
  • ▹Run prompt versions against gold data to measure autorater quality against the human baseline (F1, precision, recall)
  • ▹Draft launch readiness documentation (Launch Certification Documentation)

Requirements

  • ▹Native fluency in Italian and fluent English
  • ▹Based in Italy
  • ▹Bachelor's, Master's or Doctorate degree in Computer Science, Data Science, Computational Linguistics, HCI, Cognitive Science or a related field
  • ▹At least 4 years of experience as a Prompt Engineer
  • ▹Experience tuning LLMs for structured outputs and classification tasks, familiarity with chain-of-thought and few-shot learning
  • ▹Strong data analysis skills, proficiency in SQL or other analytics tools
  • ▹Ability to quickly master proprietary tools with minimal supervision
  • ▹Excellent verbal and written communication skills

Nice to have

  • ▹Familiarity with enterprise-grade LLM interfaces such as the Goose API
  • ▹Experience in AI model evaluation, data science, computational linguistics or software engineering
  • ▹Hands-on experience with Automated Prompt Optimization systems or tuning workflows
  • ▹Linguistic expertise, including semantics and logic

Soft skills

Independent problem-solving on edge casesFast learning with minimal supervisionExcellent communication
Languages: Olasz: Anyanyelvi szint, Angol: Felsőfok
Education: Számítástudomány, adattudomány, számítási nyelvészet, HCI, kognitív tudomány vagy kapcsolódó terület egyetemi diplomája (BSc/MSc/PhD)

Similar jobs