Project Lion - Senior Prompt Engineer - Portugal (Remote, Part-Time)

Stack

Responsibilities

• ▹Use Automatic Prompt Generation (APG) tools to create baseline prompts for complex template clusters
• ▹Run and supervise the Automated Prompt Optimization (APO) tool, reviewing outputs and flagging deadlocks
• ▹Manually draft, test, and refine prompts for complex template architectures and edge cases
• ▹Solve edge-case scenarios by designing and refining manual prompts
• ▹Monitor shadowbot runs to track human-LLM rating disagreements
• ▹Run prompt versions against gold data, calculating F1, precision, and recall
• ▹Draft Launch Certification Documentation

Requirements

• ▹Native fluency in Portuguese and fluent English
• ▹Must be based in Portugal
• ▹Bachelor's, Master's, or Doctorate in Computer Science, Data Science, Computational Linguistics, HCI, Cognitive Science, or a related field
• ▹At least 4 years' experience as a Prompt Engineer
• ▹Proven experience tuning LLMs for structured outputs and complex classification tasks
• ▹Familiarity with chain-of-thought and few-shot learning
• ▹Strong SQL and data analysis skills
• ▹Excellent verbal and written communication

Nice to have

• ▹Familiarity with enterprise-grade LLM interfaces (e.g. Goose API)
• ▹Experience in AI model evaluation, data science, computational linguistics, or software engineering
• ▹Hands-on experience with Automated Prompt Optimization (APO) systems
• ▹Linguistic expertise in semantics and logic

Soft skills

About the company

Welo Global is a global company working on LLM-based autorater systems and related prompt engineering.