Member of Technical Staff (Software Engineer, Data Flywheel)

Stack

Responsibilities

• ▹Build systems and pipelines that let Search, Product, and other teams independently access reliable eval verdicts without bottlenecks
• ▹Own the "evals-to-product" loop, turning raw signals into durable, decision-making datasets
• ▹Build a robust simulator pipeline that replays user interactions in formats legible to LLMs and VLMs, reflecting shipped product changes
• ▹Maintain data trust via monitoring, lineage, and quality checks
• ▹Work in a small, high-impact team that directly shapes how Answer Quality is measured and improved

Requirements

• ▹3+ years of software engineering experience shipping production systems
• ▹Strong Python and SQL, writing production-grade, maintainable code
• ▹Experience with big data systems including distributed compute and large-scale storage
• ▹Solid fundamentals in data modeling, system design, and debugging distributed systems
• ▹Experience with AWS and lakehouse ecosystems like Databricks or Spark
• ▹Comfortable with agentic coding workflows and AI-assisted development tools

Nice to have

• ▹Data engineering background including pipelines, orchestration, and warehousing patterns
• ▹Familiarity with LLM/VLM interfaces, tokenization, structured formats, multimodal payloads
• ▹Experience with evaluation platforms, experimentation systems, or ML infrastructure
• ▹Prior work supporting customer-facing products at scale

Soft skills

About the company

Perplexity serves tens of millions of users daily with reliable, high-quality answers grounded in an LLM-first search engine and specialized data sources. The Answer Quality team ensures that prompts, tools, search, and specialized datasets, combined with frontier and in-house models, create the best possible experience for users.