← Zurück zur Liste
Stelle

Member of Technical Staff (Software Engineer, Data Platform)

Data Engineer • Vor Ort • Vollzeit • 📍 San Francisco

Own the end-to-end data lifecycle at Perplexity — ingestion, processing, storage and serving — shaping the architecture for batch and streaming systems that power products, analytics and AI workloads.

Responsibilities

  • Design and operate large-scale batch and streaming data pipelines for products, AI training/evaluation, analytics and experimentation
  • Build event-driven/streaming systems (Kafka, Kinesis, PubSub) alongside batch frameworks for backfills and offline computation
  • Lead data orchestration architecture (Airflow/Dagster): scheduling, dependencies, retries, SLAs, observability
  • Set and enforce guarantees for data correctness, freshness, lineage and recoverability
  • Build self-serve data platforms letting engineers, scientists and analysts discover data and run their own pipelines
  • Improve developer experience through abstractions, paved paths and data-quality standards
  • Drive architectural decisions across storage, compute, orchestration and data APIs
  • Mentor engineers and raise the technical bar for data infrastructure

Requirements

  • 5+ years (Senior) or 8+ years (Staff) of software engineering experience
  • Strong experience building production data infrastructure systems
  • Hands-on experience with batch and/or streaming data processing at scale
  • Deep familiarity with data orchestration systems (Airflow, Dagster or similar)
  • Proficiency in Python plus at least one additional backend language (Go, TypeScript, etc.)
  • Strong systems thinking around reliability, latency, cost and complexity tradeoffs
  • Experience supporting ML/AI workflows, training pipelines or evaluation systems
  • Familiarity with data quality, lineage, observability and governance tooling

Soft skills

MentorshipSystems thinkingCross-team collaborationOwnership of internal platforms

About the company

Perplexity is an AI-powered answer engine that combines multiple leading models with real-time web search to deliver fast, trustworthy, citation-backed answers. In 2026 it launched Computer, a general-purpose agentic AI product used by millions to turn knowledge into action.

Ähnliche Stellen