Staff Observability Engineer

Stack

Responsibilities

• ▹Lead end-to-end observability design, telemetry schemas and OpenTelemetry pipeline architectures across products, platform services, data pipelines and internal tools
• ▹Define service-level indicators, objectives, error budgets and production-readiness requirements with engineering and product teams
• ▹Architect comprehensive AI observability solutions for Amazon Bedrock and agentic workflows, tracking model selection, latency, retries, token usage, tool execution and cost attribution
• ▹Establish end-to-end traceability across user requests, prompts, model calls, retrieved context, downstream services and final responses while maintaining data privacy and security controls
• ▹Develop automated dashboards, alerts, SLOs, runbooks and operational views for rapid incident diagnosis, performance optimization and economic sustainability
• ▹Define measurable signals for response quality, groundedness, guardrail outcomes and task completion across AI systems
• ▹Participate in the on-call rotation (approximately 20% of the time) and drive proactive failure injection, production testing and capacity planning

Requirements

• ▹6+ years in Site Reliability, Observability or Platform Engineering supporting 24x7x365 production systems
• ▹Deep experience with OpenTelemetry and platforms like Datadog, Sumo Logic, Prometheus or Grafana for telemetry, logging, tracing and alerting
• ▹Experience designing observability for distributed systems, APIs, event-driven architectures and asynchronous workflows
• ▹Hands-on experience instrumenting AI/ML or GenAI systems, including model invocation, prompts, retrieval, tool use and evaluation
• ▹Proficiency with Amazon Bedrock or similar platforms to track model usage, latency, throttling, token metrics and cost attribution
• ▹Familiarity with agentic workflows, prompt engineering, vector databases (e.g. Neptune), RAG architectures and frameworks like LangChain, LlamaIndex or SageMaker
• ▹Proficiency in Java, Python or Go
• ▹Strong AWS expertise, with an understanding of cloud networking, IAM, security and service quotas
• ▹Solid IaC, CI/CD and container experience (Terraform, Kubernetes, Argo CD, Jenkins or GitHub Actions)
• ▹Experience with data modeling, telemetry pipelines, cardinality management, retention, responsible AI and data privacy controls
• ▹Strong communication, mentoring and cross-functional leadership skills across engineering, product and non-technical stakeholders

Soft skills

What we offer

• ▹Base salary range of 290,000 - 375,000 PLN per year, with possible eligibility for a performance-based bonus and equity options
• ▹Remote-first working, with new hire stipends for setting up a home office
• ▹Equity grants for new hires
• ▹Paid time off, extended paid parental leave and company holidays
• ▹Health and wellness programs
• ▹15 hours of paid work time per year for volunteer activities
• ▹Professional development: over 6,000 on-demand courses and leadership development programs
• ▹Market-competitive benefits programs (vary by level and location)

About the company

Tealium is the trusted leader in real-time Customer Data Platforms (CDP), supporting the data strategies of more than 800 global brands. Its team is present in nearly 20 countries and the company holds over 50 patents.