Distributed Systems Engineer - Data Platform (Delivery, Database, Retrieval)

Stack

Responsibilities

• ▹Design, develop and maintain scalable and reliable distributed systems across the entire data lifecycle
• ▹Build and optimize key components of the high-throughput data delivery platform to ensure data integrity and low-latency delivery
• ▹Develop new and improve existing components for the Cloudflare Analytical Platform to extend functionality and performance
• ▹Scale, monitor and maintain the performance of large-scale database clusters to accommodate growing data volume
• ▹Develop and enhance customer-facing GraphQL APIs, log delivery and alerting solutions, focusing on performance, reliability and user experience
• ▹Identify and remove bottlenecks across data platforms, from streamlining ingestion to optimizing query performance
• ▹Collaborate with other teams across Cloudflare to understand their data needs and build solutions that empower data-driven decisions
• ▹Collaborate with the ClickHouse open-source community to add features and contribute to the upstream codebase
• ▹Participate in developing the next generation of data platforms, researching and evaluating new technologies
• ▹Flexibility to be on-call outside of standard working hours to address technical issues

Requirements

• ▹3+ years of experience in software development covering distributed systems and databases
• ▹Strong programming skills (Golang preferable), with a deep understanding of software development best practices and principles
• ▹Hands-on experience with modern observability stacks (Prometheus, Grafana) and handling high-cardinality metrics at scale
• ▹Strong knowledge of SQL and database internals, including database design, optimization and performance tuning
• ▹Solid foundation in computer science: algorithms, data structures, distributed systems and concurrency
• ▹Strong analytical and problem-solving skills, with willingness to debug and troubleshoot complex problems at scale
• ▹Ability to work collaboratively and communicate effectively with other teams across Cloudflare

Nice to have

• ▹Experience with ClickHouse
• ▹Experience with data streaming technologies (e.g. Kafka, Flink)
• ▹Experience developing and scaling APIs, particularly GraphQL
• ▹Experience with Infrastructure as Code tools like SALT or Terraform
• ▹Experience with Linux container technologies such as Docker and Kubernetes

Soft skills

What we offer

• ▹Medical/Rx Insurance
• ▹Dental Insurance
• ▹Vision Insurance
• ▹Flexible Spending Accounts
• ▹Commuter Spending Accounts
• ▹Fertility & Family Forming Benefits
• ▹On-demand mental health support and Employee Assistance Program
• ▹Global Travel Medical Insurance
• ▹Short and Long Term Disability Insurance
• ▹Life & Accident Insurance
• ▹401(k) Retirement Savings Plan
• ▹Employee Stock Participation Plan
• ▹Flexible paid time off covering vacation and sick leave
• ▹Leave programs, including parental, pregnancy health, medical, and bereavement leave

About the company

Cloudflare's Data organization owns the entire data lifecycle — from ingestion and processing to storage and retrieval — handling over a billion events per second.