Senior Data Platform Engineer

Stack

Responsibilities

• ▹Build complex, high-volume batch and near-real-time ingestion services while helping evolve the platform's streaming capabilities
• ▹Design and implement data solutions for application requirements in a distributed microservices environment
• ▹Develop and optimize large-scale data pipelines for batch and streaming use cases
• ▹Ensure data quality, compliance and governance
• ▹Manage and optimize Kubernetes infrastructure, using KEDA to dynamically scale resources for large-scale data processing workloads
• ▹Own the full lifecycle of the data stack using Terraform and Kubernetes, from provisioning to application-level frameworks
• ▹Provide technical guidance for the team, drive best practices around infrastructure, CI/CD and system design
• ▹Deep-dive into memory management and performance tuning to keep large-scale distributed systems cost-effective and fast

Requirements

• ▹5+ years of experience as a Data Platform/Infrastructure Engineer
• ▹Proven track record building and operating scalable data infrastructure within Data Lake architectures
• ▹Proven experience designing and operating large-scale data processing workloads on Kubernetes, including workload autoscaling with KEDA
• ▹Strong proficiency in Python and SQL
• ▹Hands-on experience with Infrastructure as Code, preferably Terraform
• ▹Experience managing a data orchestration platform such as Airflow or Prefect
• ▹Experience with Snowflake

What we offer

• ▹Comfortable environment, challenging tasks and a long-term interesting project
• ▹Mobilization reservation available upon successful completion of the probation period (for Ukrainian colleagues)
• ▹20 days of covered vacation
• ▹Top-notch equipment
• ▹Bookkeeping by a professional accountant
• ▹Help and support from a caring HR team