Senior Software Engineer, Data Platform

Stack

Responsibilities

• ▹Build and extend batch pipelines using dbt for transformations and Dagster for orchestration
• ▹Develop and optimize BigQuery data models for analytics, experimentation, and reporting
• ▹Advance real-time streaming capabilities: Kafka/PubSub + Flink (primarily FlinkSQL) pipelines
• ▹Design data platform standards: SDLC, naming conventions, modeling patterns, schema evolution, CI/CD and testing for batch and streaming
• ▹Improve reliability and observability: monitoring, alerting, SLAs/SLOs
• ▹Partner with analytics, product, and engineering teams to onboard new data sources
• ▹Own platform operations: performance tuning, data quality, cost optimization, scaling
• ▹Design a unified serving layer for batch and streaming systems
• ▹Establish strong data governance, reliability, and observability practices

Requirements

• ▹Strong SQL proficiency (advanced querying, performance, data modeling)
• ▹Hands-on dbt experience (models, tests, sources, macros, snapshots, incremental strategies)
• ▹Experience with batch orchestration tooling (Dagster/Airflow)
• ▹Python proficiency for data engineering tasks
• ▹Deep familiarity with BigQuery or equivalent cloud-native data warehouse tooling
• ▹Solid experience with GCP (AWS/Azure) infrastructure
• ▹Strong engineering fundamentals: version control, testing, code review, documentation, operational ownership

Nice to have

• ▹Data quality tooling and patterns (anomaly detection, expectation-based testing, lineage)
• ▹Experience designing semantic or metrics layers for analytics
• ▹Familiarity with event-driven architectures, schema registries, CDC patterns
• ▹Experience building streaming data pipelines with Kafka and Apache Flink, including FlinkSQL
• ▹Experience with IaC (e.g., Terraform) and CI/CD for data projects

Soft skills

About the company

Apella applies computer vision and machine learning to improve the standard of surgical care, building applications for surgeons, nurses, and hospital administrators.