Data Engineer

Stack

Responsibilities

• ▹Build and maintain BigQuery data models using Dataform, following medallion architecture patterns (Bronze/Silver/Gold)
• ▹Contribute to Looker dashboards and LookML models
• ▹Write performant, well-structured SQL for large-scale transformations in BigQuery
• ▹Implement data quality checks using Dataform assertions and automated alerting
• ▹Support data observability across the warehouse: pipeline health, data freshness, anomaly detection
• ▹Build and maintain robust Python data pipelines with testing, linting and CI/CD integration
• ▹Work with orchestration tooling (Cloud Composer / Airflow) to schedule and monitor workflows
• ▹Develop familiarity with CDC concepts and event-driven ingestion patterns (Datastream, Pub/Sub)
• ▹Containerise workloads with Docker for deployment on Cloud Run or similar GCP services
• ▹Support Data Scientists in moving work from notebook to production pipeline
• ▹Contribute to feature pipelines and data preparation for ML workloads

Requirements

• ▹SQL proficiency - comfortable writing complex, performant queries against large datasets in BigQuery
• ▹Dataform experience, or strong dbt experience with willingness to work in Dataform; understanding of modular, version-controlled data transformation
• ▹Python with an engineering mindset - clean, tested, linted code; comfortable with Git and CI/CD workflows
• ▹GCP familiarity - hands-on BigQuery experience essential; broader GCP exposure (Cloud Storage, Cloud Run, Pub/Sub, Datastream) a strong advantage
• ▹Orchestration experience - Cloud Composer, Airflow or a comparable tool
• ▹Data modelling fundamentals - dimensional modelling, Kimball principles or medallion architecture patterns
• ▹Docker basics - able to containerise and deploy data workloads
• ▹Collaborative and communicative - able to translate business requirements into data models
• ▹Pragmatic approach to AI tooling

Nice to have

• ▹Looker / LookML experience
• ▹Familiarity with CDC concepts and tools (Datastream, Debezium)
• ▹Exposure to ML frameworks or MLOps tooling (scikit-learn, MLflow, Vertex AI)
• ▹AWS experience as a complement (Redshift, Glue, RDS)

Soft skills

About the company

Kitman Labs is the performance intelligence company, transforming how the sports industry uses data to unlock the potential of the world's top athletes through its Intelligence Platform (iP). The platform is used by over 2000 teams in 50 leagues on 6 continents, including the NFL, Premier League, NWSL and MLS.