Senior Data Engineer

Stack

Responsibilities

• ▹Design and implement robust, scalable data architecture for large volumes of iGaming and customer data
• ▹Build and maintain efficient ETL and ELT processes from multiple sources into the data lake and DWH
• ▹Create and maintain well-structured data models following Kimball best practices
• ▹Collaborate with cross-functional teams on data integration (API, Kafka, DB extraction, webscraping, email)
• ▹Develop and manage real-time data pipelines using streaming technologies such as Kafka
• ▹Enforce data governance policies and best practices for data quality, security, and compliance
• ▹Continuously monitor, troubleshoot, and optimize data pipelines, queries, and infrastructure
• ▹Support and expand production-grade orchestration workflows using Apache Airflow
• ▹Set up and maintain monitoring, alerting, and observability (Elementary, Datadog, Prometheus, Grafana)
• ▹Develop and maintain CI/CD pipelines using Bitbucket Pipelines or GitHub Actions
• ▹Follow Git-based version control best practices in a modern DevOps environment

Requirements

• ▹5+ years of experience with Python, preferably including 2+ years with Airflow
• ▹5+ years of experience with SQL in big data environments, preferably including 2+ years with dbt
• ▹4+ years in cloud environments, preferably with 2+ years each in Snowflake and AWS
• ▹2+ years of experience with data streaming platforms, preferably Kafka

Soft skills

About the company

Ventures Lab is an international company with over 200 employees, specializing in the iGaming and Fintech industries.