Senior Data Engineer

Stack

Responsibilities

• ▹Extract data from various sources
• ▹Work with Hadoop and Spark
• ▹Use Apache NiFi, Apache Airflow, or custom scripting
• ▹Contribute to advancing the data ecosystem
• ▹Work with Kafka, Druid and Grafana
• ▹Build data processing systems designed for scalability
• ▹Perform data modelling and data warehousing

Requirements

• ▹6+ years of experience in data extraction from various sources
• ▹6+ years of hands-on experience with Hadoop and Spark
• ▹6+ years of experience in Apache NiFi, Apache Airflow or custom scripting
• ▹A proven track record using Python and/or Go
• ▹Expertise in Kafka, Druid and Grafana
• ▹Proficiency in data processing systems designed for scalability
• ▹A strong background in data modelling and data warehousing

About the company

A company building advanced media streaming solutions, tackling some of the world's most demanding technical challenges.