Kafka Expert (m/f/d) - Freelancer

Stack

Responsibilities

• ▹Design, build and operate Kafka clusters (self-managed and/or Confluent Cloud / MSK)
• ▹Design and implement event-streaming and event-driven architectures
• ▹Develop and optimize producers, consumers and stream-processing pipelines (Kafka Streams / ksqlDB / Flink)
• ▹Connect source and target systems via Kafka Connect (source/sink connectors)
• ▹Ensure performance, scalability, high availability and fault tolerance
• ▹Monitoring, alerting and troubleshooting (e.g. Prometheus, Grafana, Confluent Control Center)
• ▹Establish best practices for topic design, partitioning, schema management and data governance
• ▹Knowledge transfer and enablement of the internal team

Requirements

• ▹Several years of proven experience with Apache Kafka in production environments
• ▹Deep understanding of Kafka internals (brokers, partitions, replication, consumer groups, offsets, ISR)
• ▹Hands-on experience with Kafka Connect and the Confluent ecosystem
• ▹Experience with stream processing (Kafka Streams, ksqlDB or Apache Flink)
• ▹Schema management with Schema Registry (Avro / Protobuf / JSON Schema)
• ▹Solid programming skills (Java, Scala and/or Python)
• ▹Experience with cloud platforms (AWS MSK, Confluent Cloud, Azure Event Hubs or similar)

Nice to have

• ▹Confluent certification (CCDAK / CCAAK)
• ▹Experience with Kubernetes and containerization (e.g. Strimzi Operator)
• ▹Infrastructure as Code knowledge (Terraform, Ansible)
• ▹Security experience (mTLS, SASL, ACLs, RBAC)
• ▹Experience in projects within the transport and logistics industry

About the company

evoila Germany GmbH is an owner-managed IT company focused on cloud, security and data.