Middle Data Engineer

Why this role exists:

This role exists to design, build, and maintain streaming data solutions based on Apache Kafka and related technologies, ensuring reliable data processing, integration, and testing of streaming applications.

What you’ll drive:

• Build and maintain data pipelines using Apache Kafka, including topics, partitions, and consumer group tuning.
• Implement and manage Kafka Connect source and sink connectors for integrations.

• Design and develop stateful streaming applications using Kafka Streams or Flink with Java (and Scala where applicable).
• Ensure data consistency and schema evolution using Schema Registry (Avro).

• Write and maintain unit and integration tests for streaming topologies.

What makes you a GR8 fit:

Must-have

• 3+ years of experience in back end.
• Commercial experience in software engineering with strong proficiency in Java (Scala is a plus).
• Understanding of Apache Kafka architecture and internals.
• Experience working with Apache Flink.
• Experience with Schema Registry and schema evolution strategies.
• Knowledge of serialization formats such as Avro and JSON.
• Experience using SQL for processing large datasets.
• Upper-intermediate or higher level of English.

Nice-to-have

• Experience running Kafka and/or Flink on Kubernetes.
• Familiarity with monitoring tools such as Prometheus and Grafana for streaming metrics.
• Understanding of stream processing semantics.
• Experience with CI/CD pipelines for streaming applications.