Build your own Kafka

Apache Kafka is a distributed event streaming platform often used for high-performance data pipelines. In this challenge, you'll build your own Kafka broker that's capable of serving basic requests.

Along the way you'll learn about TCP servers, the Kafka wire protocol and more.

In this challenge extension you'll add support for serving multiple clients simultaneously.

Along the way you'll learn about TCP connections, how to handle concurrency and more.

In this challenge extension you'll add support for listing topic partitions by implementing the DescribeTopicPartitions API.

Along the way you'll learn about how Kafka stores messages on disk, the __cluster_metadata topic and more.

In this challenge extension you'll add support for consuming messages by implementing the Fetch API.

Along the way you'll learn about how Kafka's Fetch API works, how Kafka stores messages on disk and more.

In this challenge extension you'll add support for producing messages by implementing the Produce API.

Along the way you'll learn about how Kafka's Produce API works, how Kafka stores messages on disk and more.