https://kafka.apache.org/43/design/Recent content in Design on Apache KafkaHugo -- gohugo.ioenhttps://kafka.apache.org/43/design/design/Mon, 01 Jan 0001 00:00:00 +0000https://kafka.apache.org/43/design/design/Motivation We designed Kafka to be able to act as a unified platform for handling all the real-time data feeds a large company might have. To do this we had to think through a fairly broad set of use cases. It would have to have high-throughput to support high volume event streams such as real-time log aggregation. It would need to deal gracefully with large data backlogs to be able to support periodic data loads from offline systems.https://kafka.apache.org/43/design/protocol/Mon, 01 Jan 0001 00:00:00 +0000https://kafka.apache.org/43/design/protocol/Kafka protocol guide This document covers the wire protocol implemented in Kafka. It is meant to give a readable guide to the protocol that covers the available requests, their binary format, and the proper way to make use of them to implement a client. This document assumes you understand the basic design and terminology described here Preliminaries Network Kafka uses a binary protocol over TCP. The protocol defines all APIs as request response message pairs.