Danica Fine continues a series on Kafka internals:
Welcome to the second installment of our blog series to understand the inner workings of the beautiful black box that is Apache Kafka®.
We’re diving headfirst into Kafka to see how we actually interact with the cluster through producers and consumers. Along the way, we explore the configurations that affect each step of this epic journey and the metrics that we can use to more effectively monitor the process.
In the last blog, we explored what the Kafka producer client does behind the scenes each time we call
producer.send()(or similar, depending on your language of choice). In this post, we follow our brave hero, a well-formed produce request, that’s on its way to the broker to be processed and have its data stored on the cluster.
Click through to learn more about how it all works.