Narendra Lakshmana Gowda tunes a Kafka cluster:
Apache Kafka is known for its ability to process a huge quantity of events in real time. However, to handle millions of events, we need to follow certain best practices while implementing both Kafka producer services and consumer services.
Before start using Kafka in your projects, let’s understand when to use Kafka:
Much of the advice is pretty standard for performance tuning in Kafka, like setting batch size and linger time on the producer or managing consumers in a consumer group.